2023-11-27T17:26:28.814 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-27T17:26:28.815 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467908 -- /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467908/orig.config.yaml 2023-11-27T17:26:28.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T17:26:28.965 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467908 branch: wip-yuri10-testing-2023-11-22-1112 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: yweinste@redhat.com first_in_suite: false job_id: '7467908' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-yuri10-testing-2023-11-22-1112 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-11-22-1112 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8541 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri10-testing-2023-11-22-1112 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-27_17:14:24 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-27T17:26:28.965 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa; will attempt to use it 2023-11-27T17:26:28.966 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks 2023-11-27T17:26:28.966 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-27T17:26:28.970 INFO:teuthology.task.internal:Checking packages... 2023-11-27T17:26:29.002 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '369173db14b6995b2bd07c60ec5f63d01cf21631' 2023-11-27T17:26:29.003 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-27T17:26:29.003 INFO:teuthology.packaging:ref: None 2023-11-27T17:26:29.003 INFO:teuthology.packaging:tag: None 2023-11-27T17:26:29.003 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-11-22-1112 2023-11-27T17:26:29.003 INFO:teuthology.packaging:sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:26:29.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2023-11-22-1112 2023-11-27T17:26:29.153 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7498.g369173db 2023-11-27T17:26:29.154 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-27T17:26:29.161 INFO:teuthology.task.internal:no buildpackages task found 2023-11-27T17:26:29.161 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-27T17:26:29.169 INFO:teuthology.task.internal:Saving configuration 2023-11-27T17:26:29.188 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-27T17:26:29.195 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T17:26:29.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467908', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:15:37.701516', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-27T17:26:29.250 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467908', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:15:37.700412', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-27T17:26:29.250 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-27T17:26:29.257 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-27T17:26:29.257 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-27T17:26:29.257 INFO:teuthology.run_tasks:Running task console_log... 2023-11-27T17:26:29.342 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa347564b80>, signals=[15]) 2023-11-27T17:26:29.343 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-27T17:26:29.350 INFO:teuthology.task.internal:Opening connections... 2023-11-27T17:26:29.351 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2023-11-27T17:26:29.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:26:29.426 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2023-11-27T17:26:29.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:26:29.536 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-27T17:26:29.542 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-11-27T17:26:29.569 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-11-27T17:26:29.569 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-11-27T17:26:29.629 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-27T17:26:29.630 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T17:26:29.631 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:26:29.631 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-27T17:26:29.631 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-27T17:26:29.631 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-27T17:26:29.631 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-27T17:26:29.631 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-11-27T17:26:29.662 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-11-27T17:26:29.679 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-11-27T17:26:29.679 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-11-27T17:26:29.735 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-27T17:26:29.736 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-11-27T17:26:29.736 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-27T17:26:29.736 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T17:26:29.736 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:26:29.736 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-27T17:26:29.736 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-27T17:26:29.736 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-27T17:26:29.736 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-27T17:26:29.736 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-11-27T17:26:29.762 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-27T17:26:29.772 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-27T17:26:29.778 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-27T17:26:29.778 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2023-11-27T17:26:29.780 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2023-11-27T17:26:29.798 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-27T17:26:29.805 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-27T17:26:29.806 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2023-11-27T17:26:29.841 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2023-11-27T17:26:29.869 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-27T17:26:29.926 INFO:teuthology.run_tasks:Running task kernel... 2023-11-27T17:26:29.940 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-11-27T17:26:29.941 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-11-27T17:26:29.941 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-11-27T17:26:29.941 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T17:26:29.942 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T17:26:29.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:26:29.957 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-11-27T17:26:29.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:26:29.960 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2023-11-27T17:26:30.013 INFO:teuthology.orchestra.run.smithi178.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-27T17:26:30.013 INFO:teuthology.task.kernel:Running kernel on smithi178: 4.18.0-372.9.1.el8.x86_64 2023-11-27T17:26:30.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum install -y kernel 2023-11-27T17:26:30.020 INFO:teuthology.orchestra.run.smithi177.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-27T17:26:30.020 INFO:teuthology.task.kernel:Running kernel on smithi177: 4.18.0-372.9.1.el8.x86_64 2023-11-27T17:26:30.020 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum install -y kernel 2023-11-27T17:26:31.201 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-11-27T17:26:31.201 INFO:teuthology.orchestra.run.smithi178.stdout:Unable to read consumer identity 2023-11-27T17:26:31.224 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2023-11-27T17:26:31.225 INFO:teuthology.orchestra.run.smithi177.stdout:Unable to read consumer identity 2023-11-27T17:26:32.854 INFO:teuthology.orchestra.run.smithi177.stdout:Copr repo for python3-asyncssh owned by ceph 9.7 kB/s | 3.5 kB 00:00 2023-11-27T17:26:32.856 INFO:teuthology.orchestra.run.smithi178.stdout:Copr repo for python3-asyncssh owned by ceph 8.6 kB/s | 3.5 kB 00:00 2023-11-27T17:26:38.739 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 2.7 MB/s | 16 MB 00:05 2023-11-27T17:26:39.147 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 2.5 MB/s | 16 MB 00:06 2023-11-27T17:26:42.259 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 432 kB/s | 24 kB 00:00 2023-11-27T17:26:42.612 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 516 kB/s | 24 kB 00:00 2023-11-27T17:26:42.958 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-27T17:26:43.016 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-11-27T17:26:43.017 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-11-27T17:26:43.017 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-11-27T17:26:43.133 DEBUG:teuthology.orchestra.run.smithi178:> echo no | sudo yum reinstall kernel || true 2023-11-27T17:26:43.264 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-27T17:26:43.312 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2023-11-27T17:26:43.313 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2023-11-27T17:26:43.313 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2023-11-27T17:26:43.460 DEBUG:teuthology.orchestra.run.smithi177:> echo no | sudo yum reinstall kernel || true 2023-11-27T17:26:43.475 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-11-27T17:26:43.476 INFO:teuthology.orchestra.run.smithi178.stdout:Unable to read consumer identity 2023-11-27T17:26:43.742 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:01 ago on Mon 27 Nov 2023 05:26:42 PM UTC. 2023-11-27T17:26:43.782 INFO:teuthology.orchestra.run.smithi178.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-27T17:26:43.788 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2023-11-27T17:26:43.789 INFO:teuthology.orchestra.run.smithi177.stdout:Unable to read consumer identity 2023-11-27T17:26:43.835 INFO:teuthology.orchestra.run.smithi178.stderr:Error: No packages marked for reinstall. 2023-11-27T17:26:43.882 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum reinstall -y kernel || true 2023-11-27T17:26:44.046 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:02 ago on Mon 27 Nov 2023 05:26:42 PM UTC. 2023-11-27T17:26:44.088 INFO:teuthology.orchestra.run.smithi177.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-27T17:26:44.139 INFO:teuthology.orchestra.run.smithi177.stderr:Error: No packages marked for reinstall. 2023-11-27T17:26:44.185 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum reinstall -y kernel || true 2023-11-27T17:26:44.210 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-11-27T17:26:44.210 INFO:teuthology.orchestra.run.smithi178.stdout:Unable to read consumer identity 2023-11-27T17:26:44.471 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:02 ago on Mon 27 Nov 2023 05:26:42 PM UTC. 2023-11-27T17:26:44.509 INFO:teuthology.orchestra.run.smithi178.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-27T17:26:44.512 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2023-11-27T17:26:44.512 INFO:teuthology.orchestra.run.smithi177.stdout:Unable to read consumer identity 2023-11-27T17:26:44.541 INFO:teuthology.orchestra.run.smithi178.stderr:Error: No packages marked for reinstall. 2023-11-27T17:26:44.587 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T17:26:44.667 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-27T17:26:44.667 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-27T17:26:44.667 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-27T17:26:44.668 DEBUG:teuthology.parallel:result is None 2023-11-27T17:26:44.768 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:02 ago on Mon 27 Nov 2023 05:26:42 PM UTC. 2023-11-27T17:26:44.811 INFO:teuthology.orchestra.run.smithi177.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-27T17:26:44.839 INFO:teuthology.orchestra.run.smithi177.stderr:Error: No packages marked for reinstall. 2023-11-27T17:26:44.891 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T17:26:44.972 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-27T17:26:44.972 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-27T17:26:44.972 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-27T17:26:44.972 DEBUG:teuthology.parallel:result is None 2023-11-27T17:26:44.973 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-27T17:26:44.982 INFO:teuthology.task.internal:Creating test directory... 2023-11-27T17:26:44.982 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T17:26:44.985 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T17:26:45.004 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-27T17:26:45.014 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-27T17:26:45.057 INFO:teuthology.task.internal:Creating archive directory... 2023-11-27T17:26:45.058 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T17:26:45.061 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T17:26:45.086 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-27T17:26:45.094 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-27T17:26:45.094 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T17:26:45.118 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T17:26:45.153 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:26:45.164 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:26:45.169 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:26:45.176 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:26:45.177 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-27T17:26:45.185 INFO:teuthology.task.internal:Configuring sudo... 2023-11-27T17:26:45.185 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T17:26:45.214 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T17:26:45.247 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-27T17:26:45.256 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-27T17:26:45.257 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T17:26:45.281 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T17:26:45.304 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:26:45.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:26:45.439 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:26:45.521 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:26:45.563 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:26:45.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T17:26:45.630 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:26:45.675 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:26:45.733 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:26:45.819 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:26:45.865 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:26:45.865 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T17:26:45.937 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2023-11-27T17:26:45.939 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2023-11-27T17:26:45.993 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T17:26:46.035 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T17:26:46.466 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-27T17:26:46.475 INFO:teuthology.task.internal:Starting timer... 2023-11-27T17:26:46.476 INFO:teuthology.run_tasks:Running task pcp... 2023-11-27T17:26:46.490 INFO:teuthology.run_tasks:Running task selinux... 2023-11-27T17:26:46.516 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-27T17:26:46.517 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2023-11-27T17:26:46.583 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2023-11-27T17:26:46.584 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2023-11-27T17:26:46.649 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2023-11-27T17:26:46.651 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-27T17:26:46.651 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2023-11-27T17:26:46.676 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2023-11-27T17:26:46.677 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2023-11-27T17:26:46.703 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2023-11-27T17:26:46.703 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi177.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2023-11-27T17:26:46.703 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T17:26:46.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:26:46.746 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T17:26:46.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:26:46.774 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-27T17:26:46.775 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2023-11-27T17:26:46.814 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2023-11-27T17:26:46.842 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-27T17:26:46.853 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-27T17:26:46.853 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-27T17:26:46.878 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-27T17:26:46.879 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi177.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-27T17:44:00.824 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi177.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2023-11-27T17:44:00.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-27T17:44:00.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:44:00.894 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-11-27T17:44:00.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-27T17:44:00.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-11-27T17:44:00.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:44:01.030 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-11-27T17:44:01.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-11-27T17:44:01.100 INFO:teuthology.run_tasks:Running task clock... 2023-11-27T17:44:01.113 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-27T17:44:01.113 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T17:44:01.113 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T17:44:01.116 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T17:44:01.116 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T17:44:01.146 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-27T17:44:01.160 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-27T17:44:01.173 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-27T17:44:01.188 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-27T17:44:01.236 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2023-11-27T17:44:01.248 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2023-11-27T17:44:01.253 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2023-11-27T17:44:01.263 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-27T17:44:01.265 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2023-11-27T17:44:01.277 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-27T17:44:01.279 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-27T17:44:01.293 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-27T17:44:01.344 INFO:teuthology.orchestra.run.smithi177.stderr:bash: ntpq: command not found 2023-11-27T17:44:01.348 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T17:44:01.348 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2023-11-27T17:44:01.348 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T17:44:01.348 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T17:44:01.348 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T17:44:01.348 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T17:44:01.362 INFO:teuthology.orchestra.run.smithi178.stderr:bash: ntpq: command not found 2023-11-27T17:44:01.366 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T17:44:01.366 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2023-11-27T17:44:01.366 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T17:44:01.366 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T17:44:01.366 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T17:44:01.366 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T17:44:01.368 INFO:teuthology.run_tasks:Running task install... 2023-11-27T17:44:01.375 DEBUG:teuthology.task.install:project ceph 2023-11-27T17:44:01.376 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}} 2023-11-27T17:44:01.376 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'} 2023-11-27T17:44:01.376 INFO:teuthology.task.install:Using flavor: default 2023-11-27T17:44:01.383 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-27T17:44:01.383 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-27T17:44:01.383 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'tag': None, 'wait_for_package': False} 2023-11-27T17:44:01.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:44:01.385 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'tag': None, 'wait_for_package': False} 2023-11-27T17:44:01.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:44:01.531 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/8/flavors/default/ 2023-11-27T17:44:01.531 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7498.g369173db 2023-11-27T17:44:01.536 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/8/flavors/default/ 2023-11-27T17:44:01.536 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7498.g369173db 2023-11-27T17:44:01.637 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-27T17:44:01.637 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:44:01.637 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-27T17:44:01.665 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-27T17:44:01.665 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/369173db14b6995b2bd07c60ec5f63d01cf21631/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-27T17:44:01.733 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-27T17:44:01.809 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-27T17:44:01.846 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-27T17:44:01.847 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:44:01.847 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-27T17:44:01.876 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-27T17:44:01.877 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/369173db14b6995b2bd07c60ec5f63d01cf21631/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-27T17:44:01.879 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2023-11-27T17:44:01.881 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2023-11-27T17:44:01.946 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-27T17:44:02.025 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-27T17:44:02.092 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2023-11-27T17:44:02.095 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2023-11-27T17:44:02.254 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2023-11-27T17:44:02.465 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-11-27T17:44:03.265 INFO:teuthology.orchestra.run.smithi177.stdout:44 files removed 2023-11-27T17:44:03.315 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-27T17:44:03.455 INFO:teuthology.orchestra.run.smithi178.stdout:44 files removed 2023-11-27T17:44:03.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-27T17:44:03.645 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2023-11-27T17:44:03.843 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-11-27T17:44:05.502 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 174 kB/s | 81 kB 00:00 2023-11-27T17:44:05.604 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 136 kB/s | 81 kB 00:00 2023-11-27T17:44:06.062 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 18 kB/s | 9.5 kB 00:00 2023-11-27T17:44:06.147 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 19 kB/s | 9.5 kB 00:00 2023-11-27T17:44:06.471 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-11-27T17:44:06.522 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-11-27T17:44:06.780 INFO:teuthology.orchestra.run.smithi178.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-11-27T17:44:06.806 INFO:teuthology.orchestra.run.smithi177.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-11-27T17:44:09.284 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 16 MB 00:02 2023-11-27T17:44:12.781 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 450 kB/s | 24 kB 00:00 2023-11-27T17:44:13.942 INFO:teuthology.orchestra.run.smithi177.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-11-27T17:44:22.417 INFO:teuthology.orchestra.run.smithi177.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 47 MB 00:01 2023-11-27T17:44:28.765 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 744 kB/s | 16 MB 00:21 2023-11-27T17:44:32.292 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 235 kB/s | 24 kB 00:00 2023-11-27T17:44:33.331 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-27T17:44:33.332 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-27T17:44:33.346 INFO:teuthology.orchestra.run.smithi177.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-27T17:44:33.347 INFO:teuthology.orchestra.run.smithi177.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-27T17:44:33.349 INFO:teuthology.orchestra.run.smithi177.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-27T17:44:33.350 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-27T17:44:33.352 INFO:teuthology.orchestra.run.smithi177.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-27T17:44:33.356 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-27T17:44:33.357 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-27T17:44:33.479 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 47 MB 00:01 2023-11-27T17:44:33.492 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2023-11-27T17:44:33.504 INFO:teuthology.orchestra.run.smithi177.stdout:=========================================================================================================================== 2023-11-27T17:44:33.504 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2023-11-27T17:44:33.504 INFO:teuthology.orchestra.run.smithi177.stdout:=========================================================================================================================== 2023-11-27T17:44:33.504 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:18.0.0-7498.g369173db.el8 ceph 6.4 k 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:18.0.0-7498.g369173db.el8 ceph 5.4 M 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:18.0.0-7498.g369173db.el8 ceph 921 k 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7498.g369173db.el8 ceph 171 k 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:18.0.0-7498.g369173db.el8 ceph 1.6 M 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 133 k 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 1.8 M 2023-11-27T17:44:33.505 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 7.4 M 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 50 k 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:18.0.0-7498.g369173db.el8 ceph 14 M 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:18.0.0-7498.g369173db.el8 ceph 49 M 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 262 k 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 411 k 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror x86_64 2:18.0.0-7498.g369173db.el8 ceph 263 k 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 18 k 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-27T17:44:33.506 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:18.0.0-7498.g369173db.el8 ceph 31 k 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:18.0.0-7498.g369173db.el8 ceph 839 k 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:18.0.0-7498.g369173db.el8 ceph 139 k 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:18.0.0-7498.g369173db.el8 ceph 197 k 2023-11-27T17:44:33.507 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:18.0.0-7498.g369173db.el8 ceph 371 k 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:18.0.0-7498.g369173db.el8 ceph 364 k 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:18.0.0-7498.g369173db.el8 ceph 107 k 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:18.0.0-7498.g369173db.el8 ceph 94 k 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:18.0.0-7498.g369173db.el8 ceph 3.6 M 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:18.0.0-7498.g369173db.el8 ceph 181 k 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:18.0.0-7498.g369173db.el8 ceph 3.8 M 2023-11-27T17:44:33.508 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:18.0.0-7498.g369173db.el8 ceph 3.7 M 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:18.0.0-7498.g369173db.el8 ceph 23 M 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 28 k 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:18.0.0-7498.g369173db.el8 ceph 2.3 M 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 242 k 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:18.0.0-7498.g369173db.el8 ceph 4.6 M 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:18.0.0-7498.g369173db.el8 ceph 18 M 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 15 k 2023-11-27T17:44:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:18.0.0-7498.g369173db.el8 ceph 24 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:18.0.0-7498.g369173db.el8 ceph 183 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-27T17:44:33.510 INFO:teuthology.orchestra.run.smithi177.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:18.0.0-7498.g369173db.el8 ceph 517 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:18.0.0-7498.g369173db.el8 ceph 6.9 M 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-27T17:44:33.511 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-27T17:44:33.512 INFO:teuthology.orchestra.run.smithi177.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:18.0.0-7498.g369173db.el8 ceph 45 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:18.0.0-7498.g369173db.el8 ceph 128 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-27T17:44:33.513 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-27T17:44:33.514 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-27T17:44:33.515 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-27T17:44:33.516 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-27T17:44:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout:Enabling module streams: 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql 10 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout:=========================================================================================================================== 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout:Install 128 Packages 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 3 Packages 2023-11-27T17:44:33.518 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:44:33.519 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 209 M 2023-11-27T17:44:33.519 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2023-11-27T17:44:34.267 INFO:teuthology.orchestra.run.smithi177.stdout:(1/131): ceph-18.0.0-7498.g369173db.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2023-11-27T17:44:35.600 INFO:teuthology.orchestra.run.smithi177.stdout:(2/131): ceph-fuse-18.0.0-7498.g369173db.el8.x8 691 kB/s | 921 kB 00:01 2023-11-27T17:44:35.926 INFO:teuthology.orchestra.run.smithi177.stdout:(3/131): ceph-immutable-object-cache-18.0.0-749 526 kB/s | 171 kB 00:00 2023-11-27T17:44:37.959 INFO:teuthology.orchestra.run.smithi177.stdout:(4/131): ceph-mds-18.0.0-7498.g369173db.el8.x86 1.1 MB/s | 2.3 MB 00:02 2023-11-27T17:44:38.034 INFO:teuthology.orchestra.run.smithi177.stdout:(5/131): ceph-base-18.0.0-7498.g369173db.el8.x8 1.3 MB/s | 5.4 MB 00:04 2023-11-27T17:44:39.659 INFO:teuthology.orchestra.run.smithi177.stdout:(6/131): ceph-mgr-18.0.0-7498.g369173db.el8.x86 980 kB/s | 1.6 MB 00:01 2023-11-27T17:44:40.868 INFO:teuthology.orchestra.run.smithi177.stdout:(7/131): ceph-mon-18.0.0-7498.g369173db.el8.x86 1.6 MB/s | 4.6 MB 00:02 2023-11-27T17:44:41.754 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 53 MB 00:01 2023-11-27T17:44:48.568 INFO:teuthology.orchestra.run.smithi177.stdout:(8/131): ceph-radosgw-18.0.0-7498.g369173db.el8 1.8 MB/s | 14 MB 00:07 2023-11-27T17:44:48.667 INFO:teuthology.orchestra.run.smithi177.stdout:(9/131): ceph-selinux-18.0.0-7498.g369173db.el8 244 kB/s | 24 kB 00:00 2023-11-27T17:44:52.953 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-27T17:44:52.954 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-27T17:44:52.968 INFO:teuthology.orchestra.run.smithi178.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-27T17:44:52.969 INFO:teuthology.orchestra.run.smithi178.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-27T17:44:52.970 INFO:teuthology.orchestra.run.smithi178.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-27T17:44:52.972 INFO:teuthology.orchestra.run.smithi178.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-27T17:44:52.974 INFO:teuthology.orchestra.run.smithi178.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-27T17:44:52.977 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-27T17:44:52.978 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-27T17:44:53.109 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-11-27T17:44:53.123 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-11-27T17:44:53.123 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-11-27T17:44:53.123 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-11-27T17:44:53.123 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-11-27T17:44:53.123 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-27T17:44:53.123 INFO:teuthology.orchestra.run.smithi178.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:18.0.0-7498.g369173db.el8 ceph 6.4 k 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:18.0.0-7498.g369173db.el8 ceph 5.4 M 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:18.0.0-7498.g369173db.el8 ceph 921 k 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7498.g369173db.el8 ceph 171 k 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:18.0.0-7498.g369173db.el8 ceph 1.6 M 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 133 k 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 1.8 M 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 7.4 M 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 50 k 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:18.0.0-7498.g369173db.el8 ceph 14 M 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:18.0.0-7498.g369173db.el8 ceph 49 M 2023-11-27T17:44:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 262 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 411 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror x86_64 2:18.0.0-7498.g369173db.el8 ceph 263 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 18 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:18.0.0-7498.g369173db.el8 ceph 31 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:18.0.0-7498.g369173db.el8 ceph 839 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:18.0.0-7498.g369173db.el8 ceph 139 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-27T17:44:53.125 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:18.0.0-7498.g369173db.el8 ceph 197 k 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:18.0.0-7498.g369173db.el8 ceph 371 k 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:18.0.0-7498.g369173db.el8 ceph 364 k 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:18.0.0-7498.g369173db.el8 ceph 107 k 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:18.0.0-7498.g369173db.el8 ceph 94 k 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:18.0.0-7498.g369173db.el8 ceph 3.6 M 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:18.0.0-7498.g369173db.el8 ceph 181 k 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-27T17:44:53.126 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2023-11-27T17:44:53.127 INFO:teuthology.orchestra.run.smithi178.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-27T17:44:53.127 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:18.0.0-7498.g369173db.el8 ceph 3.8 M 2023-11-27T17:44:53.127 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:18.0.0-7498.g369173db.el8 ceph 3.7 M 2023-11-27T17:44:53.127 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-11-27T17:44:53.127 INFO:teuthology.orchestra.run.smithi178.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-27T17:44:53.127 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:18.0.0-7498.g369173db.el8 ceph 23 M 2023-11-27T17:44:53.127 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 28 k 2023-11-27T17:44:53.127 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:18.0.0-7498.g369173db.el8 ceph 2.3 M 2023-11-27T17:44:53.128 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 242 k 2023-11-27T17:44:53.128 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:18.0.0-7498.g369173db.el8 ceph 4.6 M 2023-11-27T17:44:53.128 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:18.0.0-7498.g369173db.el8 ceph 18 M 2023-11-27T17:44:53.129 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7498.g369173db.el8 ceph-noarch 15 k 2023-11-27T17:44:53.129 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:18.0.0-7498.g369173db.el8 ceph 24 k 2023-11-27T17:44:53.129 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-27T17:44:53.129 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-27T17:44:53.129 INFO:teuthology.orchestra.run.smithi178.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-27T17:44:53.129 INFO:teuthology.orchestra.run.smithi178.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-27T17:44:53.130 INFO:teuthology.orchestra.run.smithi178.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-27T17:44:53.130 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:18.0.0-7498.g369173db.el8 ceph 183 k 2023-11-27T17:44:53.130 INFO:teuthology.orchestra.run.smithi178.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-27T17:44:53.130 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-27T17:44:53.130 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:18.0.0-7498.g369173db.el8 ceph 517 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:18.0.0-7498.g369173db.el8 ceph 6.9 M 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-27T17:44:53.131 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:18.0.0-7498.g369173db.el8 ceph 45 k 2023-11-27T17:44:53.132 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:18.0.0-7498.g369173db.el8 ceph 128 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-27T17:44:53.133 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-27T17:44:53.134 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-27T17:44:53.135 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-27T17:44:53.136 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout:Enabling module streams: 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql 10 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout:Install 128 Packages 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 3 Packages 2023-11-27T17:44:53.137 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:44:53.138 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 209 M 2023-11-27T17:44:53.138 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-11-27T17:44:54.113 INFO:teuthology.orchestra.run.smithi178.stdout:(1/131): ceph-18.0.0-7498.g369173db.el8.x86_64. 13 kB/s | 6.4 kB 00:00 2023-11-27T17:44:55.413 INFO:teuthology.orchestra.run.smithi178.stdout:(2/131): ceph-base-18.0.0-7498.g369173db.el8.x8 3.0 MB/s | 5.4 MB 00:01 2023-11-27T17:44:55.530 INFO:teuthology.orchestra.run.smithi178.stdout:(3/131): ceph-immutable-object-cache-18.0.0-749 1.4 MB/s | 171 kB 00:00 2023-11-27T17:44:56.588 INFO:teuthology.orchestra.run.smithi178.stdout:(4/131): ceph-mds-18.0.0-7498.g369173db.el8.x86 2.2 MB/s | 2.3 MB 00:01 2023-11-27T17:44:56.822 INFO:teuthology.orchestra.run.smithi178.stdout:(5/131): ceph-fuse-18.0.0-7498.g369173db.el8.x8 340 kB/s | 921 kB 00:02 2023-11-27T17:44:57.206 INFO:teuthology.orchestra.run.smithi178.stdout:(6/131): ceph-mgr-18.0.0-7498.g369173db.el8.x86 2.6 MB/s | 1.6 MB 00:00 2023-11-27T17:45:00.322 INFO:teuthology.orchestra.run.smithi178.stdout:(7/131): ceph-common-18.0.0-7498.g369173db.el8. 3.4 MB/s | 23 MB 00:06 2023-11-27T17:45:05.096 INFO:teuthology.orchestra.run.smithi178.stdout:(8/131): ceph-osd-18.0.0-7498.g369173db.el8.x86 2.3 MB/s | 18 MB 00:07 2023-11-27T17:45:05.196 INFO:teuthology.orchestra.run.smithi178.stdout:(9/131): ceph-selinux-18.0.0-7498.g369173db.el8 244 kB/s | 24 kB 00:00 2023-11-27T17:45:11.179 INFO:teuthology.orchestra.run.smithi178.stdout:(10/131): ceph-mon-18.0.0-7498.g369173db.el8.x8 331 kB/s | 4.6 MB 00:14 2023-11-27T17:45:12.380 INFO:teuthology.orchestra.run.smithi178.stdout:(11/131): cephfs-mirror-18.0.0-7498.g369173db.e 219 kB/s | 263 kB 00:01 2023-11-27T17:45:12.663 INFO:teuthology.orchestra.run.smithi178.stdout:(12/131): libcephfs-devel-18.0.0-7498.g369173db 109 kB/s | 31 kB 00:00 2023-11-27T17:45:15.855 INFO:teuthology.orchestra.run.smithi178.stdout:(13/131): libcephfs2-18.0.0-7498.g369173db.el8. 263 kB/s | 839 kB 00:03 2023-11-27T17:45:16.047 INFO:teuthology.orchestra.run.smithi177.stdout:(10/131): ceph-test-18.0.0-7498.g369173db.el8.x 1.8 MB/s | 49 MB 00:27 2023-11-27T17:45:16.231 INFO:teuthology.orchestra.run.smithi177.stdout:(11/131): cephfs-mirror-18.0.0-7498.g369173db.e 1.4 MB/s | 263 kB 00:00 2023-11-27T17:45:16.298 INFO:teuthology.orchestra.run.smithi177.stdout:(12/131): libcephfs-devel-18.0.0-7498.g369173db 465 kB/s | 31 kB 00:00 2023-11-27T17:45:16.581 INFO:teuthology.orchestra.run.smithi177.stdout:(13/131): libcephfs2-18.0.0-7498.g369173db.el8. 2.9 MB/s | 839 kB 00:00 2023-11-27T17:45:16.673 INFO:teuthology.orchestra.run.smithi177.stdout:(14/131): libcephsqlite-18.0.0-7498.g369173db.e 1.9 MB/s | 183 kB 00:00 2023-11-27T17:45:16.680 INFO:teuthology.orchestra.run.smithi178.stdout:(14/131): libcephsqlite-18.0.0-7498.g369173db.e 222 kB/s | 183 kB 00:00 2023-11-27T17:45:16.748 INFO:teuthology.orchestra.run.smithi177.stdout:(15/131): librados-devel-18.0.0-7498.g369173db. 1.8 MB/s | 139 kB 00:00 2023-11-27T17:45:16.907 INFO:teuthology.orchestra.run.smithi177.stdout:(16/131): libradosstriper1-18.0.0-7498.g369173d 3.2 MB/s | 517 kB 00:00 2023-11-27T17:45:17.230 INFO:teuthology.orchestra.run.smithi178.stdout:(15/131): librados-devel-18.0.0-7498.g369173db. 253 kB/s | 139 kB 00:00 2023-11-27T17:45:18.316 INFO:teuthology.orchestra.run.smithi177.stdout:(17/131): librgw2-18.0.0-7498.g369173db.el8.x86 4.9 MB/s | 6.9 MB 00:01 2023-11-27T17:45:18.349 INFO:teuthology.orchestra.run.smithi177.stdout:(18/131): python3-ceph-argparse-18.0.0-7498.g36 1.3 MB/s | 45 kB 00:00 2023-11-27T17:45:18.399 INFO:teuthology.orchestra.run.smithi177.stdout:(19/131): python3-ceph-common-18.0.0-7498.g3691 2.5 MB/s | 128 kB 00:00 2023-11-27T17:45:18.475 INFO:teuthology.orchestra.run.smithi177.stdout:(20/131): python3-cephfs-18.0.0-7498.g369173db. 2.6 MB/s | 197 kB 00:00 2023-11-27T17:45:18.559 INFO:teuthology.orchestra.run.smithi177.stdout:(21/131): python3-rados-18.0.0-7498.g369173db.e 4.4 MB/s | 371 kB 00:00 2023-11-27T17:45:18.642 INFO:teuthology.orchestra.run.smithi177.stdout:(22/131): python3-rbd-18.0.0-7498.g369173db.el8 4.3 MB/s | 364 kB 00:00 2023-11-27T17:45:18.700 INFO:teuthology.orchestra.run.smithi177.stdout:(23/131): python3-rgw-18.0.0-7498.g369173db.el8 1.8 MB/s | 107 kB 00:00 2023-11-27T17:45:18.751 INFO:teuthology.orchestra.run.smithi177.stdout:(24/131): rbd-fuse-18.0.0-7498.g369173db.el8.x8 1.8 MB/s | 94 kB 00:00 2023-11-27T17:45:18.830 INFO:teuthology.orchestra.run.smithi178.stdout:(16/131): libradosstriper1-18.0.0-7498.g369173d 323 kB/s | 517 kB 00:01 2023-11-27T17:45:19.368 INFO:teuthology.orchestra.run.smithi177.stdout:(25/131): rbd-mirror-18.0.0-7498.g369173db.el8. 5.8 MB/s | 3.6 MB 00:00 2023-11-27T17:45:19.418 INFO:teuthology.orchestra.run.smithi177.stdout:(26/131): rbd-nbd-18.0.0-7498.g369173db.el8.x86 3.6 MB/s | 181 kB 00:00 2023-11-27T17:45:19.477 INFO:teuthology.orchestra.run.smithi177.stdout:(27/131): ceph-grafana-dashboards-18.0.0-7498.g 478 kB/s | 28 kB 00:00 2023-11-27T17:45:19.552 INFO:teuthology.orchestra.run.smithi177.stdout:(28/131): ceph-mgr-cephadm-18.0.0-7498.g369173d 1.7 MB/s | 133 kB 00:00 2023-11-27T17:45:19.714 INFO:teuthology.orchestra.run.smithi178.stdout:(17/131): ceph-test-18.0.0-7498.g369173db.el8.x 3.4 MB/s | 49 MB 00:14 2023-11-27T17:45:19.772 INFO:teuthology.orchestra.run.smithi178.stdout:(18/131): python3-ceph-argparse-18.0.0-7498.g36 773 kB/s | 45 kB 00:00 2023-11-27T17:45:19.794 INFO:teuthology.orchestra.run.smithi177.stdout:(29/131): ceph-mgr-dashboard-18.0.0-7498.g36917 7.3 MB/s | 1.8 MB 00:00 2023-11-27T17:45:19.839 INFO:teuthology.orchestra.run.smithi178.stdout:(19/131): python3-ceph-common-18.0.0-7498.g3691 1.9 MB/s | 128 kB 00:00 2023-11-27T17:45:19.890 INFO:teuthology.orchestra.run.smithi178.stdout:(20/131): python3-cephfs-18.0.0-7498.g369173db. 3.8 MB/s | 197 kB 00:00 2023-11-27T17:45:19.982 INFO:teuthology.orchestra.run.smithi178.stdout:(21/131): python3-rados-18.0.0-7498.g369173db.e 4.0 MB/s | 371 kB 00:00 2023-11-27T17:45:20.065 INFO:teuthology.orchestra.run.smithi178.stdout:(22/131): python3-rbd-18.0.0-7498.g369173db.el8 4.3 MB/s | 364 kB 00:00 2023-11-27T17:45:20.116 INFO:teuthology.orchestra.run.smithi178.stdout:(23/131): python3-rgw-18.0.0-7498.g369173db.el8 2.1 MB/s | 107 kB 00:00 2023-11-27T17:45:20.211 INFO:teuthology.orchestra.run.smithi178.stdout:(24/131): rbd-fuse-18.0.0-7498.g369173db.el8.x8 990 kB/s | 94 kB 00:00 2023-11-27T17:45:20.816 INFO:teuthology.orchestra.run.smithi178.stdout:(25/131): rbd-mirror-18.0.0-7498.g369173db.el8. 5.9 MB/s | 3.6 MB 00:00 2023-11-27T17:45:20.870 INFO:teuthology.orchestra.run.smithi178.stdout:(26/131): rbd-nbd-18.0.0-7498.g369173db.el8.x86 3.5 MB/s | 181 kB 00:00 2023-11-27T17:45:20.908 INFO:teuthology.orchestra.run.smithi178.stdout:(27/131): ceph-grafana-dashboards-18.0.0-7498.g 671 kB/s | 28 kB 00:00 2023-11-27T17:45:20.953 INFO:teuthology.orchestra.run.smithi177.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 6.4 MB/s | 7.4 MB 00:01 2023-11-27T17:45:20.958 INFO:teuthology.orchestra.run.smithi178.stdout:(28/131): ceph-mgr-cephadm-18.0.0-7498.g369173d 2.6 MB/s | 133 kB 00:00 2023-11-27T17:45:21.028 INFO:teuthology.orchestra.run.smithi177.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7498.g36 3.2 MB/s | 242 kB 00:00 2023-11-27T17:45:21.069 INFO:teuthology.orchestra.run.smithi177.stdout:(32/131): ceph-mgr-rook-18.0.0-7498.g369173db.e 1.2 MB/s | 50 kB 00:00 2023-11-27T17:45:21.112 INFO:teuthology.orchestra.run.smithi177.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7498.g3 360 kB/s | 15 kB 00:00 2023-11-27T17:45:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:(29/131): ceph-mgr-dashboard-18.0.0-7498.g36917 9.2 MB/s | 1.8 MB 00:00 2023-11-27T17:45:21.179 INFO:teuthology.orchestra.run.smithi177.stdout:(34/131): ceph-volume-18.0.0-7498.g369173db.el8 3.8 MB/s | 262 kB 00:00 2023-11-27T17:45:21.245 INFO:teuthology.orchestra.run.smithi177.stdout:(35/131): cephadm-18.0.0-7498.g369173db.el8.noa 6.0 MB/s | 411 kB 00:00 2023-11-27T17:45:21.287 INFO:teuthology.orchestra.run.smithi177.stdout:(36/131): cephfs-top-18.0.0-7498.g369173db.el8. 435 kB/s | 18 kB 00:00 2023-11-27T17:45:21.818 INFO:teuthology.orchestra.run.smithi178.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-11-27T17:45:21.860 INFO:teuthology.orchestra.run.smithi178.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7498.g36 5.7 MB/s | 242 kB 00:00 2023-11-27T17:45:21.862 INFO:teuthology.orchestra.run.smithi177.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 533 kB/s | 306 kB 00:00 2023-11-27T17:45:21.901 INFO:teuthology.orchestra.run.smithi178.stdout:(32/131): ceph-mgr-rook-18.0.0-7498.g369173db.e 1.2 MB/s | 50 kB 00:00 2023-11-27T17:45:21.977 INFO:teuthology.orchestra.run.smithi178.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7498.g3 200 kB/s | 15 kB 00:00 2023-11-27T17:45:21.988 INFO:teuthology.orchestra.run.smithi177.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-11-27T17:45:22.019 INFO:teuthology.orchestra.run.smithi178.stdout:(34/131): ceph-volume-18.0.0-7498.g369173db.el8 6.1 MB/s | 262 kB 00:00 2023-11-27T17:45:22.086 INFO:teuthology.orchestra.run.smithi178.stdout:(35/131): cephadm-18.0.0-7498.g369173db.el8.noa 6.0 MB/s | 411 kB 00:00 2023-11-27T17:45:22.113 INFO:teuthology.orchestra.run.smithi177.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 601 kB/s | 75 kB 00:00 2023-11-27T17:45:22.128 INFO:teuthology.orchestra.run.smithi178.stdout:(36/131): cephfs-top-18.0.0-7498.g369173db.el8. 437 kB/s | 18 kB 00:00 2023-11-27T17:45:22.314 INFO:teuthology.orchestra.run.smithi177.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-11-27T17:45:22.422 INFO:teuthology.orchestra.run.smithi177.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-11-27T17:45:22.539 INFO:teuthology.orchestra.run.smithi177.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-11-27T17:45:22.644 INFO:teuthology.orchestra.run.smithi178.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 593 kB/s | 306 kB 00:00 2023-11-27T17:45:22.656 INFO:teuthology.orchestra.run.smithi177.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-11-27T17:45:22.728 INFO:teuthology.orchestra.run.smithi178.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 705 kB/s | 59 kB 00:00 2023-11-27T17:45:22.756 INFO:teuthology.orchestra.run.smithi177.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-11-27T17:45:22.820 INFO:teuthology.orchestra.run.smithi178.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 820 kB/s | 75 kB 00:00 2023-11-27T17:45:22.874 INFO:teuthology.orchestra.run.smithi177.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-11-27T17:45:22.979 INFO:teuthology.orchestra.run.smithi178.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.9 MB/s | 476 kB 00:00 2023-11-27T17:45:23.007 INFO:teuthology.orchestra.run.smithi177.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-11-27T17:45:23.054 INFO:teuthology.orchestra.run.smithi178.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 580 kB/s | 44 kB 00:00 2023-11-27T17:45:23.146 INFO:teuthology.orchestra.run.smithi178.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-11-27T17:45:23.191 INFO:teuthology.orchestra.run.smithi177.stdout:(47/131): ceph-common-18.0.0-7498.g369173db.el8 468 kB/s | 23 MB 00:49 2023-11-27T17:45:23.216 INFO:teuthology.orchestra.run.smithi177.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 389 kB/s | 81 kB 00:00 2023-11-27T17:45:23.221 INFO:teuthology.orchestra.run.smithi178.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 441 kB/s | 33 kB 00:00 2023-11-27T17:45:23.316 INFO:teuthology.orchestra.run.smithi177.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-11-27T17:45:23.330 INFO:teuthology.orchestra.run.smithi178.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-11-27T17:45:23.367 INFO:teuthology.orchestra.run.smithi177.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 63 kB/s | 11 kB 00:00 2023-11-27T17:45:23.508 INFO:teuthology.orchestra.run.smithi177.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-11-27T17:45:23.592 INFO:teuthology.orchestra.run.smithi177.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 216 kB/s | 49 kB 00:00 2023-11-27T17:45:23.609 INFO:teuthology.orchestra.run.smithi177.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 586 kB/s | 59 kB 00:00 2023-11-27T17:45:23.726 INFO:teuthology.orchestra.run.smithi177.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-11-27T17:45:23.785 INFO:teuthology.orchestra.run.smithi177.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 314 kB/s | 60 kB 00:00 2023-11-27T17:45:23.835 INFO:teuthology.orchestra.run.smithi177.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-11-27T17:45:23.910 INFO:teuthology.orchestra.run.smithi177.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 268 kB/s | 34 kB 00:00 2023-11-27T17:45:23.952 INFO:teuthology.orchestra.run.smithi177.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-11-27T17:45:23.964 INFO:teuthology.orchestra.run.smithi178.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 272 kB/s | 173 kB 00:00 2023-11-27T17:45:24.052 INFO:teuthology.orchestra.run.smithi177.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-11-27T17:45:24.078 INFO:teuthology.orchestra.run.smithi177.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 384 kB/s | 64 kB 00:00 2023-11-27T17:45:24.153 INFO:teuthology.orchestra.run.smithi177.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2023-11-27T17:45:24.203 INFO:teuthology.orchestra.run.smithi177.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 233 kB/s | 29 kB 00:00 2023-11-27T17:45:24.262 INFO:teuthology.orchestra.run.smithi177.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2023-11-27T17:45:24.379 INFO:teuthology.orchestra.run.smithi177.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-11-27T17:45:24.487 INFO:teuthology.orchestra.run.smithi177.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 900 kB/s | 255 kB 00:00 2023-11-27T17:45:24.512 INFO:teuthology.orchestra.run.smithi177.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 459 kB/s | 61 kB 00:00 2023-11-27T17:45:24.605 INFO:teuthology.orchestra.run.smithi177.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 730 kB/s | 85 kB 00:00 2023-11-27T17:45:24.630 INFO:teuthology.orchestra.run.smithi177.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2023-11-27T17:45:24.655 INFO:teuthology.orchestra.run.smithi177.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-11-27T17:45:24.780 INFO:teuthology.orchestra.run.smithi177.stdout:(70/131): ceph-osd-18.0.0-7498.g369173db.el8.x8 409 kB/s | 18 MB 00:45 2023-11-27T17:45:24.889 INFO:teuthology.orchestra.run.smithi177.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 200 kB/s | 47 kB 00:00 2023-11-27T17:45:24.956 INFO:teuthology.orchestra.run.smithi177.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-11-27T17:45:25.090 INFO:teuthology.orchestra.run.smithi177.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 3.6 MB/s | 1.7 MB 00:00 2023-11-27T17:45:25.131 INFO:teuthology.orchestra.run.smithi177.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 176 kB/s | 43 kB 00:00 2023-11-27T17:45:25.240 INFO:teuthology.orchestra.run.smithi177.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 320 kB/s | 48 kB 00:00 2023-11-27T17:45:25.257 INFO:teuthology.orchestra.run.smithi177.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 695 kB/s | 87 kB 00:00 2023-11-27T17:45:25.307 INFO:teuthology.orchestra.run.smithi177.stdout:(77/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 628 kB/s | 220 kB 00:00 2023-11-27T17:45:25.349 INFO:teuthology.orchestra.run.smithi177.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2023-11-27T17:45:25.374 INFO:teuthology.orchestra.run.smithi177.stdout:(79/131): python3-requests-oauthlib-1.0.0-1.el8 318 kB/s | 43 kB 00:00 2023-11-27T17:45:25.433 INFO:teuthology.orchestra.run.smithi177.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-11-27T17:45:25.492 INFO:teuthology.orchestra.run.smithi177.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.9 MB/s | 560 kB 00:00 2023-11-27T17:45:25.517 INFO:teuthology.orchestra.run.smithi177.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 131 kB/s | 19 kB 00:00 2023-11-27T17:45:25.584 INFO:teuthology.orchestra.run.smithi177.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2023-11-27T17:45:25.667 INFO:teuthology.orchestra.run.smithi177.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 3.1 MB/s | 559 kB 00:00 2023-11-27T17:45:25.672 INFO:teuthology.orchestra.run.smithi178.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 225 kB/s | 384 kB 00:01 2023-11-27T17:45:25.693 INFO:teuthology.orchestra.run.smithi177.stdout:(85/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 102 kB/s | 18 kB 00:00 2023-11-27T17:45:25.735 INFO:teuthology.orchestra.run.smithi177.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-11-27T17:45:25.818 INFO:teuthology.orchestra.run.smithi177.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2023-11-27T17:45:25.881 INFO:teuthology.orchestra.run.smithi178.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 391 kB/s | 81 kB 00:00 2023-11-27T17:45:25.902 INFO:teuthology.orchestra.run.smithi177.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 11 MB/s | 2.3 MB 00:00 2023-11-27T17:45:25.927 INFO:teuthology.orchestra.run.smithi177.stdout:(89/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 376 kB/s | 72 kB 00:00 2023-11-27T17:45:25.952 INFO:teuthology.orchestra.run.smithi177.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 619 kB/s | 83 kB 00:00 2023-11-27T17:45:25.964 INFO:teuthology.orchestra.run.smithi178.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-11-27T17:45:25.977 INFO:teuthology.orchestra.run.smithi177.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 793 kB/s | 60 kB 00:00 2023-11-27T17:45:26.040 INFO:teuthology.orchestra.run.smithi178.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-11-27T17:45:26.078 INFO:teuthology.orchestra.run.smithi177.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 460 kB/s | 58 kB 00:00 2023-11-27T17:45:26.112 INFO:teuthology.orchestra.run.smithi177.stdout:(93/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 533 kB/s | 98 kB 00:00 2023-11-27T17:45:26.137 INFO:teuthology.orchestra.run.smithi177.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 243 kB/s | 39 kB 00:00 2023-11-27T17:45:26.229 INFO:teuthology.orchestra.run.smithi177.stdout:(95/131): NetworkManager-initscripts-updown-1.3 1.5 MB/s | 138 kB 00:00 2023-11-27T17:45:26.254 INFO:teuthology.orchestra.run.smithi177.stdout:(96/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.2 MB/s | 171 kB 00:00 2023-11-27T17:45:26.279 INFO:teuthology.orchestra.run.smithi177.stdout:(97/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.1 MB/s | 644 kB 00:00 2023-11-27T17:45:26.379 INFO:teuthology.orchestra.run.smithi177.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 879 kB/s | 110 kB 00:00 2023-11-27T17:45:26.396 INFO:teuthology.orchestra.run.smithi177.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 463 kB/s | 54 kB 00:00 2023-11-27T17:45:26.497 INFO:teuthology.orchestra.run.smithi177.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2023-11-27T17:45:26.538 INFO:teuthology.orchestra.run.smithi177.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-11-27T17:45:26.609 INFO:teuthology.orchestra.run.smithi177.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 358 kB/s | 39 kB 00:00 2023-11-27T17:45:26.756 INFO:teuthology.orchestra.run.smithi177.stdout:(103/131): python3-scipy-1.0.0-21.module+el8.5. 26 MB/s | 14 MB 00:00 2023-11-27T17:45:26.789 INFO:teuthology.orchestra.run.smithi177.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 2.9 MB/s | 538 kB 00:00 2023-11-27T17:45:26.815 INFO:teuthology.orchestra.run.smithi177.stdout:(105/131): bison-3.0.4-10.el8.x86_64.rpm 2.4 MB/s | 688 kB 00:00 2023-11-27T17:45:26.857 INFO:teuthology.orchestra.run.smithi177.stdout:(106/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-11-27T17:45:26.924 INFO:teuthology.orchestra.run.smithi177.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-11-27T17:45:26.966 INFO:teuthology.orchestra.run.smithi177.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 4.6 MB/s | 713 kB 00:00 2023-11-27T17:45:27.057 INFO:teuthology.orchestra.run.smithi177.stdout:(109/131): python3-jsonpatch-1.21-2.el8.noarch. 199 kB/s | 27 kB 00:00 2023-11-27T17:45:27.083 INFO:teuthology.orchestra.run.smithi177.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 2.7 MB/s | 320 kB 00:00 2023-11-27T17:45:27.216 INFO:teuthology.orchestra.run.smithi177.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-11-27T17:45:27.242 INFO:teuthology.orchestra.run.smithi177.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 239 kB/s | 44 kB 00:00 2023-11-27T17:45:27.342 INFO:teuthology.orchestra.run.smithi177.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-11-27T17:45:27.367 INFO:teuthology.orchestra.run.smithi177.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.8 MB/s | 225 kB 00:00 2023-11-27T17:45:27.401 INFO:teuthology.orchestra.run.smithi177.stdout:(115/131): python3-werkzeug-0.12.2-4.el8.noarch 2.4 MB/s | 457 kB 00:00 2023-11-27T17:45:27.448 INFO:teuthology.orchestra.run.smithi178.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 848 kB/s | 1.2 MB 00:01 2023-11-27T17:45:27.451 INFO:teuthology.orchestra.run.smithi177.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 588 kB/s | 64 kB 00:00 2023-11-27T17:45:27.485 INFO:teuthology.orchestra.run.smithi177.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2023-11-27T17:45:27.540 INFO:teuthology.orchestra.run.smithi178.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 533 kB/s | 49 kB 00:00 2023-11-27T17:45:27.585 INFO:teuthology.orchestra.run.smithi177.stdout:(118/131): python3-jsonpointer-1.10-11.el8.noar 109 kB/s | 20 kB 00:00 2023-11-27T17:45:27.632 INFO:teuthology.orchestra.run.smithi178.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 641 kB/s | 59 kB 00:00 2023-11-27T17:45:27.635 INFO:teuthology.orchestra.run.smithi177.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 563 kB/s | 103 kB 00:00 2023-11-27T17:45:27.669 INFO:teuthology.orchestra.run.smithi177.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 3.8 MB/s | 709 kB 00:00 2023-11-27T17:45:27.749 INFO:teuthology.orchestra.run.smithi178.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2023-11-27T17:45:27.785 INFO:teuthology.orchestra.run.smithi177.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 24 MB/s | 4.9 MB 00:00 2023-11-27T17:45:27.802 INFO:teuthology.orchestra.run.smithi177.stdout:(122/131): libpq-13.5-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2023-11-27T17:45:27.911 INFO:teuthology.orchestra.run.smithi177.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-11-27T17:45:27.936 INFO:teuthology.orchestra.run.smithi177.stdout:(124/131): jq-1.6-3.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2023-11-27T17:45:27.991 INFO:teuthology.orchestra.run.smithi177.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.8 MB/s | 354 kB 00:00 2023-11-27T17:45:28.041 INFO:teuthology.orchestra.run.smithi178.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 970 kB/s | 283 kB 00:00 2023-11-27T17:45:28.120 INFO:teuthology.orchestra.run.smithi177.stdout:(126/131): postgresql-server-10.21-2.module+el8 24 MB/s | 5.1 MB 00:00 2023-11-27T17:45:28.138 INFO:teuthology.orchestra.run.smithi178.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 161 kB/s | 16 kB 00:00 2023-11-27T17:45:28.162 INFO:teuthology.orchestra.run.smithi177.stdout:(127/131): postgresql-contrib-10.21-2.module+el 3.5 MB/s | 808 kB 00:00 2023-11-27T17:45:28.204 INFO:teuthology.orchestra.run.smithi177.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 7.1 MB/s | 1.5 MB 00:00 2023-11-27T17:45:28.241 INFO:teuthology.orchestra.run.smithi178.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 326 kB/s | 34 kB 00:00 2023-11-27T17:45:28.338 INFO:teuthology.orchestra.run.smithi177.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.8 MB/s | 798 kB 00:00 2023-11-27T17:45:28.484 INFO:teuthology.orchestra.run.smithi178.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 813 kB/s | 196 kB 00:00 2023-11-27T17:45:28.654 INFO:teuthology.orchestra.run.smithi177.stdout:(130/131): librbd1-18.0.0-7498.g369173db.el8.x8 7.5 MB/s | 3.7 MB 00:00 2023-11-27T17:45:28.667 INFO:teuthology.orchestra.run.smithi178.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 351 kB/s | 64 kB 00:00 2023-11-27T17:45:28.759 INFO:teuthology.orchestra.run.smithi178.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2023-11-27T17:45:28.843 INFO:teuthology.orchestra.run.smithi178.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 287 kB/s | 24 kB 00:00 2023-11-27T17:45:28.943 INFO:teuthology.orchestra.run.smithi178.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 293 kB/s | 29 kB 00:00 2023-11-27T17:45:29.043 INFO:teuthology.orchestra.run.smithi178.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 275 kB/s | 27 kB 00:00 2023-11-27T17:45:29.319 INFO:teuthology.orchestra.run.smithi178.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 929 kB/s | 255 kB 00:00 2023-11-27T17:45:29.602 INFO:teuthology.orchestra.run.smithi178.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 887 kB/s | 251 kB 00:00 2023-11-27T17:45:29.728 INFO:teuthology.orchestra.run.smithi178.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 490 kB/s | 61 kB 00:00 2023-11-27T17:45:29.915 INFO:teuthology.orchestra.run.smithi178.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 457 kB/s | 85 kB 00:00 2023-11-27T17:45:30.012 INFO:teuthology.orchestra.run.smithi178.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 237 kB/s | 23 kB 00:00 2023-11-27T17:45:31.287 INFO:teuthology.orchestra.run.smithi178.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 1.4 MB/s | 1.7 MB 00:01 2023-11-27T17:45:31.312 INFO:teuthology.orchestra.run.smithi178.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-11-27T17:45:31.683 INFO:teuthology.orchestra.run.smithi178.stdout:(70/131): ceph-radosgw-18.0.0-7498.g369173db.el 454 kB/s | 14 MB 00:31 2023-11-27T17:45:31.838 INFO:teuthology.orchestra.run.smithi178.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 715 kB/s | 110 kB 00:00 2023-11-27T17:45:32.063 INFO:teuthology.orchestra.run.smithi178.stdout:(72/131): python3-scipy-1.0.0-21.module+el8.5.0 18 MB/s | 14 MB 00:00 2023-11-27T17:45:32.088 INFO:teuthology.orchestra.run.smithi178.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 216 kB/s | 54 kB 00:00 2023-11-27T17:45:32.197 INFO:teuthology.orchestra.run.smithi178.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-11-27T17:45:32.222 INFO:teuthology.orchestra.run.smithi178.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-11-27T17:45:32.272 INFO:teuthology.orchestra.run.smithi178.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 515 kB/s | 39 kB 00:00 2023-11-27T17:45:32.331 INFO:teuthology.orchestra.run.smithi178.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 6.2 MB/s | 688 kB 00:00 2023-11-27T17:45:32.423 INFO:teuthology.orchestra.run.smithi178.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.5 MB/s | 538 kB 00:00 2023-11-27T17:45:32.473 INFO:teuthology.orchestra.run.smithi178.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-11-27T17:45:32.590 INFO:teuthology.orchestra.run.smithi178.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-11-27T17:45:32.682 INFO:teuthology.orchestra.run.smithi178.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 3.3 MB/s | 713 kB 00:00 2023-11-27T17:45:32.825 INFO:teuthology.orchestra.run.smithi178.stdout:(82/131): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-11-27T17:45:32.849 INFO:teuthology.orchestra.run.smithi178.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 159 kB/s | 27 kB 00:00 2023-11-27T17:45:33.022 INFO:teuthology.orchestra.run.smithi178.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2023-11-27T17:45:33.067 INFO:teuthology.orchestra.run.smithi178.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 202 kB/s | 44 kB 00:00 2023-11-27T17:45:33.308 INFO:teuthology.orchestra.run.smithi178.stdout:(86/131): python3-numpy-1.14.3-10.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2023-11-27T17:45:33.342 INFO:teuthology.orchestra.run.smithi178.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 1.6 MB/s | 457 kB 00:00 2023-11-27T17:45:33.468 INFO:teuthology.orchestra.run.smithi178.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.4 MB/s | 225 kB 00:00 2023-11-27T17:45:33.509 INFO:teuthology.orchestra.run.smithi178.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 383 kB/s | 64 kB 00:00 2023-11-27T17:45:33.568 INFO:teuthology.orchestra.run.smithi178.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-11-27T17:45:33.626 INFO:teuthology.orchestra.run.smithi178.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 171 kB/s | 20 kB 00:00 2023-11-27T17:45:33.668 INFO:teuthology.orchestra.run.smithi178.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-11-27T17:45:33.711 INFO:teuthology.orchestra.run.smithi178.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-11-27T17:45:33.811 INFO:teuthology.orchestra.run.smithi178.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-11-27T17:45:33.970 INFO:teuthology.orchestra.run.smithi178.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-11-27T17:45:34.087 INFO:teuthology.orchestra.run.smithi178.stdout:(96/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-11-27T17:45:34.112 INFO:teuthology.orchestra.run.smithi178.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2023-11-27T17:45:34.229 INFO:teuthology.orchestra.run.smithi178.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2023-11-27T17:45:34.363 INFO:teuthology.orchestra.run.smithi178.stdout:(99/131): postgresql-server-10.21-2.module+el8. 20 MB/s | 5.1 MB 00:00 2023-11-27T17:45:34.404 INFO:teuthology.orchestra.run.smithi178.stdout:(100/131): postgresql-contrib-10.21-2.module+el 4.5 MB/s | 808 kB 00:00 2023-11-27T17:45:34.471 INFO:teuthology.orchestra.run.smithi178.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-11-27T17:45:34.521 INFO:teuthology.orchestra.run.smithi178.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 401 kB/s | 47 kB 00:00 2023-11-27T17:45:34.547 INFO:teuthology.orchestra.run.smithi178.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.6 MB/s | 200 kB 00:00 2023-11-27T17:45:34.622 INFO:teuthology.orchestra.run.smithi178.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 424 kB/s | 43 kB 00:00 2023-11-27T17:45:34.656 INFO:teuthology.orchestra.run.smithi178.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-11-27T17:45:34.814 INFO:teuthology.orchestra.run.smithi178.stdout:(106/131): librgw2-18.0.0-7498.g369173db.el8.x8 444 kB/s | 6.9 MB 00:15 2023-11-27T17:45:34.840 INFO:teuthology.orchestra.run.smithi178.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 221 kB/s | 48 kB 00:00 2023-11-27T17:45:34.873 INFO:teuthology.orchestra.run.smithi178.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 400 kB/s | 87 kB 00:00 2023-11-27T17:45:34.932 INFO:teuthology.orchestra.run.smithi178.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.2 MB/s | 109 kB 00:00 2023-11-27T17:45:34.957 INFO:teuthology.orchestra.run.smithi178.stdout:(110/131): python3-requests-oauthlib-1.0.0-1.el 300 kB/s | 43 kB 00:00 2023-11-27T17:45:35.016 INFO:teuthology.orchestra.run.smithi178.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-11-27T17:45:35.041 INFO:teuthology.orchestra.run.smithi178.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 224 kB/s | 19 kB 00:00 2023-11-27T17:45:35.083 INFO:teuthology.orchestra.run.smithi178.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-11-27T17:45:35.158 INFO:teuthology.orchestra.run.smithi178.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-11-27T17:45:35.184 INFO:teuthology.orchestra.run.smithi178.stdout:(115/131): python3-oauthlib-2.1.0-1.el8.noarch. 925 kB/s | 155 kB 00:00 2023-11-27T17:45:35.209 INFO:teuthology.orchestra.run.smithi178.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 142 kB/s | 18 kB 00:00 2023-11-27T17:45:35.309 INFO:teuthology.orchestra.run.smithi178.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2023-11-27T17:45:35.351 INFO:teuthology.orchestra.run.smithi178.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-11-27T17:45:35.410 INFO:teuthology.orchestra.run.smithi178.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 12 MB/s | 2.3 MB 00:00 2023-11-27T17:45:35.435 INFO:teuthology.orchestra.run.smithi178.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 576 kB/s | 72 kB 00:00 2023-11-27T17:45:35.452 INFO:teuthology.orchestra.run.smithi178.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 824 kB/s | 83 kB 00:00 2023-11-27T17:45:35.527 INFO:teuthology.orchestra.run.smithi178.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 511 kB/s | 60 kB 00:00 2023-11-27T17:45:35.552 INFO:teuthology.orchestra.run.smithi178.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 575 kB/s | 58 kB 00:00 2023-11-27T17:45:35.586 INFO:teuthology.orchestra.run.smithi178.stdout:(124/131): libuuid-devel-2.32.1-35.el8.x86_64.r 650 kB/s | 98 kB 00:00 2023-11-27T17:45:35.636 INFO:teuthology.orchestra.run.smithi178.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 353 kB/s | 39 kB 00:00 2023-11-27T17:45:35.703 INFO:teuthology.orchestra.run.smithi178.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.2 MB/s | 644 kB 00:00 2023-11-27T17:45:35.729 INFO:teuthology.orchestra.run.smithi178.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.2 MB/s | 171 kB 00:00 2023-11-27T17:45:35.754 INFO:teuthology.orchestra.run.smithi178.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2023-11-27T17:45:35.987 INFO:teuthology.orchestra.run.smithi178.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 3.3 MB/s | 798 kB 00:00 2023-11-27T17:45:37.020 INFO:teuthology.orchestra.run.smithi178.stdout:(130/131): librbd1-18.0.0-7498.g369173db.el8.x8 2.9 MB/s | 3.7 MB 00:01 2023-11-27T17:45:38.161 INFO:teuthology.orchestra.run.smithi177.stdout:(131/131): librados2-18.0.0-7498.g369173db.el8. 384 kB/s | 3.8 MB 00:10 2023-11-27T17:45:38.164 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2023-11-27T17:45:38.165 INFO:teuthology.orchestra.run.smithi177.stdout:Total 3.2 MB/s | 209 MB 01:04 2023-11-27T17:45:39.006 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2023-11-27T17:45:39.126 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2023-11-27T17:45:39.126 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2023-11-27T17:45:40.250 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2023-11-27T17:45:40.255 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2023-11-27T17:45:42.853 INFO:teuthology.orchestra.run.smithi178.stdout:(131/131): librados2-18.0.0-7498.g369173db.el8. 540 kB/s | 3.8 MB 00:07 2023-11-27T17:45:48.425 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-11-27T17:45:48.425 INFO:teuthology.orchestra.run.smithi178.stdout:Total 4.2 MB/s | 209 MB 00:49 2023-11-27T17:45:48.425 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-11-27T17:45:48.425 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-11-27T17:45:48.425 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-11-27T17:45:48.425 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-11-27T17:45:48.425 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-11-27T17:45:48.427 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2023-11-27T17:45:48.427 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-27T17:45:48.427 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-27T17:45:48.427 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-27T17:45:48.427 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-27T17:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-27T17:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-27T17:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:18.0.0-7498.g369173db.el8.x86_64 5/134 2023-11-27T17:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:18.0.0-7498.g369173db.el8.x86_64 5/134 2023-11-27T17:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:18.0.0-7498.g369173db.el8.x86_64 6/134 2023-11-27T17:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:18.0.0-7498.g369173db.el8.x86_64 6/134 2023-11-27T17:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:18.0.0-7498.g369173db.el8.x86_64 7/134 2023-11-27T17:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:18.0.0-7498.g369173db.el8.x86_64 7/134 2023-11-27T17:45:48.429 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:18.0.0-7498.g369173db.el8.x86_64 8/134 2023-11-27T17:45:48.429 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-11-27T17:45:48.638 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-27T17:45:48.861 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-27T17:45:49.258 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-27T17:45:49.515 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-27T17:45:49.699 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:18.0.0-7498.g369173db.el8.x86_64 14/134 2023-11-27T17:45:49.811 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7498.g369173db.el8.x86_64 14/134 2023-11-27T17:45:49.933 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-11-27T17:45:49.991 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:18.0.0-7498.g369173db.el8.x86 15/134 2023-11-27T17:45:50.095 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-27T17:45:50.142 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7498.g369173db.el8.x86 15/134 2023-11-27T17:45:50.300 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-27T17:45:50.319 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-11-27T17:45:50.496 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-11-27T17:45:50.504 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-11-27T17:45:50.656 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-27T17:45:50.686 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-11-27T17:45:50.835 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-27T17:45:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-27T17:45:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-27T17:45:51.048 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-27T17:45:51.132 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-27T17:45:51.461 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-27T17:45:51.689 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:18.0.0-7498.g369173db.el8.x86_64 6/134 2023-11-27T17:45:51.729 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-27T17:45:51.919 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-27T17:45:52.085 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:18.0.0-7498.g369173db.el8.x86_64 6/134 2023-11-27T17:45:52.255 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:18.0.0-7498.g369173db.el8.x86_64 7/134 2023-11-27T17:45:52.384 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:18.0.0-7498.g369173db.el8.x86_64 7/134 2023-11-27T17:45:52.521 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-27T17:45:52.589 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:18.0.0-7498.g369173db.el8.x86_64 8/134 2023-11-27T17:45:52.683 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:18.0.0-7498.g369173db.el8.x86_64 8/134 2023-11-27T17:45:52.740 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-11-27T17:45:52.876 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:18.0.0-7498.g369173db.el8.x86_64 9/134 2023-11-27T17:45:53.151 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-27T17:45:53.350 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-27T17:45:53.455 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-11-27T17:45:53.690 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-11-27T17:45:53.771 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-27T17:45:53.879 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-11-27T17:45:54.055 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-27T17:45:54.150 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-27T17:45:54.213 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:18.0.0-7498.g369173db.el8.x86_64 14/134 2023-11-27T17:45:54.302 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7498.g369173db.el8.x86_64 14/134 2023-11-27T17:45:54.313 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:18.0.0-7498.g369173db.el8. 26/134 2023-11-27T17:45:54.468 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 27/134 2023-11-27T17:45:54.488 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:18.0.0-7498.g369173db.el8.x86 15/134 2023-11-27T17:45:54.562 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7498.g369173db.el8.x86 15/134 2023-11-27T17:45:54.680 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-27T17:45:54.710 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:18.0.0-7498.g369173db.el8.x86_6 28/134 2023-11-27T17:45:54.840 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-27T17:45:54.940 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-27T17:45:54.963 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-27T17:45:55.580 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-27T17:45:55.763 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-27T17:45:56.363 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-27T17:45:56.554 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-11-27T17:45:56.701 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-27T17:45:57.239 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-11-27T17:45:57.510 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-11-27T17:45:57.714 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-11-27T17:45:57.757 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-11-27T17:45:57.959 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-11-27T17:45:58.062 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-11-27T17:45:58.128 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-11-27T17:45:58.311 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-11-27T17:45:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-11-27T17:45:58.523 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-27T17:45:58.537 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-11-27T17:45:58.669 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:18.0.0-7498.g369173db.el8. 26/134 2023-11-27T17:45:58.734 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-27T17:45:58.836 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 27/134 2023-11-27T17:45:58.924 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-27T17:45:59.162 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:18.0.0-7498.g369173db.el8.x86_64 36/134 2023-11-27T17:45:59.345 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:18.0.0-7498.g369173db.el8.x86_6 37/134 2023-11-27T17:45:59.496 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-11-27T17:45:59.669 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-11-27T17:45:59.723 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:18.0.0-7498.g369173db.el8.x86_6 28/134 2023-11-27T17:45:59.855 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-11-27T17:45:59.932 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-11-27T17:46:00.035 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-11-27T17:46:00.142 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-11-27T17:46:00.314 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-11-27T17:46:00.343 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-11-27T17:46:00.522 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-27T17:46:00.540 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-11-27T17:46:00.602 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-27T17:46:00.712 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-27T17:46:00.829 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-11-27T17:46:01.010 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-11-27T17:46:01.194 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-11-27T17:46:01.366 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-11-27T17:46:01.542 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-11-27T17:46:01.676 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-11-27T17:46:01.905 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-11-27T17:46:02.104 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-11-27T17:46:02.469 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-11-27T17:46:02.473 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-27T17:46:02.740 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-11-27T17:46:02.796 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-11-27T17:46:02.949 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-11-27T17:46:02.973 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-27T17:46:03.147 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-27T17:46:03.201 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-11-27T17:46:03.326 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:18.0.0-7498.g369173db.el8.x86_64 36/134 2023-11-27T17:46:03.409 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-11-27T17:46:03.449 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:18.0.0-7498.g369173db.el8.x86_6 37/134 2023-11-27T17:46:03.647 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-11-27T17:46:03.745 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-11-27T17:46:03.822 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-11-27T17:46:03.989 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-11-27T17:46:03.996 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-11-27T17:46:04.140 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-11-27T17:46:04.181 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-11-27T17:46:04.317 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-11-27T17:46:04.410 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-11-27T17:46:04.491 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-11-27T17:46:04.608 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-11-27T17:46:04.783 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-11-27T17:46:04.854 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-11-27T17:46:05.110 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-11-27T17:46:05.131 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-11-27T17:46:05.304 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-11-27T17:46:05.446 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-11-27T17:46:05.533 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-11-27T17:46:05.676 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-11-27T17:46:05.741 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-11-27T17:46:05.898 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-11-27T17:46:06.085 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-11-27T17:46:06.096 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-27T17:46:06.283 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-27T17:46:06.344 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-11-27T17:46:06.515 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-11-27T17:46:06.577 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-27T17:46:06.758 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-11-27T17:46:06.829 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-27T17:46:06.918 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-11-27T17:46:06.993 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-27T17:46:07.072 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-11-27T17:46:07.141 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-27T17:46:07.314 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-27T17:46:07.390 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-11-27T17:46:07.525 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-27T17:46:07.681 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-11-27T17:46:07.707 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-27T17:46:07.857 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-27T17:46:07.916 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-11-27T17:46:08.002 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-27T17:46:08.134 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-11-27T17:46:08.258 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-27T17:46:08.293 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-11-27T17:46:08.429 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-11-27T17:46:08.491 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-27T17:46:08.636 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-11-27T17:46:08.685 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-27T17:46:08.694 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-11-27T17:46:08.913 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-11-27T17:46:08.992 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-27T17:46:09.122 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-11-27T17:46:09.220 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-27T17:46:09.278 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-27T17:46:09.338 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-27T17:46:09.415 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-27T17:46:09.581 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-11-27T17:46:09.654 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-27T17:46:09.745 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-11-27T17:46:09.926 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-27T17:46:10.080 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-27T17:46:10.354 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-27T17:46:10.550 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-27T17:46:10.681 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-27T17:46:10.726 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-27T17:46:10.854 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-27T17:46:10.999 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-27T17:46:11.026 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-27T17:46:11.236 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-27T17:46:11.246 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-27T17:46:11.403 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-27T17:46:11.536 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-27T17:46:11.546 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-27T17:46:11.707 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-27T17:46:11.856 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-27T17:46:11.902 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-27T17:46:12.046 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-27T17:46:12.121 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-27T17:46:12.274 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-27T17:46:12.500 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-27T17:46:12.708 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-27T17:46:12.862 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-27T17:46:12.865 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-27T17:46:13.070 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:18.0.0-7498.g369173db.el8.x86_64 92/134 2023-11-27T17:46:13.080 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-27T17:46:13.127 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:18.0.0-7498.g369173db.el8.x86_64 92/134 2023-11-27T17:46:13.295 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:18.0.0-7498.g369173db.el8.x86_64 93/134 2023-11-27T17:46:14.146 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-27T17:46:14.413 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-27T17:46:14.642 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-27T17:46:14.953 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-27T17:46:15.610 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-27T17:46:15.808 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-27T17:46:16.612 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-27T17:46:16.768 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:18.0.0-7498.g369173db.el8.x86_64 92/134 2023-11-27T17:46:16.840 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:18.0.0-7498.g369173db.el8.x86_64 92/134 2023-11-27T17:46:17.018 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:18.0.0-7498.g369173db.el8.x86_64 93/134 2023-11-27T17:46:17.019 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 94/134 2023-11-27T17:46:17.220 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 94/134 2023-11-27T17:46:17.809 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 94/134 2023-11-27T17:46:18.142 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:18.0.0-7498.g369173db.el8.x86_64 95/134 2023-11-27T17:46:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:18.0.0-7498.g369173db.el8.x86_64 95/134 2023-11-27T17:46:18.369 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:18.0.0-7498.g369173db.el8.x86_64 96/134 2023-11-27T17:46:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 94/134 2023-11-27T17:46:21.026 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 94/134 2023-11-27T17:46:21.618 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 94/134 2023-11-27T17:46:21.908 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:18.0.0-7498.g369173db.el8.x86_64 95/134 2023-11-27T17:46:21.994 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:18.0.0-7498.g369173db.el8.x86_64 95/134 2023-11-27T17:46:22.125 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:18.0.0-7498.g369173db.el8.x86_64 96/134 2023-11-27T17:46:37.188 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7498.g369173db.el8.x86_64 96/134 2023-11-27T17:46:37.188 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2023-11-27T17:46:37.188 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2023-11-27T17:46:37.188 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /dev 2023-11-27T17:46:37.188 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /run 2023-11-27T17:46:37.188 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2023-11-27T17:46:37.188 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2023-11-27T17:46:37.189 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2023-11-27T17:46:37.189 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2023-11-27T17:46:37.189 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /dev 2023-11-27T17:46:37.189 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:46:37.532 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:18.0.0-7498.g369173db.el8.noarch 97/134 2023-11-27T17:46:39.139 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:18.0.0-7498.g369173db.el8.noarch 97/134 2023-11-27T17:46:39.346 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:18.0.0-7498.g369173db.el8.x86_64 98/134 2023-11-27T17:46:39.567 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:18.0.0-7498.g369173db.el8.x86_64 98/134 2023-11-27T17:46:39.732 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:18.0.0-7498.g369173db.el8.x86_64 99/134 2023-11-27T17:46:40.188 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:18.0.0-7498.g369173db.el8.x86_64 99/134 2023-11-27T17:46:40.432 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:18.0.0-7498.g369173db.el8.x86_64 100/134 2023-11-27T17:46:40.448 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:18.0.0-7498.g369173db.el8.x86_64 100/134 2023-11-27T17:46:41.217 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7498.g369173db.el8.x86_64 96/134 2023-11-27T17:46:41.217 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /dev 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /run 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /dev 2023-11-27T17:46:41.218 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:46:41.563 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:18.0.0-7498.g369173db.el8.noarch 97/134 2023-11-27T17:46:42.125 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:18.0.0-7498.g369173db.el8.noarch 101/134 2023-11-27T17:46:42.299 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:18.0.0-7498.g369173db.el8.noarch 101/134 2023-11-27T17:46:42.430 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 102/134 2023-11-27T17:46:42.630 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 103/134 2023-11-27T17:46:42.856 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el8.noa 104/134 2023-11-27T17:46:43.078 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el8.noa 104/134 2023-11-27T17:46:43.184 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:18.0.0-7498.g369173db.el8.noarch 97/134 2023-11-27T17:46:43.329 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:18.0.0-7498.g369173db.el8.x86_64 98/134 2023-11-27T17:46:43.420 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el8.n 105/134 2023-11-27T17:46:43.548 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:18.0.0-7498.g369173db.el8.x86_64 98/134 2023-11-27T17:46:43.722 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:18.0.0-7498.g369173db.el8.x86_64 99/134 2023-11-27T17:46:44.180 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:18.0.0-7498.g369173db.el8.x86_64 99/134 2023-11-27T17:46:44.379 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:18.0.0-7498.g369173db.el8.x86_64 100/134 2023-11-27T17:46:44.382 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el8.n 105/134 2023-11-27T17:46:44.396 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:18.0.0-7498.g369173db.el8.x86_64 100/134 2023-11-27T17:46:44.540 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 106/134 2023-11-27T17:46:44.629 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 106/134 2023-11-27T17:46:45.012 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 107/134 2023-11-27T17:46:45.196 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:18.0.0-7498.g369173db.el8.x86_64 108/134 2023-11-27T17:46:45.232 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7498.g369173db.el8.x86_64 108/134 2023-11-27T17:46:45.405 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:18.0.0-7498.g369173db.el8.noarch 109/134 2023-11-27T17:46:45.417 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7498.g369173db.el8.noarch 109/134 2023-11-27T17:46:46.065 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:18.0.0-7498.g369173db.el8.noarch 101/134 2023-11-27T17:46:46.222 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:18.0.0-7498.g369173db.el8.noarch 101/134 2023-11-27T17:46:46.361 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 102/134 2023-11-27T17:46:46.549 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 103/134 2023-11-27T17:46:46.746 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el8.noa 104/134 2023-11-27T17:46:46.775 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:18.0.0-7498.g369173db.el8.x86_64 110/134 2023-11-27T17:46:46.965 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el8.noa 104/134 2023-11-27T17:46:47.025 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:18.0.0-7498.g369173db.el8.x86_64 111/134 2023-11-27T17:46:47.060 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7498.g369173db.el8.x86_64 111/134 2023-11-27T17:46:47.222 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7498.g36917 112/134 2023-11-27T17:46:47.265 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7498.g36917 112/134 2023-11-27T17:46:47.286 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el8.n 105/134 2023-11-27T17:46:47.431 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-mirror-2:18.0.0-7498.g369173db.el8.x86_64 113/134 2023-11-27T17:46:47.791 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7498.g369173db.el8.x86_64 113/134 2023-11-27T17:46:47.947 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:18.0.0-7498.g369173db.el8.x86_64 114/134 2023-11-27T17:46:48.247 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el8.n 105/134 2023-11-27T17:46:48.387 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 106/134 2023-11-27T17:46:48.478 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 106/134 2023-11-27T17:46:48.853 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 107/134 2023-11-27T17:46:49.052 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:18.0.0-7498.g369173db.el8.x86_64 108/134 2023-11-27T17:46:49.089 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7498.g369173db.el8.x86_64 108/134 2023-11-27T17:46:49.262 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:18.0.0-7498.g369173db.el8.noarch 109/134 2023-11-27T17:46:49.273 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7498.g369173db.el8.noarch 109/134 2023-11-27T17:46:50.611 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:18.0.0-7498.g369173db.el8.x86_64 110/134 2023-11-27T17:46:50.854 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:18.0.0-7498.g369173db.el8.x86_64 111/134 2023-11-27T17:46:50.887 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7498.g369173db.el8.x86_64 111/134 2023-11-27T17:46:51.003 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7498.g36917 112/134 2023-11-27T17:46:51.045 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7498.g36917 112/134 2023-11-27T17:46:51.220 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-mirror-2:18.0.0-7498.g369173db.el8.x86_64 113/134 2023-11-27T17:46:51.579 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7498.g369173db.el8.x86_64 113/134 2023-11-27T17:46:51.737 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:18.0.0-7498.g369173db.el8.x86_64 114/134 2023-11-27T17:46:52.610 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7498.g369173db.el8.x86_64 114/134 2023-11-27T17:46:53.462 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:18.0.0-7498.g369173db.el8.x86_64 115/134 2023-11-27T17:46:53.749 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-11-27T17:46:53.963 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:18.0.0-7498.g369173db.el8.x86_64 117/134 2023-11-27T17:46:54.206 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-11-27T17:46:54.362 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-11-27T17:46:54.550 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-11-27T17:46:54.817 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-11-27T17:46:54.991 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:18.0.0-7498.g369173db.el8.x86_ 121/134 2023-11-27T17:46:55.139 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-27T17:46:56.420 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7498.g369173db.el8.x86_64 114/134 2023-11-27T17:46:56.716 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:18.0.0-7498.g369173db.el8.x86_64 115/134 2023-11-27T17:46:56.852 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-11-27T17:46:57.046 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-11-27T17:46:57.245 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-27T17:46:57.521 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-27T17:46:57.538 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-27T17:46:57.713 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-top-2:18.0.0-7498.g369173db.el8.noarch 124/134 2023-11-27T17:46:57.899 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-11-27T17:46:57.995 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:18.0.0-7498.g369173db.el8.x86_64 125/134 2023-11-27T17:46:58.197 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-11-27T17:46:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:18.0.0-7498.g369173db.el8.x86_64 126/134 2023-11-27T17:46:58.390 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:18.0.0-7498.g369173db.el8.x86_64 119/134 2023-11-27T17:46:58.556 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-27T17:46:58.684 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-27T17:46:58.748 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:18.0.0-7498.g369173db.el8.x86_ 121/134 2023-11-27T17:46:58.861 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-27T17:46:58.903 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-11-27T17:46:58.981 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-11-27T17:46:59.170 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-11-27T17:46:59.183 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-11-27T17:46:59.328 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-27T17:46:59.337 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-27T17:46:59.480 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-11-27T17:46:59.481 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-27T17:46:59.698 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-27T17:46:59.698 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-27T17:46:59.965 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-27T17:47:00.169 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-27T17:47:00.702 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:18.0.0-7498.g369173db.el8.x86_64 1/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:18.0.0-7498.g369173db.el8.x86_64 2/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 3/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:18.0.0-7498.g369173db.el8.x86_64 4/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7498.g36917 5/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:18.0.0-7498.g369173db.el8.x86_64 6/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:18.0.0-7498.g369173db.el8.x86_64 7/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:18.0.0-7498.g369173db.el8.x86_64 8/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:18.0.0-7498.g369173db.el8.x86_64 9/134 2023-11-27T17:47:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:18.0.0-7498.g369173db.el8.x86_64 10/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:18.0.0-7498.g369173db.el8.x86_64 11/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:18.0.0-7498.g369173db.el8.x86_64 12/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-mirror-2:18.0.0-7498.g369173db.el8.x86_64 13/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:18.0.0-7498.g369173db.el8.x86_ 14/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:18.0.0-7498.g369173db.el8.x86_64 15/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:18.0.0-7498.g369173db.el8.x86_64 16/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:18.0.0-7498.g369173db.el8.x86_6 17/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:18.0.0-7498.g369173db.el8.x86 18/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:18.0.0-7498.g369173db.el8.x86_64 19/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 20/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:18.0.0-7498.g369173db.el8. 21/134 2023-11-27T17:47:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:18.0.0-7498.g369173db.el8.x86_6 22/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:18.0.0-7498.g369173db.el8.x86_64 23/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:18.0.0-7498.g369173db.el8.x86_64 24/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:18.0.0-7498.g369173db.el8.x86_64 25/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:18.0.0-7498.g369173db.el8.x86_64 26/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:18.0.0-7498.g369173db.el8.x86_64 27/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:18.0.0-7498.g369173db.el8.x86_64 28/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 29/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el8.noa 30/134 2023-11-27T17:47:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el8.n 31/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 32/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 33/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7498.g369173db.el8.noarch 34/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 35/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:18.0.0-7498.g369173db.el8.noarch 36/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:18.0.0-7498.g369173db.el8.noarch 37/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-top-2:18.0.0-7498.g369173db.el8.noarch 38/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-27T17:47:00.706 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-27T17:47:00.707 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-27T17:47:00.708 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-11-27T17:47:00.709 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-11-27T17:47:00.710 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-11-27T17:47:00.711 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-11-27T17:47:00.712 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-11-27T17:47:00.713 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:18.0.0-7498.g369173db.el8.x86_64 129/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:18.0.0-7498.g369173db.el8.x86_64 131/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-27T17:47:00.714 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-27T17:47:01.123 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-27T17:47:01.418 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-27T17:47:01.435 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-27T17:47:01.602 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-top-2:18.0.0-7498.g369173db.el8.noarch 124/134 2023-11-27T17:47:01.851 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:18.0.0-7498.g369173db.el8.x86_64 125/134 2023-11-27T17:47:02.114 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:18.0.0-7498.g369173db.el8.x86_64 126/134 2023-11-27T17:47:02.453 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-27T17:47:02.593 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-27T17:47:02.601 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-27T17:47:02.821 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-11-27T17:47:02.992 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-11-27T17:47:03.070 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-11-27T17:47:03.288 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-27T17:47:03.288 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:02:42 ago on Mon 27 Nov 2023 05:44:21 PM UTC. 2023-11-27T17:47:03.309 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-11-27T17:47:03.321 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-11-27T17:47:03.322 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-27T17:47:03.487 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-27T17:47:03.487 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-27T17:47:03.734 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-27T17:47:03.908 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-27T17:47:04.423 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:18.0.0-7498.g369173db.el8.x86_64 1/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:18.0.0-7498.g369173db.el8.x86_64 2/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 3/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:18.0.0-7498.g369173db.el8.x86_64 4/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7498.g36917 5/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:18.0.0-7498.g369173db.el8.x86_64 6/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:18.0.0-7498.g369173db.el8.x86_64 7/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:18.0.0-7498.g369173db.el8.x86_64 8/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:18.0.0-7498.g369173db.el8.x86_64 9/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:18.0.0-7498.g369173db.el8.x86_64 10/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:18.0.0-7498.g369173db.el8.x86_64 11/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:18.0.0-7498.g369173db.el8.x86_64 12/134 2023-11-27T17:47:04.424 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-mirror-2:18.0.0-7498.g369173db.el8.x86_64 13/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:18.0.0-7498.g369173db.el8.x86_ 14/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:18.0.0-7498.g369173db.el8.x86_64 15/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:18.0.0-7498.g369173db.el8.x86_64 16/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:18.0.0-7498.g369173db.el8.x86_6 17/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:18.0.0-7498.g369173db.el8.x86 18/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:18.0.0-7498.g369173db.el8.x86_64 19/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 20/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:18.0.0-7498.g369173db.el8. 21/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:18.0.0-7498.g369173db.el8.x86_6 22/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:18.0.0-7498.g369173db.el8.x86_64 23/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:18.0.0-7498.g369173db.el8.x86_64 24/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:18.0.0-7498.g369173db.el8.x86_64 25/134 2023-11-27T17:47:04.425 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:18.0.0-7498.g369173db.el8.x86_64 26/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:18.0.0-7498.g369173db.el8.x86_64 27/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:18.0.0-7498.g369173db.el8.x86_64 28/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 29/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el8.noa 30/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el8.n 31/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 32/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 33/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7498.g369173db.el8.noarch 34/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 35/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:18.0.0-7498.g369173db.el8.noarch 36/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:18.0.0-7498.g369173db.el8.noarch 37/134 2023-11-27T17:47:04.426 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-top-2:18.0.0-7498.g369173db.el8.noarch 38/134 2023-11-27T17:47:04.427 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-27T17:47:04.427 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-27T17:47:04.427 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-27T17:47:04.427 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-27T17:47:04.427 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-27T17:47:04.427 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-27T17:47:04.427 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-27T17:47:04.427 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-27T17:47:04.428 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-27T17:47:04.429 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-11-27T17:47:04.430 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-11-27T17:47:04.431 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-11-27T17:47:04.432 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-27T17:47:04.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:18.0.0-7498.g369173db.el8.x86_64 129/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:18.0.0-7498.g369173db.el8.x86_64 131/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-27T17:47:04.434 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-27T17:47:06.997 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-27T17:47:06.997 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:25 ago on Mon 27 Nov 2023 05:44:41 PM UTC. 2023-11-27T17:47:11.903 INFO:teuthology.orchestra.run.smithi177.stdout:Installed products updated. 2023-11-27T17:47:12.171 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:12.171 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2023-11-27T17:47:12.171 INFO:teuthology.orchestra.run.smithi177.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-27T17:47:12.171 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.171 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.1-7.el8.noarch 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.0.4-10.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.172 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.173 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.1-9.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: jq-1.6-3.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.174 INFO:teuthology.orchestra.run.smithi177.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: libpq-13.5-1.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-27T17:47:12.175 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-27T17:47:12.176 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-27T17:47:12.177 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-27T17:47:12.178 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-2.6-1.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.179 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-27T17:47:12.180 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-27T17:47:12.181 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-27T17:47:12.182 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-27T17:47:12.182 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:12.182 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2023-11-27T17:47:13.398 DEBUG:teuthology.parallel:result is None 2023-11-27T17:47:15.352 INFO:teuthology.orchestra.run.smithi178.stdout:Installed products updated. 2023-11-27T17:47:15.586 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:15.586 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2023-11-27T17:47:15.586 INFO:teuthology.orchestra.run.smithi178.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-27T17:47:15.586 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.586 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.587 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-11-27T17:47:15.587 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-27T17:47:15.587 INFO:teuthology.orchestra.run.smithi178.stdout: automake-1.16.1-7.el8.noarch 2023-11-27T17:47:15.587 INFO:teuthology.orchestra.run.smithi178.stdout: bison-3.0.4-10.el8.x86_64 2023-11-27T17:47:15.587 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.588 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.588 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.588 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.588 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.588 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.588 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.588 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.589 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.589 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.589 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.589 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.589 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.589 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.589 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.590 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.590 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.590 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.590 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.590 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.590 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.590 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.591 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top-2:18.0.0-7498.g369173db.el8.noarch 2023-11-27T17:47:15.591 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-27T17:47:15.591 INFO:teuthology.orchestra.run.smithi178.stdout: flex-2.6.1-9.el8.x86_64 2023-11-27T17:47:15.591 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-27T17:47:15.591 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-27T17:47:15.591 INFO:teuthology.orchestra.run.smithi178.stdout: jq-1.6-3.el8.x86_64 2023-11-27T17:47:15.591 INFO:teuthology.orchestra.run.smithi178.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-27T17:47:15.592 INFO:teuthology.orchestra.run.smithi178.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-27T17:47:15.592 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-27T17:47:15.592 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.592 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.592 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.592 INFO:teuthology.orchestra.run.smithi178.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-27T17:47:15.592 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-27T17:47:15.593 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-27T17:47:15.593 INFO:teuthology.orchestra.run.smithi178.stdout: libpq-13.5-1.el8.x86_64 2023-11-27T17:47:15.593 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-27T17:47:15.593 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-27T17:47:15.593 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.593 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.593 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-27T17:47:15.594 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.594 INFO:teuthology.orchestra.run.smithi178.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-27T17:47:15.594 INFO:teuthology.orchestra.run.smithi178.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-27T17:47:15.594 INFO:teuthology.orchestra.run.smithi178.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-27T17:47:15.594 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-27T17:47:15.594 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-27T17:47:15.594 INFO:teuthology.orchestra.run.smithi178.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-27T17:47:15.594 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-27T17:47:15.595 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-27T17:47:15.595 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-27T17:47:15.595 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-27T17:47:15.595 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-27T17:47:15.595 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-27T17:47:15.595 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-27T17:47:15.595 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-27T17:47:15.596 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-27T17:47:15.596 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-27T17:47:15.596 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-27T17:47:15.596 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-27T17:47:15.596 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-27T17:47:15.596 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-27T17:47:15.596 INFO:teuthology.orchestra.run.smithi178.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-27T17:47:15.596 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-27T17:47:15.597 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.597 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.597 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.597 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-27T17:47:15.597 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-27T17:47:15.597 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-27T17:47:15.597 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-27T17:47:15.598 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-27T17:47:15.598 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-27T17:47:15.598 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-27T17:47:15.598 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-27T17:47:15.598 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-27T17:47:15.598 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-27T17:47:15.598 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-27T17:47:15.598 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-27T17:47:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-27T17:47:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-27T17:47:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-27T17:47:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-27T17:47:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-27T17:47:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-27T17:47:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-27T17:47:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-27T17:47:15.600 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-27T17:47:15.600 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-27T17:47:15.600 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-2.6-1.el8.noarch 2023-11-27T17:47:15.600 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-27T17:47:15.600 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-27T17:47:15.600 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-27T17:47:15.600 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-27T17:47:15.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-27T17:47:15.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-27T17:47:15.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-27T17:47:15.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-27T17:47:15.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-27T17:47:15.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-27T17:47:15.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-27T17:47:15.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-27T17:47:15.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-27T17:47:15.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-27T17:47:15.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-27T17:47:15.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-27T17:47:15.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-27T17:47:15.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-27T17:47:15.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-27T17:47:15.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-27T17:47:15.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-27T17:47:15.603 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.604 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.604 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:18.0.0-7498.g369173db.el8.x86_64 2023-11-27T17:47:15.604 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-27T17:47:15.604 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-27T17:47:15.604 INFO:teuthology.orchestra.run.smithi178.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-27T17:47:15.604 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-27T17:47:15.604 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-27T17:47:15.605 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-27T17:47:15.605 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:15.605 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-11-27T17:47:15.832 DEBUG:teuthology.parallel:result is None 2023-11-27T17:47:15.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:47:15.972 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-27T17:47:15.995 INFO:teuthology.orchestra.run.smithi177.stdout:18.0.0-7498.g369173db.el8 2023-11-27T17:47:15.996 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498.g369173db.el8 2023-11-27T17:47:15.996 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498.g369173db is installed. 2023-11-27T17:47:15.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:47:16.136 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-27T17:47:16.158 INFO:teuthology.orchestra.run.smithi178.stdout:18.0.0-7498.g369173db.el8 2023-11-27T17:47:16.158 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498.g369173db.el8 2023-11-27T17:47:16.158 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498.g369173db is installed. 2023-11-27T17:47:16.161 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-27T17:47:16.161 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:16.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T17:47:16.203 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:16.204 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T17:47:16.247 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-27T17:47:16.248 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:16.248 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T17:47:16.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T17:47:16.340 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:16.340 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T17:47:16.368 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T17:47:16.434 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-27T17:47:16.435 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:16.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T17:47:16.462 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T17:47:16.528 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:16.528 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T17:47:16.554 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T17:47:16.619 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-27T17:47:16.620 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:16.620 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T17:47:16.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T17:47:16.712 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:16.712 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T17:47:16.740 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T17:47:16.806 INFO:teuthology.run_tasks:Running task ceph... 2023-11-27T17:47:16.870 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-27T17:47:16.870 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2023-11-27T17:47:16.872 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2023-11-27T17:47:16.900 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-27T17:47:16.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T17:47:16.938 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T17:47:16.966 INFO:tasks.ceph:Creating extra log directories... 2023-11-27T17:47:16.966 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T17:47:17.004 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T17:47:17.037 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-27T17:47:17.037 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-27T17:47:17.037 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-27T17:47:17.038 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:17.038 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T17:47:17.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T17:47:17.244 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-27T17:47:17.271 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:17.272 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T17:47:17.290 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T17:47:17.498 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-27T17:47:17.530 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-27T17:47:17.530 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-27T17:47:17.530 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467908', 'branch': 'wip-yuri10-testing-2023-11-22-1112', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7467908', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-11-22-1112'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-11-22-1112', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8541, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-11-22-1112', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-27_17:14:24', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-27T17:47:17.531 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T17:47:17.533 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T17:47:17.580 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T17:47:17.589 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T17:47:17.646 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:17.646 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T17:47:17.669 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T17:47:17.669 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2023-11-27T17:47:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T17:47:17.726 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:47:17.726 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 393370 Links: 1 2023-11-27T17:47:17.726 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:47:17.726 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T17:47:17.726 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-11-27 17:47:00.388751988 +0000 2023-11-27T17:47:17.727 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-11-27 17:43:22.977405960 +0000 2023-11-27T17:47:17.727 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-11-27 17:43:22.977405960 +0000 2023-11-27T17:47:17.727 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2023-11-27T17:47:17.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T17:47:17.790 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-11-27T17:47:17.790 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-11-27T17:47:17.790 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000227699 s, 2.2 MB/s 2023-11-27T17:47:17.791 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T17:47:17.849 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2023-11-27T17:47:17.905 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T17:47:17.905 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:47:17.905 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 389601 Links: 1 2023-11-27T17:47:17.906 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:47:17.906 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T17:47:17.906 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-11-27 17:47:00.388751988 +0000 2023-11-27T17:47:17.906 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-11-27 17:43:23.527390614 +0000 2023-11-27T17:47:17.906 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-11-27 17:43:23.527390614 +0000 2023-11-27T17:47:17.906 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2023-11-27T17:47:17.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T17:47:17.971 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-11-27T17:47:17.971 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-11-27T17:47:17.971 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000198842 s, 2.6 MB/s 2023-11-27T17:47:17.972 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T17:47:18.029 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2023-11-27T17:47:18.086 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T17:47:18.086 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:47:18.087 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 391569 Links: 1 2023-11-27T17:47:18.087 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:47:18.087 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T17:47:18.087 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-11-27 17:47:00.388751988 +0000 2023-11-27T17:47:18.087 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-11-27 17:43:24.109374375 +0000 2023-11-27T17:47:18.087 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-11-27 17:43:24.109374375 +0000 2023-11-27T17:47:18.087 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2023-11-27T17:47:18.087 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T17:47:18.152 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-11-27T17:47:18.152 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-11-27T17:47:18.152 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000212092 s, 2.4 MB/s 2023-11-27T17:47:18.153 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T17:47:18.214 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2023-11-27T17:47:18.270 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T17:47:18.271 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:47:18.271 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 395445 Links: 1 2023-11-27T17:47:18.271 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:47:18.271 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T17:47:18.271 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-11-27 17:47:00.388751988 +0000 2023-11-27T17:47:18.271 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-11-27 17:43:24.651359252 +0000 2023-11-27T17:47:18.271 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-11-27 17:43:24.651359252 +0000 2023-11-27T17:47:18.272 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2023-11-27T17:47:18.272 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T17:47:18.336 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-11-27T17:47:18.336 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-11-27T17:47:18.337 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.00020071 s, 2.6 MB/s 2023-11-27T17:47:18.337 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T17:47:18.395 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:18.395 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:18.395 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T17:47:18.414 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T17:47:18.414 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2023-11-27T17:47:18.470 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T17:47:18.470 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:47:18.470 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 390461 Links: 1 2023-11-27T17:47:18.470 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:47:18.471 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T17:47:18.471 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-11-27 17:47:04.114143457 +0000 2023-11-27T17:47:18.471 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-11-27 17:43:26.974529602 +0000 2023-11-27T17:47:18.471 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-11-27 17:43:26.974529602 +0000 2023-11-27T17:47:18.471 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-11-27T17:47:18.471 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T17:47:18.536 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-11-27T17:47:18.536 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-11-27T17:47:18.537 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.8102e-05 s, 5.2 MB/s 2023-11-27T17:47:18.539 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T17:47:18.596 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2023-11-27T17:47:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T17:47:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:47:18.654 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 389441 Links: 1 2023-11-27T17:47:18.654 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:47:18.654 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T17:47:18.654 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-11-27 17:47:04.114143457 +0000 2023-11-27T17:47:18.654 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-11-27 17:43:27.609516711 +0000 2023-11-27T17:47:18.654 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-11-27 17:43:27.609516711 +0000 2023-11-27T17:47:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-11-27T17:47:18.655 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T17:47:18.720 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-11-27T17:47:18.720 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-11-27T17:47:18.721 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000104798 s, 4.9 MB/s 2023-11-27T17:47:18.723 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T17:47:18.781 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2023-11-27T17:47:18.838 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T17:47:18.838 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:47:18.838 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 390561 Links: 1 2023-11-27T17:47:18.838 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:47:18.838 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T17:47:18.838 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-11-27 17:47:04.114143457 +0000 2023-11-27T17:47:18.838 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-11-27 17:43:28.260503496 +0000 2023-11-27T17:47:18.838 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-11-27 17:43:28.260503496 +0000 2023-11-27T17:47:18.839 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-11-27T17:47:18.840 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T17:47:18.904 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-11-27T17:47:18.904 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-11-27T17:47:18.904 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.0612e-05 s, 5.7 MB/s 2023-11-27T17:47:18.905 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T17:47:18.963 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2023-11-27T17:47:19.021 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T17:47:19.021 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:47:19.021 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 392547 Links: 1 2023-11-27T17:47:19.021 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:47:19.021 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T17:47:19.022 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-11-27 17:47:04.115143437 +0000 2023-11-27T17:47:19.022 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-11-27 17:43:28.942489651 +0000 2023-11-27T17:47:19.022 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-11-27 17:43:28.942489651 +0000 2023-11-27T17:47:19.022 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-11-27T17:47:19.022 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T17:47:19.085 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-11-27T17:47:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-11-27T17:47:19.086 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000100059 s, 5.1 MB/s 2023-11-27T17:47:19.087 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T17:47:19.144 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:19.144 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T17:47:19.144 INFO:tasks.ceph:Generating config... 2023-11-27T17:47:19.146 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-27T17:47:19.146 INFO:tasks.ceph:[client] debug client = 20 2023-11-27T17:47:19.146 INFO:tasks.ceph:[client] debug ms = 1 2023-11-27T17:47:19.146 INFO:tasks.ceph:[client] pid file = 2023-11-27T17:47:19.146 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-27T17:47:19.146 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-27T17:47:19.146 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-27T17:47:19.146 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-27T17:47:19.146 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-27T17:47:19.147 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-27T17:47:19.148 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-27T17:47:19.148 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-27T17:47:19.148 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-27T17:47:19.149 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-27T17:47:19.149 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-27T17:47:19.149 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-27T17:47:19.149 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-27T17:47:19.149 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-27T17:47:19.149 INFO:tasks.ceph:Setting up mon.a... 2023-11-27T17:47:19.149 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-27T17:47:19.297 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.keyring 2023-11-27T17:47:19.299 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-27T17:47:19.373 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T17:47:19.399 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.177'), ('mon.b', '172.21.15.178'), ('mon.c', '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]')] 2023-11-27T17:47:19.399 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.177,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-27T17:47:19.400 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:19.400 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T17:47:19.455 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.177 --add b 172.21.15.178 --addv c '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:19.542 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:19.542 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: generated fsid 9352b089-d7fa-4b22-a837-e414c87a0ebc 2023-11-27T17:47:19.542 INFO:teuthology.orchestra.run.smithi177.stdout:setting min_mon_release = quincy 2023-11-27T17:47:19.542 INFO:teuthology.orchestra.run.smithi177.stdout:epoch 0 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:fsid 9352b089-d7fa-4b22-a837-e414c87a0ebc 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:last_changed 2023-11-27T17:47:19.541473+0000 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:created 2023-11-27T17:47:19.541473+0000 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:min_mon_release 17 (quincy) 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:election_strategy: 1 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:0: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.a 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:2: [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] mon.c 2023-11-27T17:47:19.543 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-27T17:47:19.544 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T17:47:19.609 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9352b089-d7fa-4b22-a837-e414c87a0ebc... 2023-11-27T17:47:19.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T17:47:19.612 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T17:47:19.654 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2023-11-27T17:47:19.654 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2023-11-27T17:47:19.655 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2023-11-27T17:47:19.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.177,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 9352b089-d7fa-4b22-a837-e414c87a0ebc 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2023-11-27T17:47:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2023-11-27T17:47:19.659 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2023-11-27T17:47:19.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2023-11-27T17:47:19.661 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2023-11-27T17:47:19.662 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:47:19.663 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2023-11-27T17:47:19.664 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2023-11-27T17:47:19.665 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2023-11-27T17:47:19.666 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2023-11-27T17:47:19.667 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-11-27T17:47:19.668 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T17:47:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T17:47:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-11-27T17:47:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.177,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 9352b089-d7fa-4b22-a837-e414c87a0ebc 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-11-27T17:47:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-11-27T17:47:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2023-11-27T17:47:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2023-11-27T17:47:19.675 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-11-27T17:47:19.676 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T17:47:19.677 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2023-11-27T17:47:19.678 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-11-27T17:47:19.679 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2023-11-27T17:47:19.680 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2023-11-27T17:47:19.681 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2023-11-27T17:47:19.681 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-11-27T17:47:19.681 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-11-27T17:47:19.681 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-11-27T17:47:19.682 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-27T17:47:19.682 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-27T17:47:19.811 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-27T17:47:19.811 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:19.811 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-27T17:47:19.829 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:19.829 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-27T17:47:19.885 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2023-11-27T17:47:19.885 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:19.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T17:47:19.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T17:47:20.037 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:20.037 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:20.059 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2023-11-27T17:47:20.059 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:20.059 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T17:47:20.059 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T17:47:20.096 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:20.096 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:20.152 INFO:tasks.ceph:Setting up mon nodes... 2023-11-27T17:47:20.152 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-27T17:47:20.152 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T17:47:20.207 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T17:47:20.209 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T17:47:20.271 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T17:47:20.275 INFO:tasks.ceph:Setting up mds nodes... 2023-11-27T17:47:20.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T17:47:20.328 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T17:47:20.331 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-27T17:47:20.357 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T17:47:20.451 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T17:47:20.454 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-27T17:47:20.480 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T17:47:20.535 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T17:47:20.538 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-27T17:47:20.564 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T17:47:20.660 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T17:47:20.663 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-27T17:47:20.688 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-27T17:47:20.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-27T17:47:20.732 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-27T17:47:20.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-27T17:47:20.788 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-27T17:47:20.801 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-27T17:47:20.844 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-27T17:47:20.858 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-27T17:47:20.943 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-27T17:47:20.957 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-27T17:47:20.957 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T17:47:20.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-27T17:47:20.983 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:20.983 INFO:tasks.ceph:role: osd.0 2023-11-27T17:47:20.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-27T17:47:20.984 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:47:21.057 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:47:21.492 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-11-27T17:47:21.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-11-27T17:47:21.494 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-27T17:47:21.682 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-27T17:47:21.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-27T17:47:21.782 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:21.782 INFO:tasks.ceph:role: osd.1 2023-11-27T17:47:21.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-27T17:47:21.782 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T17:47:21.855 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:47:21.855 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:47:21.855 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:47:21.855 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:47:21.856 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:47:21.856 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:47:21.856 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:47:21.856 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:47:21.856 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:47:21.856 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:47:22.272 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-11-27T17:47:22.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-11-27T17:47:22.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-27T17:47:22.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-27T17:47:22.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-27T17:47:22.479 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:22.479 INFO:tasks.ceph:role: osd.2 2023-11-27T17:47:22.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-27T17:47:22.479 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T17:47:22.553 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:47:22.553 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:47:22.553 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:47:22.553 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:47:22.554 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:47:22.554 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:47:22.554 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:47:22.554 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:47:22.554 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:47:22.554 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:47:22.994 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-11-27T17:47:22.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-11-27T17:47:22.996 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-27T17:47:23.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-27T17:47:23.194 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-27T17:47:23.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:23.262 INFO:tasks.ceph:role: osd.3 2023-11-27T17:47:23.262 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2023-11-27T17:47:23.263 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T17:47:23.336 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:47:23.336 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:47:23.336 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:47:23.337 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:47:23.337 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:47:23.337 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:47:23.337 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:47:23.337 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:47:23.337 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:47:23.337 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:47:23.779 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-11-27T17:47:23.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-11-27T17:47:23.781 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-27T17:47:23.948 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-27T17:47:23.982 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:24.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:24.098+0000 7f4ca9f8f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-27T17:47:24.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:24.098+0000 7f4ca9f8f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-27T17:47:24.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:24.098+0000 7f4ca9f8f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T17:47:24.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:24.098+0000 7f4ca9f8f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T17:47:24.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:24.098+0000 7f4ca9f8f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T17:47:24.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:24.099+0000 7f4ca9f8f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-27T17:47:26.982 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-27T17:47:27.010 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:27.093+0000 7ff23990c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-27T17:47:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:27.093+0000 7ff23990c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-27T17:47:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:27.093+0000 7ff23990c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T17:47:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:27.093+0000 7ff23990c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T17:47:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:27.093+0000 7ff23990c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T17:47:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:27.094+0000 7ff23990c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-27T17:47:29.984 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-27T17:47:30.012 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:30.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:30.096+0000 7fd0e5bde640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-27T17:47:30.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:30.097+0000 7fd0e5bde640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-27T17:47:30.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:30.097+0000 7fd0e5bde640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T17:47:30.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:30.097+0000 7fd0e5bde640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T17:47:30.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:30.097+0000 7fd0e5bde640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T17:47:30.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:30.097+0000 7fd0e5bde640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-27T17:47:32.970 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-27T17:47:33.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:33.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:33.090+0000 7fbc0c20d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-27T17:47:33.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:33.090+0000 7fbc0c20d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-27T17:47:33.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:33.090+0000 7fbc0c20d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T17:47:33.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:33.090+0000 7fbc0c20d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T17:47:33.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:33.090+0000 7fbc0c20d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T17:47:33.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:33.091+0000 7fbc0c20d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-27T17:47:35.957 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-27T17:47:35.988 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-27T17:47:36.021 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:36.021 INFO:tasks.ceph:role: osd.4 2023-11-27T17:47:36.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2023-11-27T17:47:36.022 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T17:47:36.093 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:47:36.093 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:47:36.093 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:47:36.093 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:47:36.093 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:47:36.093 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:47:36.094 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:47:36.094 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:47:36.094 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:47:36.094 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:47:36.116 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-11-27T17:47:36.117 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-11-27T17:47:36.117 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-27T17:47:36.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-27T17:47:36.272 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-27T17:47:36.340 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:36.340 INFO:tasks.ceph:role: osd.5 2023-11-27T17:47:36.340 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2023-11-27T17:47:36.341 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T17:47:36.407 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:47:36.407 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:47:36.407 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:47:36.407 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:47:36.408 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:47:36.408 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:47:36.408 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:47:36.408 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:47:36.408 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:47:36.408 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:47:36.429 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-11-27T17:47:36.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-11-27T17:47:36.431 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-27T17:47:36.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-27T17:47:36.580 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-27T17:47:36.646 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:36.646 INFO:tasks.ceph:role: osd.6 2023-11-27T17:47:36.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2023-11-27T17:47:36.646 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:47:36.712 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:47:36.735 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-11-27T17:47:36.736 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-11-27T17:47:36.736 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-27T17:47:36.816 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-27T17:47:36.886 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-27T17:47:36.952 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:47:36.952 INFO:tasks.ceph:role: osd.7 2023-11-27T17:47:36.953 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com 2023-11-27T17:47:36.953 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T17:47:37.018 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:47:37.019 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:47:37.041 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-11-27T17:47:37.042 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-11-27T17:47:37.043 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-27T17:47:37.122 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-27T17:47:37.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:37.296 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:37.293+0000 7f539f80e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-27T17:47:37.297 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:37.294+0000 7f539f80e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-27T17:47:37.297 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:37.294+0000 7f539f80e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T17:47:37.297 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:37.294+0000 7f539f80e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T17:47:37.297 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:37.294+0000 7f539f80e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T17:47:37.297 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:37.294+0000 7f539f80e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-27T17:47:40.160 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-27T17:47:40.191 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:40.283 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:40.280+0000 7f82ca059640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-27T17:47:40.283 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:40.280+0000 7f82ca059640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-27T17:47:40.283 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:40.280+0000 7f82ca059640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T17:47:40.283 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:40.280+0000 7f82ca059640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T17:47:40.283 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:40.280+0000 7f82ca059640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T17:47:40.284 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:40.281+0000 7f82ca059640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-27T17:47:43.146 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-27T17:47:49.923 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:47:49.927 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:47:49.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:50.048 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:50.046+0000 7f12b9037640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-27T17:47:50.048 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:50.046+0000 7f12b9037640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-27T17:47:50.048 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:50.046+0000 7f12b9037640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T17:47:50.049 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:50.046+0000 7f12b9037640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T17:47:50.049 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:50.046+0000 7f12b9037640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T17:47:50.049 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:50.046+0000 7f12b9037640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-27T17:47:52.916 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-27T17:47:52.947 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:53.038 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:53.036+0000 7fbbde06b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-27T17:47:53.038 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:53.036+0000 7fbbde06b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-27T17:47:53.039 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:53.036+0000 7fbbde06b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T17:47:53.039 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:53.036+0000 7fbbde06b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T17:47:53.039 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:53.036+0000 7fbbde06b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T17:47:53.039 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:53.036+0000 7fbbde06b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-27T17:47:55.907 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-27T17:47:55.938 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-27T17:47:55.938 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:55.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-27T17:47:55.971 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:55.971 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-27T17:47:56.041 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:56.041 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-27T17:47:56.110 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:56.110 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-27T17:47:56.179 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:56.179 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-27T17:47:56.247 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:56.247 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-27T17:47:56.314 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:56.314 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-27T17:47:56.381 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.381 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-27T17:47:56.413 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.413 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-27T17:47:56.483 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.483 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-27T17:47:56.552 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.552 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-27T17:47:56.621 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.621 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-27T17:47:56.689 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.689 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-27T17:47:56.758 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-27T17:47:56.826 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:56.826 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-27T17:47:56.845 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:56.845 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-27T17:47:56.903 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.904 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-27T17:47:56.921 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:56.921 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-27T17:47:56.978 INFO:tasks.ceph:Adding keys to all mons... 2023-11-27T17:47:56.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T17:47:56.980 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T17:47:57.020 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRlvvNIDBAA4uMdKVdinQhFG5SSLgNqaA== 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRlHP6KExAAukLdiilIGGneFbtBeNl2gg== 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRlsrffGhAAmmygO3kh060STqc/7fxe2Q== 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAs1mRllPbgBRAAeQtd2cCiAnc7LM7pbt+MUQ== 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAv1mRlrGenBRAAP/aWP6geRnrnqjBca4bFHQ== 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAy1mRlNB3YBRAA3+VtBsPlmjUtpqLbSm+Sdw== 2023-11-27T17:47:57.021 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQA11mRlxpB4BRAAhLKAEZAsjsiRiFVyqyzMKg== 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRlw88nEBAAbGSsb0x5a/j56Gq7ev0wrw== 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRlPs3kHxAA4b1vBwh/PKOwkk0RVpSZFg== 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRlc7FPJxAAKAHwbRGrKom3FaNFuNFCbw== 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQA51mRl/oqWERAAeyQH3VKzZySxfp8w1BS25w== 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2023-11-27T17:47:57.022 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQA81mRl2cfNEBAA6dQetCMJA+zzMKVi15mkcQ== 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBG1mRl31/QAhAA5MrpSoluxAETuL2GlkA5Ig== 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBJ1mRls/I4AhAAV4/Hlg8ogU4uZPlEx1geOg== 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRl71yWKxAAe2FZ+w7xYRvPZ8mqVdPkZQ== 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout:[client.2] 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRlQf3vLhAAa5BNgV/MIf4oPB9oO3D7jQ== 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRlZ7dKMhAA7VqlnWB0UiO2FqE2+g2gGw== 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout:[client.3] 2023-11-27T17:47:57.023 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRljCAxOBAAZ63GVtYgdskTFi4ebeGTGg== 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.y] 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRlvvNIDBAA4uMdKVdinQhFG5SSLgNqaA== 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRlHP6KExAAukLdiilIGGneFbtBeNl2gg== 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRlsrffGhAAmmygO3kh060STqc/7fxe2Q== 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAs1mRllPbgBRAAeQtd2cCiAnc7LM7pbt+MUQ== 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2023-11-27T17:47:57.043 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAv1mRlrGenBRAAP/aWP6geRnrnqjBca4bFHQ== 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAy1mRlNB3YBRAA3+VtBsPlmjUtpqLbSm+Sdw== 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.3] 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQA11mRlxpB4BRAAhLKAEZAsjsiRiFVyqyzMKg== 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRlw88nEBAAbGSsb0x5a/j56Gq7ev0wrw== 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRlPs3kHxAA4b1vBwh/PKOwkk0RVpSZFg== 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRlc7FPJxAAKAHwbRGrKom3FaNFuNFCbw== 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.4] 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQA51mRl/oqWERAAeyQH3VKzZySxfp8w1BS25w== 2023-11-27T17:47:57.044 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.5] 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQA81mRl2cfNEBAA6dQetCMJA+zzMKVi15mkcQ== 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.6] 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBG1mRl31/QAhAA5MrpSoluxAETuL2GlkA5Ig== 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.7] 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBJ1mRls/I4AhAAV4/Hlg8ogU4uZPlEx1geOg== 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRl71yWKxAAe2FZ+w7xYRvPZ8mqVdPkZQ== 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout:[client.2] 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRlQf3vLhAAa5BNgV/MIf4oPB9oO3D7jQ== 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRlZ7dKMhAA7VqlnWB0UiO2FqE2+g2gGw== 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout:[client.3] 2023-11-27T17:47:57.045 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQAo1mRljCAxOBAAZ63GVtYgdskTFi4ebeGTGg== 2023-11-27T17:47:57.046 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T17:47:57.067 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T17:47:57.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:47:57.143 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:47:57.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:47:57.202 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:47:57.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.312 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.367 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.369 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.423 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.425 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.478 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T17:47:57.480 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T17:47:57.533 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:47:57.535 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:47:57.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:47:57.593 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:47:57.649 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.651 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.759 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.761 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.816 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:47:57.869 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:47:57.871 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:47:57.927 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:47:57.929 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:47:57.985 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:47:57.987 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:47:58.050 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:47:58.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:47:58.108 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-27T17:47:58.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-27T17:47:58.134 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T17:47:58.233 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-27T17:47:58.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-27T17:47:58.286 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T17:47:58.383 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-27T17:47:58.409 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-27T17:47:58.474 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T17:47:58.573 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-27T17:47:58.598 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:58.601 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:47:58.655 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-27T17:47:58.655 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-27T17:47:58.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-27T17:47:58.657 INFO:tasks.ceph.mon.a:Started 2023-11-27T17:47:58.657 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-27T17:47:58.657 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-27T17:47:58.697 INFO:tasks.ceph.mon.b:Started 2023-11-27T17:47:58.697 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-27T17:47:58.697 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-27T17:47:58.699 INFO:tasks.ceph.mon.c:Started 2023-11-27T17:47:58.699 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-27T17:47:58.699 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-27T17:47:58.699 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-27T17:47:58.701 INFO:tasks.ceph.mgr.y:Started 2023-11-27T17:47:58.702 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-27T17:47:58.702 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-27T17:47:58.703 INFO:tasks.ceph.mgr.x:Started 2023-11-27T17:47:58.704 INFO:tasks.ceph:Setting crush tunables to default 2023-11-27T17:47:58.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd crush tunables default 2023-11-27T17:47:58.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.824+0000 7fc41f26d700 1 Processor -- start 2023-11-27T17:47:58.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.825+0000 7fc41f26d700 1 -- start start 2023-11-27T17:47:58.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.825+0000 7fc41f26d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4180cdff0 0x7fc418162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.825+0000 7fc41f26d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc4180cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.825+0000 7fc41f26d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc418162bc0 con 0x7fc418146f00 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.825+0000 7fc41f26d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4181472e0 con 0x7fc4180cdff0 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.825+0000 7fc41f26d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180b0110 con 0x7fc4180afc30 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41d80a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc4180cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41c808700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4180cdff0 0x7fc418162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41d009700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fc418146f00 0x7fc4180cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:44040/0 (socket says 172.21.15.177:44040) 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41d80a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc4180cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:38214/0 (socket says 172.21.15.177:38214) 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41d009700 1 -- 172.21.15.177:0/3668709164 learned_addr learned my addr 172.21.15.177:0/3668709164 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41c808700 1 -- 172.21.15.177:0/3668709164 >> v2:172.21.15.178:3300/0 conn(0x7fc4180cdff0 msgr2=0x7fc418162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T17:47:58.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41c808700 1 -- 172.21.15.177:0/3668709164 >> v2:172.21.15.178:3300/0 conn(0x7fc4180cdff0 msgr2=0x7fc418162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:47:58.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41c808700 1 --2- 172.21.15.177:0/3668709164 >> v2:172.21.15.178:3300/0 conn(0x7fc4180cdff0 0x7fc418162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:47:58.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41d80a700 1 -- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 msgr2=0x7fc4180cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T17:47:58.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41d80a700 1 -- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 msgr2=0x7fc4180cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:47:58.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41d80a700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc4180cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:47:58.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41c808700 1 --2- 172.21.15.177:0/3668709164 >> v2:172.21.15.178:3300/0 conn(0x7fc4180cdff0 0x7fc418162680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T17:47:58.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:58.826+0000 7fc41d80a700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc4180cef50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T17:47:59.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892661182 0 0) 0x7fc418162bc0 con 0x7fc418146f00 2023-11-27T17:47:59.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4040035b0 con 0x7fc418146f00 2023-11-27T17:47:59.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3826895998 0 0) 0x7fc4040035b0 con 0x7fc418146f00 2023-11-27T17:47:59.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 msgr2=0x7fc4180cef50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:47:59.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc4180cef50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 >> v2:172.21.15.178:3300/0 conn(0x7fc4180cdff0 msgr2=0x7fc418162680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 --2- 172.21.15.177:0/3668709164 >> v2:172.21.15.178:3300/0 conn(0x7fc4180cdff0 0x7fc418162680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180b03f0 con 0x7fc418146f00 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fc408001670 con 0x7fc418146f00 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 >> v1:172.21.15.178:6789/0 conn(0x7fc418146f00 legacy=0x7fc4180cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc404003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc404004030 0x7fc404004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004d90 0x7fc404005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4181472e0 con 0x7fc404004d90 2023-11-27T17:47:59.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180b0110 con 0x7fc404004030 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40400bb10 con 0x7fc4180afc30 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc41d80a700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004d90 0x7fc404005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc41d009700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc404003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.022+0000 7fc41c808700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc404004030 0x7fc404004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.023+0000 7fc41c808700 1 -- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 msgr2=0x7fc404003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.023+0000 7fc41c808700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4180afc30 0x7fc404003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.023+0000 7fc41c808700 1 -- 172.21.15.177:0/3668709164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004d90 msgr2=0x7fc404005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.023+0000 7fc41c808700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004d90 0x7fc404005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.023+0000 7fc41c808700 1 -- 172.21.15.177:0/3668709164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040035b0 con 0x7fc404004030 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.023+0000 7fc41d80a700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004d90 0x7fc404005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:47:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.023+0000 7fc41c808700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc404004030 0x7fc404004850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc414009840 tx=0x7fc404005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d453a44e2fbc2e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:47:59.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.024+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400c070 con 0x7fc404004030 2023-11-27T17:47:59.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.024+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414013630 con 0x7fc404004030 2023-11-27T17:47:59.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.024+0000 7fc40ffff700 1 -- 172.21.15.177:0/3668709164 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4140139e0 con 0x7fc404004030 2023-11-27T17:47:59.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.025+0000 7fc41f26d700 1 -- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc404004030 msgr2=0x7fc404004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.025+0000 7fc41f26d700 1 --2- 172.21.15.177:0/3668709164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc404004030 0x7fc404004850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc414009840 tx=0x7fc404005880 comp rx=0 tx=0).stop 2023-11-27T17:47:59.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.025+0000 7fc41d80a700 1 -- 172.21.15.177:0/3668709164 reap_dead start 2023-11-27T17:47:59.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.025+0000 7fc41f26d700 1 -- 172.21.15.177:0/3668709164 shutdown_connections 2023-11-27T17:47:59.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.025+0000 7fc41f26d700 1 -- 172.21.15.177:0/3668709164 >> 172.21.15.177:0/3668709164 conn(0x7fc4180b38b0 msgr2=0x7fc4180b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.025+0000 7fc41f26d700 1 -- 172.21.15.177:0/3668709164 shutdown_connections 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.025+0000 7fc41f26d700 1 -- 172.21.15.177:0/3668709164 wait complete. 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.027+0000 7fc41f26d700 1 Processor -- start 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.027+0000 7fc41f26d700 1 -- start start 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41f26d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004030 0x7fc418153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41f26d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc418072e10 0x7fc4180706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41f26d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc418070be0 0x7fc418071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41f26d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41813f3b0 con 0x7fc404004030 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41f26d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41813e520 con 0x7fc418070be0 2023-11-27T17:47:59.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41f26d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41813e730 con 0x7fc418072e10 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc418072e10 0x7fc4180706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41d80a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc418070be0 0x7fc418071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc418072e10 0x7fc4180706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:38242/0 (socket says 172.21.15.177:38242) 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 -- 172.21.15.177:0/3516021367 learned_addr learned my addr 172.21.15.177:0/3516021367 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41d80a700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc418070be0 0x7fc418071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:58800/0 (socket says 172.21.15.177:58800) 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 -- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc418070be0 msgr2=0x7fc418071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc418070be0 0x7fc418071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 -- 172.21.15.177:0/3516021367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004030 msgr2=0x7fc418153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004030 0x7fc418153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 -- 172.21.15.177:0/3516021367 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41813ea10 con 0x7fc418072e10 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41d80a700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc418070be0 0x7fc418071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:47:59.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc41c808700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc418072e10 0x7fc4180706a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc4040047d0 tx=0x7fc4140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:47:59.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.028+0000 7fc40dffb700 1 -- 172.21.15.177:0/3516021367 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414013c70 con 0x7fc418072e10 2023-11-27T17:47:59.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.029+0000 7fc40dffb700 1 -- 172.21.15.177:0/3516021367 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414013dd0 con 0x7fc418072e10 2023-11-27T17:47:59.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.029+0000 7fc40dffb700 1 -- 172.21.15.177:0/3516021367 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4140038e0 con 0x7fc418072e10 2023-11-27T17:47:59.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.029+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41813ecf0 con 0x7fc418072e10 2023-11-27T17:47:59.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.029+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc418073290 con 0x7fc418072e10 2023-11-27T17:47:59.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.030+0000 7fc40dffb700 1 -- 172.21.15.177:0/3516021367 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fc414030440 con 0x7fc418072e10 2023-11-27T17:47:59.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.030+0000 7fc40dffb700 1 -- 172.21.15.177:0/3516021367 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc414027440 con 0x7fc418072e10 2023-11-27T17:47:59.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.030+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4180704f0 con 0x7fc418072e10 2023-11-27T17:47:59.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.032+0000 7fc40dffb700 1 -- 172.21.15.177:0/3516021367 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fc414017020 con 0x7fc418072e10 2023-11-27T17:47:59.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.108+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc418073420 con 0x7fc418072e10 2023-11-27T17:47:59.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.111+0000 7fc40dffb700 1 -- 172.21.15.177:0/3516021367 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc41400f040 con 0x7fc418072e10 2023-11-27T17:47:59.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.112+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc418072e10 msgr2=0x7fc4180706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.112+0000 7fc41f26d700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc418072e10 0x7fc4180706a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc4040047d0 tx=0x7fc4140047c0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.112+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 shutdown_connections 2023-11-27T17:47:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.113+0000 7fc41f26d700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc418070be0 0x7fc418071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.113+0000 7fc41f26d700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc404004030 0x7fc418153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.113+0000 7fc41f26d700 1 --2- 172.21.15.177:0/3516021367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc418072e10 0x7fc4180706a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.113+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 >> 172.21.15.177:0/3516021367 conn(0x7fc4180b38b0 msgr2=0x7fc4180b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:47:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.113+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 shutdown_connections 2023-11-27T17:47:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:47:59.113+0000 7fc41f26d700 1 -- 172.21.15.177:0/3516021367 wait complete. 2023-11-27T17:47:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:adjusted tunables profile to default 2023-11-27T17:47:59.126 INFO:tasks.ceph:check_enable_crimson: False 2023-11-27T17:47:59.126 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-27T17:47:59.126 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:59.126 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-27T17:47:59.141 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:47:59.140+0000 7f866e513200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T17:47:59.143 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:47:59.142+0000 7f3e53c99200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T17:47:59.152 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:59.152 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-27T17:47:59.206 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:47:59.205+0000 7f866e513200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T17:47:59.212 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:47:59.211+0000 7f3e53c99200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T17:47:59.219 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:59.219 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-27T17:47:59.281 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:47:59.280+0000 7f866e513200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T17:47:59.285 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:47:59.285 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-27T17:47:59.293 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:47:59.292+0000 7f3e53c99200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T17:47:59.319 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:59.319 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-27T17:47:59.345 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:59.345 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-27T17:47:59.362 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:47:59.361+0000 7f866e513200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T17:47:59.376 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:47:59.375+0000 7f3e53c99200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T17:47:59.387 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:59.387 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-27T17:47:59.452 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:47:59.452 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-27T17:47:59.511 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:47:59.510+0000 7f866e513200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T17:47:59.517 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:47:59.516+0000 7f3e53c99200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T17:47:59.518 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 14b9bc6e-b475-43f4-a62e-78fb5acdecd3 0 2023-11-27T17:47:59.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.676+0000 7f542a05b700 1 Processor -- start 2023-11-27T17:47:59.678 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.676+0000 7f542a05b700 1 -- start start 2023-11-27T17:47:59.679 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.677+0000 7f542a05b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f542415e460 0x7f54240d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.679 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.677+0000 7f542a05b700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54240d1010 con 0x7f5424158620 2023-11-27T17:47:59.679 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.677+0000 7f542a05b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54240d1240 con 0x7f54240d2530 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.677+0000 7f542a05b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542415f470 con 0x7f542415e460 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.677+0000 7f5423fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f542415e460 0x7f54240d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.677+0000 7f5422ffd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f54240d2530 0x7f5424070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59808/0 (socket says 172.21.15.178:59808) 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.677+0000 7f5422ffd700 1 -- 172.21.15.178:0/3908779059 learned_addr learned my addr 172.21.15.178:0/3908779059 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.677+0000 7f54227fc700 1 -- 172.21.15.178:0/3908779059 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938538519 0 0) 0x7f54240d1240 con 0x7f54240d2530 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f54227fc700 1 -- 172.21.15.178:0/3908779059 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54100035b0 con 0x7f54240d2530 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f5423fff700 1 -- 172.21.15.178:0/3908779059 >> v1:172.21.15.178:6789/0 conn(0x7f54240d2530 legacy=0x7f5424070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f5423fff700 1 -- 172.21.15.178:0/3908779059 >> v1:172.21.15.177:6789/0 conn(0x7f5424158620 legacy=0x7f54240d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f5423fff700 1 -- 172.21.15.178:0/3908779059 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240d1520 con 0x7f542415e460 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f5423fff700 1 --2- 172.21.15.178:0/3908779059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f542415e460 0x7f54240d0ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f541c009870 tx=0x7f541c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bddd96e548a96e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f54227fc700 1 -- 172.21.15.178:0/3908779059 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c011830 con 0x7f542415e460 2023-11-27T17:47:59.680 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f54227fc700 1 -- 172.21.15.178:0/3908779059 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c011990 con 0x7f542415e460 2023-11-27T17:47:59.681 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f54227fc700 1 -- 172.21.15.178:0/3908779059 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c011d20 con 0x7f542415e460 2023-11-27T17:47:59.683 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f542a05b700 1 -- 172.21.15.178:0/3908779059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f542415e460 msgr2=0x7f54240d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.678+0000 7f542a05b700 1 --2- 172.21.15.178:0/3908779059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f542415e460 0x7f54240d0ad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f541c009870 tx=0x7f541c009b80 comp rx=0 tx=0).stop 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.679+0000 7f542a05b700 1 -- 172.21.15.178:0/3908779059 shutdown_connections 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.679+0000 7f542a05b700 1 --2- 172.21.15.178:0/3908779059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f542415e460 0x7f54240d0ad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.679+0000 7f542a05b700 1 -- 172.21.15.178:0/3908779059 >> 172.21.15.178:0/3908779059 conn(0x7f54240b60e0 msgr2=0x7f54240b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.679+0000 7f542a05b700 1 -- 172.21.15.178:0/3908779059 shutdown_connections 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.679+0000 7f542a05b700 1 -- 172.21.15.178:0/3908779059 wait complete. 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.680+0000 7f542a05b700 1 Processor -- start 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.680+0000 7f542a05b700 1 -- start start 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f542a05b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54240d2530 0x7f5424156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f542a05b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5424158620 0x7f542415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.684 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f542a05b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f542415e460 0x7f54240af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f542a05b700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424157240 con 0x7f54240d2530 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f542a05b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542415b850 con 0x7f542415e460 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f542a05b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240ae380 con 0x7f5424158620 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5422ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5424158620 0x7f542415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5423fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f542415e460 0x7f54240af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5422ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5424158620 0x7f542415b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:47162/0 (socket says 172.21.15.178:47162) 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f54237fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54240d2530 0x7f5424156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5422ffd700 1 -- 172.21.15.178:0/3555868928 learned_addr learned my addr 172.21.15.178:0/3555868928 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5423fff700 1 -- 172.21.15.178:0/3555868928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5424158620 msgr2=0x7f542415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5423fff700 1 --2- 172.21.15.178:0/3555868928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5424158620 0x7f542415b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5423fff700 1 -- 172.21.15.178:0/3555868928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54240d2530 msgr2=0x7f5424156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5423fff700 1 --2- 172.21.15.178:0/3555868928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54240d2530 0x7f5424156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.685 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5423fff700 1 -- 172.21.15.178:0/3555868928 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0094a0 con 0x7f542415e460 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f5423fff700 1 --2- 172.21.15.178:0/3555868928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f542415e460 0x7f54240af420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f541c016000 tx=0x7f541c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f541bfff700 1 -- 172.21.15.178:0/3555868928 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0036a0 con 0x7f542415e460 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f541bfff700 1 -- 172.21.15.178:0/3555868928 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c01e070 con 0x7f542415e460 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54240ae660 con 0x7f542415e460 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f541bfff700 1 -- 172.21.15.178:0/3555868928 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c003a20 con 0x7f542415e460 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.681+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54240aec20 con 0x7f542415e460 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.682+0000 7f541bfff700 1 -- 172.21.15.178:0/3555868928 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f541c003b80 con 0x7f542415e460 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.682+0000 7f541bfff700 1 -- 172.21.15.178:0/3555868928 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f541c01adf0 con 0x7f542415e460 2023-11-27T17:47:59.686 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.682+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5424073aa0 con 0x7f542415e460 2023-11-27T17:47:59.687 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.685+0000 7f541bfff700 1 -- 172.21.15.178:0/3555868928 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f541c020070 con 0x7f542415e460 2023-11-27T17:47:59.768 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.767+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14b9bc6e-b475-43f4-a62e-78fb5acdecd3", "id": 0} v 0) v1 -- 0x7f5424069400 con 0x7f542415e460 2023-11-27T17:47:59.771 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.770+0000 7f541bfff700 1 -- 172.21.15.178:0/3555868928 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14b9bc6e-b475-43f4-a62e-78fb5acdecd3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f541c015020 con 0x7f542415e460 2023-11-27T17:47:59.772 INFO:teuthology.orchestra.run.smithi178.stdout:0 2023-11-27T17:47:59.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f542415e460 msgr2=0x7f54240af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 --2- 172.21.15.178:0/3555868928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f542415e460 0x7f54240af420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f541c016000 tx=0x7f541c004750 comp rx=0 tx=0).stop 2023-11-27T17:47:59.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 shutdown_connections 2023-11-27T17:47:59.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 --2- 172.21.15.178:0/3555868928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f542415e460 0x7f54240af420 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 --2- 172.21.15.178:0/3555868928 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54240d2530 0x7f5424156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.774 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 --2- 172.21.15.178:0/3555868928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5424158620 0x7f542415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.774 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 >> 172.21.15.178:0/3555868928 conn(0x7f54240b60e0 msgr2=0x7f54240b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:47:59.774 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 shutdown_connections 2023-11-27T17:47:59.774 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.771+0000 7f542a05b700 1 -- 172.21.15.178:0/3555868928 wait complete. 2023-11-27T17:47:59.784 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5 1 2023-11-27T17:47:59.904 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.902+0000 7f5a4855e700 1 Processor -- start 2023-11-27T17:47:59.904 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.903+0000 7f5a4855e700 1 -- start start 2023-11-27T17:47:59.907 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a4855e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a400afa50 0x7f5a400b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.907 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a4855e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a400cd850 0x7f5a400cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.907 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a4855e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400ce200 con 0x7f5a4015b3d0 2023-11-27T17:47:59.907 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a4855e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400afe30 con 0x7f5a400afa50 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a4855e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4015b870 con 0x7f5a400cd850 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a462fa700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a400afa50 0x7f5a400b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a46afb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a400cd850 0x7f5a400cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a462fa700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a400afa50 0x7f5a400b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50820/0 (socket says 172.21.15.178:50820) 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.904+0000 7f5a462fa700 1 -- 172.21.15.178:0/773421383 learned_addr learned my addr 172.21.15.178:0/773421383 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a46afb700 1 -- 172.21.15.178:0/773421383 >> v2:172.21.15.178:3300/0 conn(0x7f5a400afa50 msgr2=0x7f5a400b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a46afb700 1 --2- 172.21.15.178:0/773421383 >> v2:172.21.15.178:3300/0 conn(0x7f5a400afa50 0x7f5a400b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a46afb700 1 -- 172.21.15.178:0/773421383 >> v1:172.21.15.177:6789/0 conn(0x7f5a4015b3d0 legacy=0x7f5a4015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a46afb700 1 -- 172.21.15.178:0/773421383 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4015bb50 con 0x7f5a400cd850 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a462fa700 1 --2- 172.21.15.178:0/773421383 >> v2:172.21.15.178:3300/0 conn(0x7f5a400afa50 0x7f5a400b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:47:59.908 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a46afb700 1 --2- 172.21.15.178:0/773421383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a400cd850 0x7f5a400cdcc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009d90 tx=0x7f5a3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284309a7f1526f29 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a452f8700 1 -- 172.21.15.178:0/773421383 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800e070 con 0x7f5a400cd850 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a452f8700 1 -- 172.21.15.178:0/773421383 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800bb20 con 0x7f5a400cd850 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.905+0000 7f5a452f8700 1 -- 172.21.15.178:0/773421383 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38012430 con 0x7f5a400cd850 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.906+0000 7f5a4855e700 1 -- 172.21.15.178:0/773421383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a400cd850 msgr2=0x7f5a400cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.906+0000 7f5a4855e700 1 --2- 172.21.15.178:0/773421383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a400cd850 0x7f5a400cdcc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009d90 tx=0x7f5a3800b330 comp rx=0 tx=0).stop 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.906+0000 7f5a4855e700 1 -- 172.21.15.178:0/773421383 shutdown_connections 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.906+0000 7f5a4855e700 1 --2- 172.21.15.178:0/773421383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a400cd850 0x7f5a400cdcc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.906+0000 7f5a4855e700 1 --2- 172.21.15.178:0/773421383 >> v2:172.21.15.178:3300/0 conn(0x7f5a400afa50 0x7f5a400b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.909 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.906+0000 7f5a4855e700 1 -- 172.21.15.178:0/773421383 >> 172.21.15.178:0/773421383 conn(0x7f5a400b38b0 msgr2=0x7f5a400b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:47:59.910 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.906+0000 7f5a4855e700 1 -- 172.21.15.178:0/773421383 shutdown_connections 2023-11-27T17:47:59.910 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.906+0000 7f5a4855e700 1 -- 172.21.15.178:0/773421383 wait complete. 2023-11-27T17:47:59.910 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:47:59.907+0000 7f3e53c99200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.908+0000 7f5a4855e700 1 Processor -- start 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.908+0000 7f5a4855e700 1 -- start start 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a4855e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a400afa50 0x7f5a401566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a4855e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a400cd850 0x7f5a401540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a4855e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a4015b3d0 0x7f5a40070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a4855e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a401f1890 con 0x7f5a400cd850 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a4855e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40155470 con 0x7f5a400afa50 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a4855e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a401548f0 con 0x7f5a4015b3d0 2023-11-27T17:47:59.913 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a462fa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a400afa50 0x7f5a401566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a462fa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a400afa50 0x7f5a401566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50826/0 (socket says 172.21.15.178:50826) 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a46afb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a4015b3d0 0x7f5a40070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a462fa700 1 -- 172.21.15.178:0/1156716035 learned_addr learned my addr 172.21.15.178:0/1156716035 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a45af9700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a400cd850 0x7f5a401540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a46afb700 1 -- 172.21.15.178:0/1156716035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a400afa50 msgr2=0x7f5a401566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a46afb700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a400afa50 0x7f5a401566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a46afb700 1 -- 172.21.15.178:0/1156716035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a400cd850 msgr2=0x7f5a401540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a46afb700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a400cd850 0x7f5a401540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a46afb700 1 -- 172.21.15.178:0/1156716035 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c009550 con 0x7f5a4015b3d0 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.909+0000 7f5a462fa700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a400afa50 0x7f5a401566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:47:59.914 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.910+0000 7f5a46afb700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a4015b3d0 0x7f5a40070760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5a38016000 tx=0x7f5a38004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.910+0000 7f5a36ffd700 1 -- 172.21.15.178:0/1156716035 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38012430 con 0x7f5a4015b3d0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.910+0000 7f5a36ffd700 1 -- 172.21.15.178:0/1156716035 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38020070 con 0x7f5a4015b3d0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.910+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a38009a70 con 0x7f5a4015b3d0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.910+0000 7f5a36ffd700 1 -- 172.21.15.178:0/1156716035 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380098f0 con 0x7f5a4015b3d0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.910+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a40155190 con 0x7f5a4015b3d0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.910+0000 7f5a36ffd700 1 -- 172.21.15.178:0/1156716035 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f5a380043c0 con 0x7f5a4015b3d0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.910+0000 7f5a36ffd700 1 -- 172.21.15.178:0/1156716035 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5a38022070 con 0x7f5a4015b3d0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.911+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a401f1b20 con 0x7f5a4015b3d0 2023-11-27T17:47:59.915 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:47:59.913+0000 7f5a36ffd700 1 -- 172.21.15.178:0/1156716035 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f5a38045ce0 con 0x7f5a4015b3d0 2023-11-27T17:47:59.924 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:47:59.923+0000 7f866e513200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T17:48:00.008 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.007+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5", "id": 1} v 0) v1 -- 0x7f5a40069400 con 0x7f5a4015b3d0 2023-11-27T17:48:00.013 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.012+0000 7f5a36ffd700 1 -- 172.21.15.178:0/1156716035 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a38034030 con 0x7f5a4015b3d0 2023-11-27T17:48:00.014 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-11-27T17:48:00.015 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.013+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a4015b3d0 msgr2=0x7f5a40070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.015 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.013+0000 7f5a4855e700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a4015b3d0 0x7f5a40070760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5a38016000 tx=0x7f5a38004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.015 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.013+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 shutdown_connections 2023-11-27T17:48:00.015 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.013+0000 7f5a4855e700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a4015b3d0 0x7f5a40070760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.015 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.013+0000 7f5a4855e700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a400afa50 0x7f5a401566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.015 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.013+0000 7f5a4855e700 1 --2- 172.21.15.178:0/1156716035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a400cd850 0x7f5a401540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.015 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.013+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 >> 172.21.15.178:0/1156716035 conn(0x7f5a400b38b0 msgr2=0x7f5a4015c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.016 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.014+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 shutdown_connections 2023-11-27T17:48:00.016 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.014+0000 7f5a4855e700 1 -- 172.21.15.178:0/1156716035 wait complete. 2023-11-27T17:48:00.027 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 422bf301-9e8e-4c96-aa75-883717f49bfd 2 2023-11-27T17:48:00.028 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:00.026+0000 7f3e53c99200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T17:48:00.049 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:00.048+0000 7f866e513200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T17:48:00.116 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:00.115+0000 7f3e53c99200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T17:48:00.148 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.147+0000 7f4228846700 1 Processor -- start 2023-11-27T17:48:00.148 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.147+0000 7f4228846700 1 -- start start 2023-11-27T17:48:00.148 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:00.147+0000 7f866e513200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T17:48:00.151 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4228846700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4224070760 0x7f42240cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.151 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4228846700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f42240afa60 0x7f422413e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.151 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4228846700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42241417d0 con 0x7f4224070b40 2023-11-27T17:48:00.151 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4228846700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4224141ab0 con 0x7f42240afa60 2023-11-27T17:48:00.151 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4228846700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4224141d90 con 0x7f4224070760 2023-11-27T17:48:00.151 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4224070760 0x7f42240cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4222d9d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4224070b40 0x7f422415fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59834/0 (socket says 172.21.15.178:59834) 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4224070760 0x7f42240cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50832/0 (socket says 172.21.15.178:50832) 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4222d9d700 1 -- 172.21.15.178:0/528903329 learned_addr learned my addr 172.21.15.178:0/528903329 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4221d9b700 1 --2- 172.21.15.178:0/528903329 >> v2:172.21.15.177:3300/0 conn(0x7f42240afa60 0x7f422413e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422259c700 1 -- 172.21.15.178:0/528903329 >> v2:172.21.15.177:3300/0 conn(0x7f42240afa60 msgr2=0x7f422413e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422259c700 1 --2- 172.21.15.178:0/528903329 >> v2:172.21.15.177:3300/0 conn(0x7f42240afa60 0x7f422413e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422259c700 1 -- 172.21.15.178:0/528903329 >> v1:172.21.15.178:6789/0 conn(0x7f4224070b40 legacy=0x7f422415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422259c700 1 -- 172.21.15.178:0/528903329 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224142070 con 0x7f4224070760 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422159a700 1 -- 172.21.15.178:0/528903329 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226752956 0 0) 0x7f42241417d0 con 0x7f4224070b40 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f4221d9b700 1 --2- 172.21.15.178:0/528903329 >> v2:172.21.15.177:3300/0 conn(0x7f42240afa60 0x7f422413e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422259c700 1 --2- 172.21.15.178:0/528903329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070760 0x7f42240cdb70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42240735f0 tx=0x7f4214009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5637ef298bc34f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:00.152 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.148+0000 7f422159a700 1 -- 172.21.15.178:0/528903329 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214011830 con 0x7f4224070760 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f422159a700 1 -- 172.21.15.178:0/528903329 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4214011990 con 0x7f4224070760 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f422159a700 1 -- 172.21.15.178:0/528903329 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214011d20 con 0x7f4224070760 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f4228846700 1 -- 172.21.15.178:0/528903329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070760 msgr2=0x7f42240cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f4228846700 1 --2- 172.21.15.178:0/528903329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070760 0x7f42240cdb70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42240735f0 tx=0x7f4214009b20 comp rx=0 tx=0).stop 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f4228846700 1 -- 172.21.15.178:0/528903329 shutdown_connections 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f4228846700 1 --2- 172.21.15.178:0/528903329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070760 0x7f42240cdb70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f4228846700 1 --2- 172.21.15.178:0/528903329 >> v2:172.21.15.177:3300/0 conn(0x7f42240afa60 0x7f422413e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f4228846700 1 -- 172.21.15.178:0/528903329 >> 172.21.15.178:0/528903329 conn(0x7f42240b38b0 msgr2=0x7f42240b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f4228846700 1 -- 172.21.15.178:0/528903329 shutdown_connections 2023-11-27T17:48:00.153 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.149+0000 7f4228846700 1 -- 172.21.15.178:0/528903329 wait complete. 2023-11-27T17:48:00.155 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4228846700 1 Processor -- start 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4228846700 1 -- start start 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4228846700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4224070760 0x7f4224155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4228846700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070b40 0x7f422415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4228846700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42240afa60 0x7f42241590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4228846700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b69d0 con 0x7f4224070760 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4228846700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b5ae0 con 0x7f4224070b40 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4228846700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b5dc0 con 0x7f42240afa60 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4221d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070b40 0x7f422415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4221d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070b40 0x7f422415b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50840/0 (socket says 172.21.15.178:50840) 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4221d9b700 1 -- 172.21.15.178:0/1065584553 learned_addr learned my addr 172.21.15.178:0/1065584553 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:00.156 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.151+0000 7f4222d9d700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42240afa60 0x7f42241590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f422259c700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4224070760 0x7f4224155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4221d9b700 1 -- 172.21.15.178:0/1065584553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42240afa60 msgr2=0x7f42241590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4221d9b700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42240afa60 0x7f42241590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4221d9b700 1 -- 172.21.15.178:0/1065584553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4224070760 msgr2=0x7f4224155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4221d9b700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4224070760 0x7f4224155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4221d9b700 1 -- 172.21.15.178:0/1065584553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42140094a0 con 0x7f4224070b40 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4221d9b700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070b40 0x7f422415b180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f421800e810 tx=0x7f421800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4212ffd700 1 -- 172.21.15.178:0/1065584553 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800c070 con 0x7f4224070b40 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4212ffd700 1 -- 172.21.15.178:0/1065584553 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218004230 con 0x7f4224070b40 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42240b60a0 con 0x7f4224070b40 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4212ffd700 1 -- 172.21.15.178:0/1065584553 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180036a0 con 0x7f4224070b40 2023-11-27T17:48:00.157 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.152+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240b6660 con 0x7f4224070b40 2023-11-27T17:48:00.158 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.153+0000 7f4212ffd700 1 -- 172.21.15.178:0/1065584553 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f4218003800 con 0x7f4224070b40 2023-11-27T17:48:00.158 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.153+0000 7f4212ffd700 1 -- 172.21.15.178:0/1065584553 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f421801c400 con 0x7f4224070b40 2023-11-27T17:48:00.158 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.153+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4224069400 con 0x7f4224070b40 2023-11-27T17:48:00.158 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.155+0000 7f4212ffd700 1 -- 172.21.15.178:0/1065584553 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f421800f040 con 0x7f4224070b40 2023-11-27T17:48:00.197 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:00.196+0000 7f3e53c99200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T17:48:00.232 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:00.231+0000 7f866e513200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T17:48:00.241 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.240+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "422bf301-9e8e-4c96-aa75-883717f49bfd", "id": 2} v 0) v1 -- 0x7f4224155ff0 con 0x7f4224070b40 2023-11-27T17:48:00.246 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.245+0000 7f4212ffd700 1 -- 172.21.15.178:0/1065584553 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "422bf301-9e8e-4c96-aa75-883717f49bfd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4218013410 con 0x7f4224070b40 2023-11-27T17:48:00.246 INFO:teuthology.orchestra.run.smithi178.stdout:2 2023-11-27T17:48:00.247 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070b40 msgr2=0x7f422415b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.247 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070b40 0x7f422415b180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f421800e810 tx=0x7f421800eb20 comp rx=0 tx=0).stop 2023-11-27T17:48:00.248 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 shutdown_connections 2023-11-27T17:48:00.248 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42240afa60 0x7f42241590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.248 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4224070760 0x7f4224155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.248 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 --2- 172.21.15.178:0/1065584553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4224070b40 0x7f422415b180 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.248 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 >> 172.21.15.178:0/1065584553 conn(0x7f42240b38b0 msgr2=0x7f42240724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.248 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 shutdown_connections 2023-11-27T17:48:00.248 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.246+0000 7f4228846700 1 -- 172.21.15.178:0/1065584553 wait complete. 2023-11-27T17:48:00.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new c423d761-307d-4c04-b4b9-8e680d19227f 3 2023-11-27T17:48:00.422 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.420+0000 7f7cb4e22700 1 Processor -- start 2023-11-27T17:48:00.422 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.420+0000 7f7cb4e22700 1 -- start start 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.421+0000 7f7cb4e22700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7cb00cdf60 0x7f7cb00b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.421+0000 7f7cb4e22700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb015b870 con 0x7f7cb015b3d0 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.421+0000 7f7cb4e22700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb015bb50 con 0x7f7cb00afa50 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.421+0000 7f7cb4e22700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb00afe30 con 0x7f7cb00cdf60 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cae59c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f7cb00afa50 0x7f7cb015e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59842/0 (socket says 172.21.15.178:59842) 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cae59c700 1 -- 172.21.15.178:0/2902514114 learned_addr learned my addr 172.21.15.178:0/2902514114 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7caed9d700 1 --2- 172.21.15.178:0/2902514114 >> v2:172.21.15.177:3300/0 conn(0x7f7cb00cdf60 0x7f7cb00b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cad59a700 1 -- 172.21.15.178:0/2902514114 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957981409 0 0) 0x7f7cb015bb50 con 0x7f7cb00afa50 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cad59a700 1 -- 172.21.15.178:0/2902514114 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c980035b0 con 0x7f7cb00afa50 2023-11-27T17:48:00.424 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cad59a700 1 -- 172.21.15.178:0/2902514114 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649769570 0 0) 0x7f7cb015b870 con 0x7f7cb015b3d0 2023-11-27T17:48:00.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cad59a700 1 -- 172.21.15.178:0/2902514114 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb015bb50 con 0x7f7cb015b3d0 2023-11-27T17:48:00.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7caed9d700 1 -- 172.21.15.178:0/2902514114 >> v1:172.21.15.178:6789/0 conn(0x7f7cb00afa50 legacy=0x7f7cb015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7caed9d700 1 -- 172.21.15.178:0/2902514114 >> v1:172.21.15.177:6789/0 conn(0x7f7cb015b3d0 legacy=0x7f7cb00cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7caed9d700 1 -- 172.21.15.178:0/2902514114 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb015be30 con 0x7f7cb00cdf60 2023-11-27T17:48:00.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7caed9d700 1 --2- 172.21.15.178:0/2902514114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb00cdf60 0x7f7cb00b0e80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009d90 tx=0x7f7ca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d52200620425be server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:00.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cad59a700 1 -- 172.21.15.178:0/2902514114 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800bd20 con 0x7f7cb00cdf60 2023-11-27T17:48:00.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cad59a700 1 -- 172.21.15.178:0/2902514114 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800be80 con 0x7f7cb00cdf60 2023-11-27T17:48:00.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.422+0000 7f7cad59a700 1 -- 172.21.15.178:0/2902514114 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca80116a0 con 0x7f7cb00cdf60 2023-11-27T17:48:00.426 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.423+0000 7f7cb4e22700 1 -- 172.21.15.178:0/2902514114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb00cdf60 msgr2=0x7f7cb00b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.426 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.423+0000 7f7cb4e22700 1 --2- 172.21.15.178:0/2902514114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb00cdf60 0x7f7cb00b0e80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009d90 tx=0x7f7ca800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:00.426 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.423+0000 7f7cb4e22700 1 -- 172.21.15.178:0/2902514114 shutdown_connections 2023-11-27T17:48:00.426 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.423+0000 7f7cb4e22700 1 --2- 172.21.15.178:0/2902514114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb00cdf60 0x7f7cb00b0e80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.426 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.423+0000 7f7cb4e22700 1 -- 172.21.15.178:0/2902514114 >> 172.21.15.178:0/2902514114 conn(0x7f7cb00b38b0 msgr2=0x7f7cb00b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.426 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.423+0000 7f7cb4e22700 1 -- 172.21.15.178:0/2902514114 shutdown_connections 2023-11-27T17:48:00.427 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.423+0000 7f7cb4e22700 1 -- 172.21.15.178:0/2902514114 wait complete. 2023-11-27T17:48:00.427 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.425+0000 7f7cb4e22700 1 Processor -- start 2023-11-27T17:48:00.427 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.425+0000 7f7cb4e22700 1 -- start start 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cb4e22700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb00afa50 0x7f7cb006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cb4e22700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cb00cdf60 0x7f7cb01558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cb4e22700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb015b3d0 0x7f7cb013e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cb4e22700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0150e80 con 0x7f7cb015b3d0 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cb4e22700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0156390 con 0x7f7cb00afa50 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cb4e22700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0156670 con 0x7f7cb00cdf60 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb00afa50 0x7f7cb006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cadd9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cb00cdf60 0x7f7cb01558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.429 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb00afa50 0x7f7cb006dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50850/0 (socket says 172.21.15.178:50850) 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cadd9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cb00cdf60 0x7f7cb01558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:47198/0 (socket says 172.21.15.178:47198) 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 -- 172.21.15.178:0/3663879611 learned_addr learned my addr 172.21.15.178:0/3663879611 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7caed9d700 1 --2- 172.21.15.178:0/3663879611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb015b3d0 0x7f7cb013e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 -- 172.21.15.178:0/3663879611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cb00cdf60 msgr2=0x7f7cb01558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 --2- 172.21.15.178:0/3663879611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cb00cdf60 0x7f7cb01558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 -- 172.21.15.178:0/3663879611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb015b3d0 msgr2=0x7f7cb013e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 --2- 172.21.15.178:0/3663879611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb015b3d0 0x7f7cb013e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 -- 172.21.15.178:0/3663879611 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8009a70 con 0x7f7cb00afa50 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.426+0000 7f7cae59c700 1 --2- 172.21.15.178:0/3663879611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb00afa50 0x7f7cb006dd10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c700 tx=0x7f7ca000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.427+0000 7f7c9effd700 1 -- 172.21.15.178:0/3663879611 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0005d70 con 0x7f7cb00afa50 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.427+0000 7f7c9effd700 1 -- 172.21.15.178:0/3663879611 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca00070d0 con 0x7f7cb00afa50 2023-11-27T17:48:00.430 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.427+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb0156950 con 0x7f7cb00afa50 2023-11-27T17:48:00.431 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.427+0000 7f7c9effd700 1 -- 172.21.15.178:0/3663879611 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0007440 con 0x7f7cb00afa50 2023-11-27T17:48:00.431 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.427+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb006e250 con 0x7f7cb00afa50 2023-11-27T17:48:00.431 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.427+0000 7f7c9effd700 1 -- 172.21.15.178:0/3663879611 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f7ca001c440 con 0x7f7cb00afa50 2023-11-27T17:48:00.431 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.427+0000 7f7c9effd700 1 -- 172.21.15.178:0/3663879611 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7ca0012b10 con 0x7f7cb00afa50 2023-11-27T17:48:00.431 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.428+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb0151440 con 0x7f7cb00afa50 2023-11-27T17:48:00.431 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.430+0000 7f7c9effd700 1 -- 172.21.15.178:0/3663879611 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f7ca0021060 con 0x7f7cb00afa50 2023-11-27T17:48:00.515 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.514+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c423d761-307d-4c04-b4b9-8e680d19227f", "id": 3} v 0) v1 -- 0x7f7cb0069400 con 0x7f7cb00afa50 2023-11-27T17:48:00.520 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.519+0000 7f7c9effd700 1 -- 172.21.15.178:0/3663879611 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c423d761-307d-4c04-b4b9-8e680d19227f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ca0017070 con 0x7f7cb00afa50 2023-11-27T17:48:00.521 INFO:teuthology.orchestra.run.smithi178.stdout:3 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb00afa50 msgr2=0x7f7cb006dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 --2- 172.21.15.178:0/3663879611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb00afa50 0x7f7cb006dd10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c700 tx=0x7f7ca000ca10 comp rx=0 tx=0).stop 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 shutdown_connections 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 --2- 172.21.15.178:0/3663879611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb015b3d0 0x7f7cb013e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 --2- 172.21.15.178:0/3663879611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb00afa50 0x7f7cb006dd10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 --2- 172.21.15.178:0/3663879611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cb00cdf60 0x7f7cb01558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 >> 172.21.15.178:0/3663879611 conn(0x7f7cb00b38b0 msgr2=0x7f7cb015db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 shutdown_connections 2023-11-27T17:48:00.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.520+0000 7f7cb4e22700 1 -- 172.21.15.178:0/3663879611 wait complete. 2023-11-27T17:48:00.533 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 602c6293-7ef2-4d15-a841-ba93e6a8e196 4 2023-11-27T17:48:00.636 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:00.635+0000 7f3e53c99200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T17:48:00.653 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.652+0000 7ff5cdea0700 1 Processor -- start 2023-11-27T17:48:00.653 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.652+0000 7ff5cdea0700 1 -- start start 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.652+0000 7ff5cdea0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5c8147930 0x7ff5c8161b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5cdea0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c81624d0 con 0x7ff5c8162070 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5cdea0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c80b0c00 con 0x7ff5c80b07d0 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5cdea0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c80b0e70 con 0x7ff5c8147930 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5c8147930 0x7ff5c8161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c7fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff5c80b07d0 0x7ff5c80cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59858/0 (socket says 172.21.15.178:59858) 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c7fff700 1 -- 172.21.15.178:0/2719010709 learned_addr learned my addr 172.21.15.178:0/2719010709 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c77fe700 1 -- 172.21.15.178:0/2719010709 >> v1:172.21.15.178:6789/0 conn(0x7ff5c80b07d0 legacy=0x7ff5c80cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c77fe700 1 -- 172.21.15.178:0/2719010709 >> v1:172.21.15.177:6789/0 conn(0x7ff5c8162070 legacy=0x7ff5c80b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c77fe700 1 -- 172.21.15.178:0/2719010709 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c80b1150 con 0x7ff5c8147930 2023-11-27T17:48:00.656 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c77fe700 1 --2- 172.21.15.178:0/2719010709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8147930 0x7ff5c8161b30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009840 tx=0x7ff5b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9d4641b66a1ce41 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:00.656 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c67fc700 1 -- 172.21.15.178:0/2719010709 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8011830 con 0x7ff5c8147930 2023-11-27T17:48:00.656 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c67fc700 1 -- 172.21.15.178:0/2719010709 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b8011990 con 0x7ff5c8147930 2023-11-27T17:48:00.656 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.653+0000 7ff5c67fc700 1 -- 172.21.15.178:0/2719010709 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8011d20 con 0x7ff5c8147930 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.654+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2719010709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8147930 msgr2=0x7ff5c8161b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.654+0000 7ff5cdea0700 1 --2- 172.21.15.178:0/2719010709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8147930 0x7ff5c8161b30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009840 tx=0x7ff5b8009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.654+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2719010709 shutdown_connections 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.654+0000 7ff5cdea0700 1 --2- 172.21.15.178:0/2719010709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8147930 0x7ff5c8161b30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.654+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2719010709 >> 172.21.15.178:0/2719010709 conn(0x7ff5c80b3420 msgr2=0x7ff5c80b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.654+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2719010709 shutdown_connections 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.654+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2719010709 wait complete. 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.655+0000 7ff5cdea0700 1 Processor -- start 2023-11-27T17:48:00.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.655+0000 7ff5cdea0700 1 -- start start 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5cdea0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c80b07d0 0x7ff5c815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5cdea0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5c8147930 0x7ff5c81f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5cdea0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8162070 0x7ff5c81f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5cdea0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c815de20 con 0x7ff5c8147930 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5cdea0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81f5970 con 0x7ff5c8162070 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5cdea0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81f5c50 con 0x7ff5c80b07d0 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c80b07d0 0x7ff5c815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8162070 0x7ff5c81f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c80b07d0 0x7ff5c815d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:47208/0 (socket says 172.21.15.178:47208) 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c77fe700 1 -- 172.21.15.178:0/2678376454 learned_addr learned my addr 172.21.15.178:0/2678376454 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c6ffd700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5c8147930 0x7ff5c81f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c77fe700 1 -- 172.21.15.178:0/2678376454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8162070 msgr2=0x7ff5c81f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c77fe700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8162070 0x7ff5c81f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c77fe700 1 -- 172.21.15.178:0/2678376454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5c8147930 msgr2=0x7ff5c81f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c77fe700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5c8147930 0x7ff5c81f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c77fe700 1 -- 172.21.15.178:0/2678376454 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b80094a0 con 0x7ff5c80b07d0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.656+0000 7ff5c7fff700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8162070 0x7ff5c81f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.657+0000 7ff5c77fe700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c80b07d0 0x7ff5c815d8e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80090b0 tx=0x7ff5b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.657+0000 7ff5affff700 1 -- 172.21.15.178:0/2678376454 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80036a0 con 0x7ff5c80b07d0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.657+0000 7ff5affff700 1 -- 172.21.15.178:0/2678376454 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b801f070 con 0x7ff5c80b07d0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.657+0000 7ff5affff700 1 -- 172.21.15.178:0/2678376454 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8003a60 con 0x7ff5c80b07d0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.657+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c81f5f30 con 0x7ff5c80b07d0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.657+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c81f64f0 con 0x7ff5c80b07d0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.657+0000 7ff5affff700 1 -- 172.21.15.178:0/2678376454 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7ff5b8003bc0 con 0x7ff5c80b07d0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.657+0000 7ff5affff700 1 -- 172.21.15.178:0/2678376454 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff5b8021070 con 0x7ff5c80b07d0 2023-11-27T17:48:00.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.658+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c81f6680 con 0x7ff5c80b07d0 2023-11-27T17:48:00.663 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.662+0000 7ff5affff700 1 -- 172.21.15.178:0/2678376454 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7ff5b802b020 con 0x7ff5c80b07d0 2023-11-27T17:48:00.692 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:00.691+0000 7f866e513200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T17:48:00.748 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.747+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "602c6293-7ef2-4d15-a841-ba93e6a8e196", "id": 4} v 0) v1 -- 0x7ff5c8069400 con 0x7ff5c80b07d0 2023-11-27T17:48:00.754 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.753+0000 7ff5affff700 1 -- 172.21.15.178:0/2678376454 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "602c6293-7ef2-4d15-a841-ba93e6a8e196", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff5b8015020 con 0x7ff5c80b07d0 2023-11-27T17:48:00.754 INFO:teuthology.orchestra.run.smithi178.stdout:4 2023-11-27T17:48:00.755 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c80b07d0 msgr2=0x7ff5c815d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.756 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c80b07d0 0x7ff5c815d8e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80090b0 tx=0x7ff5b8004750 comp rx=0 tx=0).stop 2023-11-27T17:48:00.756 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 shutdown_connections 2023-11-27T17:48:00.756 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c8162070 0x7ff5c81f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.756 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c80b07d0 0x7ff5c815d8e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.756 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 --2- 172.21.15.178:0/2678376454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5c8147930 0x7ff5c81f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.756 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 >> 172.21.15.178:0/2678376454 conn(0x7ff5c80b3420 msgr2=0x7ff5c815f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.756 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 shutdown_connections 2023-11-27T17:48:00.757 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.754+0000 7ff5cdea0700 1 -- 172.21.15.178:0/2678376454 wait complete. 2023-11-27T17:48:00.768 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new cfc016da-08c8-4209-ab4f-396e1a384fa5 5 2023-11-27T17:48:00.889 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.887+0000 7fa285ae7700 1 Processor -- start 2023-11-27T17:48:00.889 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.888+0000 7fa285ae7700 1 -- start start 2023-11-27T17:48:00.891 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.888+0000 7fa285ae7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa280146f00 0x7fa280162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.888+0000 7fa285ae7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa2800cdff0 0x7fa2800cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.888+0000 7fa285ae7700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa280162bc0 con 0x7fa2800afc30 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.888+0000 7fa285ae7700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2801472e0 con 0x7fa280146f00 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.888+0000 7fa285ae7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2800b0110 con 0x7fa2800cdff0 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.888+0000 7fa27ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa2800cdff0 0x7fa2800cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa2800cdff0 0x7fa2800cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50870/0 (socket says 172.21.15.178:50870) 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27ffff700 1 -- 172.21.15.178:0/3153414472 learned_addr learned my addr 172.21.15.178:0/3153414472 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27f7fe700 1 --2- 172.21.15.178:0/3153414472 >> v2:172.21.15.177:3300/0 conn(0x7fa280146f00 0x7fa280162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27ffff700 1 -- 172.21.15.178:0/3153414472 >> v2:172.21.15.177:3300/0 conn(0x7fa280146f00 msgr2=0x7fa280162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27ffff700 1 --2- 172.21.15.178:0/3153414472 >> v2:172.21.15.177:3300/0 conn(0x7fa280146f00 0x7fa280162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.892 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27ffff700 1 -- 172.21.15.178:0/3153414472 >> v1:172.21.15.177:6789/0 conn(0x7fa2800afc30 legacy=0x7fa2800cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27ffff700 1 -- 172.21.15.178:0/3153414472 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800b03f0 con 0x7fa2800cdff0 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27ffff700 1 --2- 172.21.15.178:0/3153414472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2800cdff0 0x7fa2800cef50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa28006fa10 tx=0x7fa27800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ba958db676cc272 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27e7fc700 1 -- 172.21.15.178:0/3153414472 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800e070 con 0x7fa2800cdff0 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27e7fc700 1 -- 172.21.15.178:0/3153414472 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800b910 con 0x7fa2800cdff0 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.889+0000 7fa27e7fc700 1 -- 172.21.15.178:0/3153414472 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800bcc0 con 0x7fa2800cdff0 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.890+0000 7fa285ae7700 1 -- 172.21.15.178:0/3153414472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2800cdff0 msgr2=0x7fa2800cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.890+0000 7fa285ae7700 1 --2- 172.21.15.178:0/3153414472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2800cdff0 0x7fa2800cef50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa28006fa10 tx=0x7fa27800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.890+0000 7fa285ae7700 1 -- 172.21.15.178:0/3153414472 shutdown_connections 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.890+0000 7fa285ae7700 1 --2- 172.21.15.178:0/3153414472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2800cdff0 0x7fa2800cef50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.890+0000 7fa285ae7700 1 --2- 172.21.15.178:0/3153414472 >> v2:172.21.15.177:3300/0 conn(0x7fa280146f00 0x7fa280162680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.890+0000 7fa285ae7700 1 -- 172.21.15.178:0/3153414472 >> 172.21.15.178:0/3153414472 conn(0x7fa2800b38b0 msgr2=0x7fa2800b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.890+0000 7fa285ae7700 1 -- 172.21.15.178:0/3153414472 shutdown_connections 2023-11-27T17:48:00.893 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.890+0000 7fa285ae7700 1 -- 172.21.15.178:0/3153414472 wait complete. 2023-11-27T17:48:00.896 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.891+0000 7fa285ae7700 1 Processor -- start 2023-11-27T17:48:00.896 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.891+0000 7fa285ae7700 1 -- start start 2023-11-27T17:48:00.896 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa285ae7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2800afc30 0x7fa2801f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.896 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa285ae7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2800cdff0 0x7fa280145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.896 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa285ae7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa280146f00 0x7fa280071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:00.896 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa285ae7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa280146190 con 0x7fa2800cdff0 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa285ae7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2801457c0 con 0x7fa280146f00 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa285ae7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa280071870 con 0x7fa2800afc30 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2800afc30 0x7fa2801f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2800afc30 0x7fa2801f3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:47218/0 (socket says 172.21.15.178:47218) 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27f7fe700 1 -- 172.21.15.178:0/1184479139 learned_addr learned my addr 172.21.15.178:0/1184479139 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27ffff700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa280146f00 0x7fa280071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27effd700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2800cdff0 0x7fa280145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27f7fe700 1 -- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa280146f00 msgr2=0x7fa280071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27f7fe700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa280146f00 0x7fa280071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27f7fe700 1 -- 172.21.15.178:0/1184479139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2800cdff0 msgr2=0x7fa280145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27f7fe700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2800cdff0 0x7fa280145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.897 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27f7fe700 1 -- 172.21.15.178:0/1184479139 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278009b30 con 0x7fa2800afc30 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27ffff700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa280146f00 0x7fa280071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.892+0000 7fa27effd700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2800cdff0 0x7fa280145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.893+0000 7fa27f7fe700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2800afc30 0x7fa2801f3430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa27000e9b0 tx=0x7fa27000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.893+0000 7fa267fff700 1 -- 172.21.15.178:0/1184479139 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270009710 con 0x7fa2800afc30 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.893+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa280144bb0 con 0x7fa2800afc30 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.893+0000 7fa267fff700 1 -- 172.21.15.178:0/1184479139 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000ee50 con 0x7fa2800afc30 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.893+0000 7fa267fff700 1 -- 172.21.15.178:0/1184479139 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000ca50 con 0x7fa2800afc30 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.893+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa280145170 con 0x7fa2800afc30 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.893+0000 7fa267fff700 1 -- 172.21.15.178:0/1184479139 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa27000cbb0 con 0x7fa2800afc30 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.893+0000 7fa267fff700 1 -- 172.21.15.178:0/1184479139 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa2700067a0 con 0x7fa2800afc30 2023-11-27T17:48:00.898 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.894+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa280147c00 con 0x7fa2800afc30 2023-11-27T17:48:00.899 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.896+0000 7fa267fff700 1 -- 172.21.15.178:0/1184479139 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fa280147c00 con 0x7fa2800afc30 2023-11-27T17:48:00.983 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.982+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cfc016da-08c8-4209-ab4f-396e1a384fa5", "id": 5} v 0) v1 -- 0x7fa2800ae9b0 con 0x7fa2800afc30 2023-11-27T17:48:00.988 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.987+0000 7fa267fff700 1 -- 172.21.15.178:0/1184479139 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfc016da-08c8-4209-ab4f-396e1a384fa5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa270021060 con 0x7fa2800afc30 2023-11-27T17:48:00.989 INFO:teuthology.orchestra.run.smithi178.stdout:5 2023-11-27T17:48:00.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.988+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2800afc30 msgr2=0x7fa2801f3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:00.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.988+0000 7fa285ae7700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2800afc30 0x7fa2801f3430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa27000e9b0 tx=0x7fa27000ecc0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.988+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 shutdown_connections 2023-11-27T17:48:00.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.988+0000 7fa285ae7700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa280146f00 0x7fa280071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.988+0000 7fa285ae7700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2800afc30 0x7fa2801f3430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.988+0000 7fa285ae7700 1 --2- 172.21.15.178:0/1184479139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2800cdff0 0x7fa280145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:00.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.988+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 >> 172.21.15.178:0/1184479139 conn(0x7fa2800b38b0 msgr2=0x7fa2800b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:00.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.988+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 shutdown_connections 2023-11-27T17:48:00.991 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:00.989+0000 7fa285ae7700 1 -- 172.21.15.178:0/1184479139 wait complete. 2023-11-27T17:48:01.002 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 5f7bd22b-4c20-4682-a058-da8785268f9b 6 2023-11-27T17:48:01.163 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.162+0000 7fd6436ab700 1 Processor -- start 2023-11-27T17:48:01.164 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.162+0000 7fd6436ab700 1 -- start start 2023-11-27T17:48:01.165 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd6436ab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c06c260 0x7fd63c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.165 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd6436ab700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd63c161bc0 0x7fd63c162050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.165 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd6436ab700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c15fea0 con 0x7fd63c1585b0 2023-11-27T17:48:01.165 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd6436ab700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0b7af0 con 0x7fd63c161bc0 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd6436ab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c162590 con 0x7fd63c06c260 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd640c46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c06c260 0x7fd63c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd641c48700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd63c161bc0 0x7fd63c162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd641c48700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd63c161bc0 0x7fd63c162050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50882/0 (socket says 172.21.15.178:50882) 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd640c46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c06c260 0x7fd63c06c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:47226/0 (socket says 172.21.15.178:47226) 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd641c48700 1 -- 172.21.15.178:0/2369403677 learned_addr learned my addr 172.21.15.178:0/2369403677 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.163+0000 7fd641c48700 1 -- 172.21.15.178:0/2369403677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c06c260 msgr2=0x7fd63c06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd641c48700 1 --2- 172.21.15.178:0/2369403677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c06c260 0x7fd63c06c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd641c48700 1 -- 172.21.15.178:0/2369403677 >> v1:172.21.15.177:6789/0 conn(0x7fd63c1585b0 legacy=0x7fd63c15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd641c48700 1 -- 172.21.15.178:0/2369403677 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c0b5370 con 0x7fd63c161bc0 2023-11-27T17:48:01.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd641c48700 1 --2- 172.21.15.178:0/2369403677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c162050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd634009e50 tx=0x7fd63400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=157fb4b89064fe89 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:01.167 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd633fff700 1 -- 172.21.15.178:0/2369403677 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63400e070 con 0x7fd63c161bc0 2023-11-27T17:48:01.167 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd633fff700 1 -- 172.21.15.178:0/2369403677 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63400b910 con 0x7fd63c161bc0 2023-11-27T17:48:01.167 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd633fff700 1 -- 172.21.15.178:0/2369403677 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63400bcc0 con 0x7fd63c161bc0 2023-11-27T17:48:01.169 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd6436ab700 1 -- 172.21.15.178:0/2369403677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 msgr2=0x7fd63c162050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd6436ab700 1 --2- 172.21.15.178:0/2369403677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c162050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd634009e50 tx=0x7fd63400b330 comp rx=0 tx=0).stop 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd6436ab700 1 -- 172.21.15.178:0/2369403677 shutdown_connections 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd6436ab700 1 --2- 172.21.15.178:0/2369403677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c162050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd6436ab700 1 --2- 172.21.15.178:0/2369403677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c06c260 0x7fd63c06c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.164+0000 7fd6436ab700 1 -- 172.21.15.178:0/2369403677 >> 172.21.15.178:0/2369403677 conn(0x7fd63c0b31d0 msgr2=0x7fd63c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.165+0000 7fd6436ab700 1 -- 172.21.15.178:0/2369403677 shutdown_connections 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.165+0000 7fd6436ab700 1 -- 172.21.15.178:0/2369403677 wait complete. 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.166+0000 7fd6436ab700 1 Processor -- start 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.166+0000 7fd6436ab700 1 -- start start 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.166+0000 7fd6436ab700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd63c06c260 0x7fd63c14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.166+0000 7fd6436ab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c1585b0 0x7fd63c155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.170 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.166+0000 7fd6436ab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.166+0000 7fd6436ab700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0cc7d0 con 0x7fd63c06c260 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.166+0000 7fd6436ab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0cb920 con 0x7fd63c161bc0 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.166+0000 7fd6436ab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0cbb50 con 0x7fd63c1585b0 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c1585b0 0x7fd63c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd641c48700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c1585b0 0x7fd63c155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:47232/0 (socket says 172.21.15.178:47232) 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd641c48700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c0cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50888/0 (socket says 172.21.15.178:50888) 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 -- 172.21.15.178:0/2654396109 learned_addr learned my addr 172.21.15.178:0/2654396109 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd641447700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd63c06c260 0x7fd63c14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 -- 172.21.15.178:0/2654396109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 msgr2=0x7fd63c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 -- 172.21.15.178:0/2654396109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd63c06c260 msgr2=0x7fd63c14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd63c06c260 0x7fd63c14fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 -- 172.21.15.178:0/2654396109 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634009b30 con 0x7fd63c1585b0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd641c48700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd640c46700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c1585b0 0x7fd63c155550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00e9b0 tx=0x7fd62c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd631ffb700 1 -- 172.21.15.178:0/2654396109 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c009710 con 0x7fd63c1585b0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd631ffb700 1 -- 172.21.15.178:0/2654396109 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00ee50 con 0x7fd63c1585b0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c0cbe30 con 0x7fd63c1585b0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd631ffb700 1 -- 172.21.15.178:0/2654396109 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00ca50 con 0x7fd63c1585b0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.167+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c0cc3f0 con 0x7fd63c1585b0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.168+0000 7fd631ffb700 1 -- 172.21.15.178:0/2654396109 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fd62c00cbb0 con 0x7fd63c1585b0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.168+0000 7fd631ffb700 1 -- 172.21.15.178:0/2654396109 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd62c006750 con 0x7fd63c1585b0 2023-11-27T17:48:01.172 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.168+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c069400 con 0x7fd63c1585b0 2023-11-27T17:48:01.173 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.170+0000 7fd631ffb700 1 -- 172.21.15.178:0/2654396109 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fd62c021060 con 0x7fd63c1585b0 2023-11-27T17:48:01.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.255+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f7bd22b-4c20-4682-a058-da8785268f9b", "id": 6} v 0) v1 -- 0x7fd63c161730 con 0x7fd63c1585b0 2023-11-27T17:48:01.261 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.260+0000 7fd631ffb700 1 -- 172.21.15.178:0/2654396109 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f7bd22b-4c20-4682-a058-da8785268f9b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd62c017070 con 0x7fd63c1585b0 2023-11-27T17:48:01.262 INFO:teuthology.orchestra.run.smithi178.stdout:6 2023-11-27T17:48:01.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.261+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c1585b0 msgr2=0x7fd63c155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.261+0000 7fd6436ab700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c1585b0 0x7fd63c155550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00e9b0 tx=0x7fd62c00ecc0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.261+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 shutdown_connections 2023-11-27T17:48:01.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.261+0000 7fd6436ab700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c161bc0 0x7fd63c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.261+0000 7fd6436ab700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd63c06c260 0x7fd63c14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.261+0000 7fd6436ab700 1 --2- 172.21.15.178:0/2654396109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c1585b0 0x7fd63c155550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.261+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 >> 172.21.15.178:0/2654396109 conn(0x7fd63c0b31d0 msgr2=0x7fd63c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:01.264 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.262+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 shutdown_connections 2023-11-27T17:48:01.264 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.262+0000 7fd6436ab700 1 -- 172.21.15.178:0/2654396109 wait complete. 2023-11-27T17:48:01.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 072497cd-3a04-487a-830a-37477a7fdc6c 7 2023-11-27T17:48:01.281 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:01.280+0000 7f3e53c99200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-27T17:48:01.349 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:01.348+0000 7f3e53c99200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T17:48:01.364 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:01.362+0000 7f866e513200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-27T17:48:01.397 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.395+0000 7f7e5bf82700 1 Processor -- start 2023-11-27T17:48:01.398 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.395+0000 7f7e5bf82700 1 -- start start 2023-11-27T17:48:01.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.396+0000 7f7e5bf82700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e5415cfb0 0x7f7e540d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.396+0000 7f7e5bf82700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5415d440 con 0x7f7e54072750 2023-11-27T17:48:01.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.396+0000 7f7e5bf82700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540d1300 con 0x7f7e541599a0 2023-11-27T17:48:01.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.396+0000 7f7e5bf82700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e540d15e0 con 0x7f7e5415cfb0 2023-11-27T17:48:01.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.396+0000 7f7e5951d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e5415cfb0 0x7f7e540d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.396+0000 7f7e5951d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e5415cfb0 0x7f7e540d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50892/0 (socket says 172.21.15.178:50892) 2023-11-27T17:48:01.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.396+0000 7f7e5951d700 1 -- 172.21.15.178:0/451235834 learned_addr learned my addr 172.21.15.178:0/451235834 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:01.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.396+0000 7f7e59d1e700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f7e541599a0 0x7f7e540b56e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59888/0 (socket says 172.21.15.178:59888) 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.397+0000 7f7e5951d700 1 -- 172.21.15.178:0/451235834 >> v1:172.21.15.178:6789/0 conn(0x7f7e541599a0 legacy=0x7f7e540b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.397+0000 7f7e5951d700 1 -- 172.21.15.178:0/451235834 >> v1:172.21.15.177:6789/0 conn(0x7f7e54072750 legacy=0x7f7e54072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.397+0000 7f7e5951d700 1 -- 172.21.15.178:0/451235834 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540d18c0 con 0x7f7e5415cfb0 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.397+0000 7f7e5951d700 1 --2- 172.21.15.178:0/451235834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e5415cfb0 0x7f7e540d0ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7e440098f0 tx=0x7f7e44009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f97528cb0fc763a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.397+0000 7f7e58d1c700 1 -- 172.21.15.178:0/451235834 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4400b8a0 con 0x7f7e5415cfb0 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.397+0000 7f7e58d1c700 1 -- 172.21.15.178:0/451235834 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4400ba00 con 0x7f7e5415cfb0 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.397+0000 7f7e58d1c700 1 -- 172.21.15.178:0/451235834 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4400bd90 con 0x7f7e5415cfb0 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.398+0000 7f7e5bf82700 1 -- 172.21.15.178:0/451235834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e5415cfb0 msgr2=0x7f7e540d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.398+0000 7f7e5bf82700 1 --2- 172.21.15.178:0/451235834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e5415cfb0 0x7f7e540d0ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7e440098f0 tx=0x7f7e44009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.398+0000 7f7e5bf82700 1 -- 172.21.15.178:0/451235834 shutdown_connections 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.398+0000 7f7e5bf82700 1 --2- 172.21.15.178:0/451235834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e5415cfb0 0x7f7e540d0ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.398+0000 7f7e5bf82700 1 -- 172.21.15.178:0/451235834 >> 172.21.15.178:0/451235834 conn(0x7f7e54066e20 msgr2=0x7f7e54067230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:01.402 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.398+0000 7f7e5bf82700 1 -- 172.21.15.178:0/451235834 shutdown_connections 2023-11-27T17:48:01.402 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.398+0000 7f7e5bf82700 1 -- 172.21.15.178:0/451235834 wait complete. 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.399+0000 7f7e5bf82700 1 Processor -- start 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.399+0000 7f7e5bf82700 1 -- start start 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5bf82700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e54072750 0x7f7e541509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5bf82700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e541599a0 0x7f7e5406b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5bf82700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e5415cfb0 0x7f7e5406b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5bf82700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540b0560 con 0x7f7e541599a0 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5bf82700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54150ee0 con 0x7f7e54072750 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5bf82700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5406bc40 con 0x7f7e5415cfb0 2023-11-27T17:48:01.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e54072750 0x7f7e541509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5a51f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e5415cfb0 0x7f7e5406b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e54072750 0x7f7e541509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:50896/0 (socket says 172.21.15.178:50896) 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5951d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e541599a0 0x7f7e5406b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 -- 172.21.15.178:0/1365846217 learned_addr learned my addr 172.21.15.178:0/1365846217 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5a51f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e5415cfb0 0x7f7e5406b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:47246/0 (socket says 172.21.15.178:47246) 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 -- 172.21.15.178:0/1365846217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e5415cfb0 msgr2=0x7f7e5406b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 --2- 172.21.15.178:0/1365846217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e5415cfb0 0x7f7e5406b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 -- 172.21.15.178:0/1365846217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e541599a0 msgr2=0x7f7e5406b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 --2- 172.21.15.178:0/1365846217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e541599a0 0x7f7e5406b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 -- 172.21.15.178:0/1365846217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e44009550 con 0x7f7e54072750 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5a51f700 1 --2- 172.21.15.178:0/1365846217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e5415cfb0 0x7f7e5406b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:01.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e59d1e700 1 --2- 172.21.15.178:0/1365846217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e54072750 0x7f7e541509a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000c520 tx=0x7f7e5000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:01.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e4a7fc700 1 -- 172.21.15.178:0/1365846217 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50005cb0 con 0x7f7e54072750 2023-11-27T17:48:01.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e4a7fc700 1 -- 172.21.15.178:0/1365846217 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e50005e10 con 0x7f7e54072750 2023-11-27T17:48:01.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5406bf20 con 0x7f7e54072750 2023-11-27T17:48:01.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.400+0000 7f7e4a7fc700 1 -- 172.21.15.178:0/1365846217 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500072d0 con 0x7f7e54072750 2023-11-27T17:48:01.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.401+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5406c4e0 con 0x7f7e54072750 2023-11-27T17:48:01.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.401+0000 7f7e4a7fc700 1 -- 172.21.15.178:0/1365846217 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f7e5001c440 con 0x7f7e54072750 2023-11-27T17:48:01.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.401+0000 7f7e4a7fc700 1 -- 172.21.15.178:0/1365846217 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7e50012c90 con 0x7f7e54072750 2023-11-27T17:48:01.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.402+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5406cb30 con 0x7f7e54072750 2023-11-27T17:48:01.407 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.404+0000 7f7e4a7fc700 1 -- 172.21.15.178:0/1365846217 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f7e50021060 con 0x7f7e54072750 2023-11-27T17:48:01.436 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:01.434+0000 7f866e513200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T17:48:01.491 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.489+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "072497cd-3a04-487a-830a-37477a7fdc6c", "id": 7} v 0) v1 -- 0x7f7e54073aa0 con 0x7f7e54072750 2023-11-27T17:48:01.496 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.494+0000 7f7e4a7fc700 1 -- 172.21.15.178:0/1365846217 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "072497cd-3a04-487a-830a-37477a7fdc6c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e50017070 con 0x7f7e54072750 2023-11-27T17:48:01.496 INFO:teuthology.orchestra.run.smithi178.stdout:7 2023-11-27T17:48:01.497 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e54072750 msgr2=0x7f7e541509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.497 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 --2- 172.21.15.178:0/1365846217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e54072750 0x7f7e541509a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000c520 tx=0x7f7e5000c830 comp rx=0 tx=0).stop 2023-11-27T17:48:01.497 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 shutdown_connections 2023-11-27T17:48:01.497 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 --2- 172.21.15.178:0/1365846217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e5415cfb0 0x7f7e5406b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.498 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 --2- 172.21.15.178:0/1365846217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e54072750 0x7f7e541509a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.498 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 --2- 172.21.15.178:0/1365846217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e541599a0 0x7f7e5406b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.498 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 >> 172.21.15.178:0/1365846217 conn(0x7f7e54066e20 msgr2=0x7f7e540b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:01.498 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 shutdown_connections 2023-11-27T17:48:01.498 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-27T17:48:01.495+0000 7f7e5bf82700 1 -- 172.21.15.178:0/1365846217 wait complete. 2023-11-27T17:48:01.509 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-27T17:48:01.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-27T17:48:01.511 INFO:tasks.ceph.osd.0:Started 2023-11-27T17:48:01.511 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-27T17:48:01.511 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-27T17:48:01.513 INFO:tasks.ceph.osd.1:Started 2023-11-27T17:48:01.513 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-27T17:48:01.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-27T17:48:01.515 INFO:tasks.ceph.osd.2:Started 2023-11-27T17:48:01.516 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-27T17:48:01.516 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-27T17:48:01.518 INFO:tasks.ceph.osd.3:Started 2023-11-27T17:48:01.518 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-27T17:48:01.518 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-27T17:48:01.520 INFO:tasks.ceph.osd.4:Started 2023-11-27T17:48:01.520 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-27T17:48:01.521 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-27T17:48:01.522 INFO:tasks.ceph.osd.5:Started 2023-11-27T17:48:01.522 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-27T17:48:01.523 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-27T17:48:01.524 INFO:tasks.ceph.osd.6:Started 2023-11-27T17:48:01.525 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-27T17:48:01.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-27T17:48:01.527 INFO:tasks.ceph.osd.7:Started 2023-11-27T17:48:01.527 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:01.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.674+0000 7f116dddf700 1 Processor -- start 2023-11-27T17:48:01.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.674+0000 7f116dddf700 1 -- start start 2023-11-27T17:48:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f116dddf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11680cf3c0 0x7f11680b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f116dddf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680b2690 0x7f116815fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f116dddf700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1168160180 0x7f1168144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f116dddf700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11681609e0 con 0x7f1168160180 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f116dddf700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11680b2af0 con 0x7f11680cf3c0 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f116dddf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11680d0f40 con 0x7f11680b2690 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f1167fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1168160180 0x7f1168144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f1167fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1168160180 0x7f1168144fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50812/0 (socket says 172.21.15.177:50812) 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f1167fff700 1 -- 172.21.15.177:0/3678882038 learned_addr learned my addr 172.21.15.177:0/3678882038 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f11677fe700 1 --2- 172.21.15.177:0/3678882038 >> v2:172.21.15.178:3300/0 conn(0x7f11680cf3c0 0x7f11680b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.675+0000 7f1166ffd700 1 --2- 172.21.15.177:0/3678882038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680b2690 0x7f116815fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f1167fff700 1 -- 172.21.15.177:0/3678882038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680b2690 msgr2=0x7f116815fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f1167fff700 1 --2- 172.21.15.177:0/3678882038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680b2690 0x7f116815fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f1167fff700 1 -- 172.21.15.177:0/3678882038 >> v2:172.21.15.178:3300/0 conn(0x7f11680cf3c0 msgr2=0x7f11680b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f1167fff700 1 --2- 172.21.15.177:0/3678882038 >> v2:172.21.15.178:3300/0 conn(0x7f11680cf3c0 0x7f11680b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f1167fff700 1 -- 172.21.15.177:0/3678882038 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680d1220 con 0x7f1168160180 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f1167fff700 1 --2- 172.21.15.177:0/3678882038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f1168144fe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f11680b8320 tx=0x7f116000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b776d780d8c77b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f11667fc700 1 -- 172.21.15.177:0/3678882038 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000e070 con 0x7f1168160180 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f11667fc700 1 -- 172.21.15.177:0/3678882038 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000b910 con 0x7f1168160180 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.676+0000 7f11667fc700 1 -- 172.21.15.177:0/3678882038 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000bcc0 con 0x7f1168160180 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 -- 172.21.15.177:0/3678882038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 msgr2=0x7f1168144fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 --2- 172.21.15.177:0/3678882038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f1168144fe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f11680b8320 tx=0x7f116000b330 comp rx=0 tx=0).stop 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 -- 172.21.15.177:0/3678882038 shutdown_connections 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 --2- 172.21.15.177:0/3678882038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f1168144fe0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 --2- 172.21.15.177:0/3678882038 >> v2:172.21.15.178:3300/0 conn(0x7f11680cf3c0 0x7f11680b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 --2- 172.21.15.177:0/3678882038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680b2690 0x7f116815fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 -- 172.21.15.177:0/3678882038 >> 172.21.15.177:0/3678882038 conn(0x7f1168072190 msgr2=0x7f11680725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:01.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 -- 172.21.15.177:0/3678882038 shutdown_connections 2023-11-27T17:48:01.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.677+0000 7f116dddf700 1 -- 172.21.15.177:0/3678882038 wait complete. 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.678+0000 7f116dddf700 1 Processor -- start 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.678+0000 7f116dddf700 1 -- start start 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f116dddf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11680b2690 0x7f116815c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f116dddf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680cf3c0 0x7f116814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f116dddf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f11681551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f116dddf700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116815cf10 con 0x7f1168160180 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f116dddf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116814fee0 con 0x7f11680b2690 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f116dddf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116814f460 con 0x7f11680cf3c0 2023-11-27T17:48:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f11681551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f11681551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50818/0 (socket says 172.21.15.177:50818) 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 -- 172.21.15.177:0/2949986501 learned_addr learned my addr 172.21.15.177:0/2949986501 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1166ffd700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680cf3c0 0x7f116814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f11677fe700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11680b2690 0x7f116815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 -- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680cf3c0 msgr2=0x7f116814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680cf3c0 0x7f116814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 -- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11680b2690 msgr2=0x7f116815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11680b2690 0x7f116815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 -- 172.21.15.177:0/2949986501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1160009b30 con 0x7f1168160180 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1166ffd700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680cf3c0 0x7f116814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f1167fff700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f11681551c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11680690f0 tx=0x7f1160004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f114ffff700 1 -- 172.21.15.177:0/2949986501 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600099b0 con 0x7f1168160180 2023-11-27T17:48:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.679+0000 7f114ffff700 1 -- 172.21.15.177:0/2949986501 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000ce80 con 0x7f1168160180 2023-11-27T17:48:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.680+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1168154400 con 0x7f1168160180 2023-11-27T17:48:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.680+0000 7f114ffff700 1 -- 172.21.15.177:0/2949986501 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160004490 con 0x7f1168160180 2023-11-27T17:48:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.680+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11681549c0 con 0x7f1168160180 2023-11-27T17:48:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.680+0000 7f114ffff700 1 -- 172.21.15.177:0/2949986501 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f11600045f0 con 0x7f1168160180 2023-11-27T17:48:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.680+0000 7f114ffff700 1 -- 172.21.15.177:0/2949986501 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1160024ae0 con 0x7f1168160180 2023-11-27T17:48:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.681+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1168073aa0 con 0x7f1168160180 2023-11-27T17:48:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.683+0000 7f114ffff700 1 -- 172.21.15.177:0/2949986501 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f1160029060 con 0x7f1168160180 2023-11-27T17:48:01.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.753+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f116815fd20 con 0x7f1168160180 2023-11-27T17:48:01.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.753+0000 7f114ffff700 1 -- 172.21.15.177:0/2949986501 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f116001f030 con 0x7f1168160180 2023-11-27T17:48:01.755 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:01.755 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":10,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:01.491141+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.754+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 msgr2=0x7f11681551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.754+0000 7f116dddf700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f11681551c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11680690f0 tx=0x7f1160004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.754+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 shutdown_connections 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.754+0000 7f116dddf700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1168160180 0x7f11681551c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.754+0000 7f116dddf700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11680b2690 0x7f116815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.754+0000 7f116dddf700 1 --2- 172.21.15.177:0/2949986501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11680cf3c0 0x7f116814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.754+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 >> 172.21.15.177:0/2949986501 conn(0x7f1168072190 msgr2=0x7f116815f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.754+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 shutdown_connections 2023-11-27T17:48:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:01.755+0000 7f116dddf700 1 -- 172.21.15.177:0/2949986501 wait complete. 2023-11-27T17:48:01.768 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-27T17:48:01.768 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-27T17:48:01.895 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T17:48:01.893+0000 7f296d708640 -1 Falling back to public interface 2023-11-27T17:48:02.093 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:02.091+0000 7f3e53c99200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T17:48:02.124 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T17:48:02.122+0000 7f1658b7e640 -1 Falling back to public interface 2023-11-27T17:48:02.128 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T17:48:02.127+0000 7f8f19ae2640 -1 Falling back to public interface 2023-11-27T17:48:02.129 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T17:48:02.127+0000 7f61cdf3b640 -1 Falling back to public interface 2023-11-27T17:48:02.142 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T17:48:02.140+0000 7efc60e29640 -1 Falling back to public interface 2023-11-27T17:48:02.146 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T17:48:02.145+0000 7efc4a2cd640 -1 Falling back to public interface 2023-11-27T17:48:02.152 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T17:48:02.150+0000 7f5fce3e4640 -1 Falling back to public interface 2023-11-27T17:48:02.153 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T17:48:02.152+0000 7f28e3c16640 -1 Falling back to public interface 2023-11-27T17:48:02.170 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:02.168+0000 7f866e513200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T17:48:02.173 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:02.172+0000 7f3e53c99200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T17:48:02.247 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:02.245+0000 7f866e513200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T17:48:02.314 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:02.313+0000 7f3e53c99200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T17:48:02.388 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:02.386+0000 7f866e513200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T17:48:02.551 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:02.550+0000 7f3e53c99200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-27T17:48:02.573 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:02.625 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:02.623+0000 7f866e513200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-27T17:48:02.690 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.687+0000 7f6895cc3700 1 Processor -- start 2023-11-27T17:48:02.690 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.688+0000 7f6895cc3700 1 -- start start 2023-11-27T17:48:02.692 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6895cc3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f689015b070 0x7f689006b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:02.692 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6895cc3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f68900b2890 0x7f68900ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:02.692 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6895cc3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6890072f70 con 0x7f68900b1090 2023-11-27T17:48:02.692 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6895cc3700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689006baa0 con 0x7f68900b2890 2023-11-27T17:48:02.692 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6895cc3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900cffe0 con 0x7f689015b070 2023-11-27T17:48:02.692 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6886ffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f68900b2890 0x7f68900ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:02.692 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6886ffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f68900b2890 0x7f68900ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50822/0 (socket says 172.21.15.177:50822) 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6886ffd700 1 -- 172.21.15.177:0/2471642569 learned_addr learned my addr 172.21.15.177:0/2471642569 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f688f7fe700 1 --2- 172.21.15.177:0/2471642569 >> v2:172.21.15.178:3300/0 conn(0x7f689015b070 0x7f689006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6886ffd700 1 -- 172.21.15.177:0/2471642569 >> v2:172.21.15.178:3300/0 conn(0x7f689015b070 msgr2=0x7f689006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6886ffd700 1 --2- 172.21.15.177:0/2471642569 >> v2:172.21.15.178:3300/0 conn(0x7f689015b070 0x7f689006b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6886ffd700 1 -- 172.21.15.177:0/2471642569 >> v1:172.21.15.178:6789/0 conn(0x7f68900b1090 legacy=0x7f68900b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6886ffd700 1 -- 172.21.15.177:0/2471642569 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900731c0 con 0x7f68900b2890 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f6886ffd700 1 --2- 172.21.15.177:0/2471642569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68900b2890 0x7f68900ce0a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f689006f6a0 tx=0x7f6878009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8e78e7950dc64f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f688effd700 1 -- 172.21.15.177:0/2471642569 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878011830 con 0x7f68900b2890 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f688effd700 1 -- 172.21.15.177:0/2471642569 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878011990 con 0x7f68900b2890 2023-11-27T17:48:02.693 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.689+0000 7f688effd700 1 -- 172.21.15.177:0/2471642569 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878011d20 con 0x7f68900b2890 2023-11-27T17:48:02.696 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.690+0000 7f6895cc3700 1 -- 172.21.15.177:0/2471642569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68900b2890 msgr2=0x7f68900ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:02.696 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.690+0000 7f6895cc3700 1 --2- 172.21.15.177:0/2471642569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68900b2890 0x7f68900ce0a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f689006f6a0 tx=0x7f6878009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.696 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.690+0000 7f6895cc3700 1 -- 172.21.15.177:0/2471642569 shutdown_connections 2023-11-27T17:48:02.696 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.690+0000 7f6895cc3700 1 --2- 172.21.15.177:0/2471642569 >> v2:172.21.15.178:3300/0 conn(0x7f689015b070 0x7f689006b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.696 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.690+0000 7f6895cc3700 1 --2- 172.21.15.177:0/2471642569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68900b2890 0x7f68900ce0a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.696 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.690+0000 7f6895cc3700 1 -- 172.21.15.177:0/2471642569 >> 172.21.15.177:0/2471642569 conn(0x7f68900b1d70 msgr2=0x7f68900b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:02.696 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.690+0000 7f6895cc3700 1 -- 172.21.15.177:0/2471642569 shutdown_connections 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.690+0000 7f6895cc3700 1 -- 172.21.15.177:0/2471642569 wait complete. 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.691+0000 7f6895cc3700 1 Processor -- start 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.692+0000 7f6895cc3700 1 -- start start 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.692+0000 7f6895cc3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68900b1090 0x7f6890099610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.692+0000 7f6895cc3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68900b2890 0x7f68900c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.692+0000 7f6895cc3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f689015b070 0x7f6890166df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.692+0000 7f6895cc3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890166c10 con 0x7f689015b070 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.692+0000 7f6895cc3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689006dbe0 con 0x7f68900b2890 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.692+0000 7f6895cc3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6890165d40 con 0x7f68900b1090 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f689015b070 0x7f6890166df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f689015b070 0x7f6890166df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50830/0 (socket says 172.21.15.177:50830) 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 -- 172.21.15.177:0/2553345178 learned_addr learned my addr 172.21.15.177:0/2553345178 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:02.697 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688f7fe700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68900b1090 0x7f6890099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f6886ffd700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68900b2890 0x7f68900c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 -- 172.21.15.177:0/2553345178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68900b1090 msgr2=0x7f6890099610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68900b1090 0x7f6890099610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 -- 172.21.15.177:0/2553345178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68900b2890 msgr2=0x7f68900c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68900b2890 0x7f68900c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 -- 172.21.15.177:0/2553345178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878009550 con 0x7f689015b070 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688ffff700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f689015b070 0x7f6890166df0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f688800cb80 tx=0x7f688800ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688cff9700 1 -- 172.21.15.177:0/2553345178 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888003c00 con 0x7f689015b070 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688cff9700 1 -- 172.21.15.177:0/2553345178 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888003d60 con 0x7f689015b070 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68900c5020 con 0x7f689015b070 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f688cff9700 1 -- 172.21.15.177:0/2553345178 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800aaa0 con 0x7f689015b070 2023-11-27T17:48:02.698 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.693+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6890166270 con 0x7f689015b070 2023-11-27T17:48:02.699 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.694+0000 7f688cff9700 1 -- 172.21.15.177:0/2553345178 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f68880050d0 con 0x7f689015b070 2023-11-27T17:48:02.699 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.694+0000 7f688cff9700 1 -- 172.21.15.177:0/2553345178 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f688801b400 con 0x7f689015b070 2023-11-27T17:48:02.699 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.694+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689009e3d0 con 0x7f689015b070 2023-11-27T17:48:02.699 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.696+0000 7f688cff9700 1 -- 172.21.15.177:0/2553345178 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f6888012420 con 0x7f689015b070 2023-11-27T17:48:02.770 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.768+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6890068030 con 0x7f689015b070 2023-11-27T17:48:02.771 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.769+0000 7f688cff9700 1 -- 172.21.15.177:0/2553345178 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f6888005560 con 0x7f689015b070 2023-11-27T17:48:02.772 INFO:teuthology.misc.health.smithi177.stdout: 2023-11-27T17:48:02.772 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":10,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:01.491141+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:02.772 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f3e53c99200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T17:48:02.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f689015b070 msgr2=0x7f6890166df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:02.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f689015b070 0x7f6890166df0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f688800cb80 tx=0x7f688800ce90 comp rx=0 tx=0).stop 2023-11-27T17:48:02.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 shutdown_connections 2023-11-27T17:48:02.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f689015b070 0x7f6890166df0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68900b1090 0x7f6890099610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.773 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 --2- 172.21.15.177:0/2553345178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68900b2890 0x7f68900c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:02.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 >> 172.21.15.177:0/2553345178 conn(0x7f68900b1d70 msgr2=0x7f689006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:02.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 shutdown_connections 2023-11-27T17:48:02.774 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:02.770+0000 7f6895cc3700 1 -- 172.21.15.177:0/2553345178 wait complete. 2023-11-27T17:48:02.783 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T17:48:02.841 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:02.839+0000 7f866e513200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T17:48:02.905 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:02.903+0000 7f3e53c99200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T17:48:02.974 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:02.972+0000 7f866e513200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T17:48:03.126 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:03.124+0000 7f3e53c99200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T17:48:03.194 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:03.192+0000 7f866e513200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T17:48:03.281 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:03.279+0000 7f3e53c99200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T17:48:03.349 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:03.347+0000 7f866e513200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T17:48:03.394 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:03.392+0000 7f3e53c99200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T17:48:03.462 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:03.460+0000 7f866e513200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T17:48:03.718 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:03.716+0000 7f3e53c99200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T17:48:03.789 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:03.787+0000 7f866e513200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T17:48:03.818 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:03.816+0000 7f3e53c99200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T17:48:03.888 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:03.886+0000 7f866e513200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T17:48:04.005 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:04.003+0000 7f3e53c99200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T17:48:04.076 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:04.073+0000 7f866e513200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T17:48:04.600 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:04.597+0000 7f3e53c99200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T17:48:04.676 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-27T17:48:04.674+0000 7f866e513200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T17:48:05.444 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T17:48:05.442+0000 7f296d708640 -1 osd.0 0 log_to_monitors true 2023-11-27T17:48:05.625 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:05.622+0000 7f3e0bbee700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-27T17:48:05.625 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-11-27T17:48:05.623+0000 7f3e0bbee700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-27T17:48:05.701 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T17:48:05.699+0000 7f5fce3e4640 -1 osd.7 0 log_to_monitors true 2023-11-27T17:48:05.701 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T17:48:05.699+0000 7f1658b7e640 -1 osd.6 0 log_to_monitors true 2023-11-27T17:48:05.703 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T17:48:05.701+0000 7f8f19ae2640 -1 osd.2 0 log_to_monitors true 2023-11-27T17:48:05.704 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T17:48:05.702+0000 7efc60e29640 -1 osd.4 0 log_to_monitors true 2023-11-27T17:48:05.704 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T17:48:05.702+0000 7f61cdf3b640 -1 osd.5 0 log_to_monitors true 2023-11-27T17:48:05.717 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T17:48:05.715+0000 7efc4a2cd640 -1 osd.1 0 log_to_monitors true 2023-11-27T17:48:05.721 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T17:48:05.719+0000 7f28e3c16640 -1 osd.3 0 log_to_monitors true 2023-11-27T17:48:08.063 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T17:48:08.060+0000 7efc549e0700 -1 osd.4 0 waiting for initial osdmap 2023-11-27T17:48:08.076 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T17:48:08.074+0000 7efc4cdc0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:48:08.078 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T17:48:08.076+0000 7f61c1af2700 -1 osd.5 0 waiting for initial osdmap 2023-11-27T17:48:08.091 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T17:48:08.089+0000 7f61b9ed2700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:48:08.102 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T17:48:08.100+0000 7f5fc1f9b700 -1 osd.7 0 waiting for initial osdmap 2023-11-27T17:48:08.111 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T17:48:08.109+0000 7f5fba37b700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:48:08.116 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T17:48:08.114+0000 7f164c735700 -1 osd.6 0 waiting for initial osdmap 2023-11-27T17:48:08.127 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T17:48:08.125+0000 7f1644b15700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:48:08.730 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T17:48:08.728+0000 7f28d77cd700 -1 osd.3 0 waiting for initial osdmap 2023-11-27T17:48:08.748 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T17:48:08.745+0000 7f28cfbad700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:48:08.768 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T17:48:08.766+0000 7efc3de84700 -1 osd.1 0 waiting for initial osdmap 2023-11-27T17:48:08.781 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T17:48:08.779+0000 7efc36264700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:48:08.805 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T17:48:08.803+0000 7f29612bf700 -1 osd.0 0 waiting for initial osdmap 2023-11-27T17:48:08.807 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T17:48:08.805+0000 7f8f0d699700 -1 osd.2 0 waiting for initial osdmap 2023-11-27T17:48:08.819 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T17:48:08.817+0000 7f295969f700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:48:08.823 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T17:48:08.821+0000 7f8f05a79700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:48:09.588 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:09.705 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.703+0000 7fa20846c700 1 Processor -- start 2023-11-27T17:48:09.706 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.703+0000 7fa20846c700 1 -- start start 2023-11-27T17:48:09.708 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.704+0000 7fa20846c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa200158040 0x7fa20015b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:09.708 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.704+0000 7fa20846c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006c430 0x7fa20006d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:09.708 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.704+0000 7fa20846c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20006c000 con 0x7fa20006d840 2023-11-27T17:48:09.708 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.704+0000 7fa20846c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2000d0ed0 con 0x7fa200158040 2023-11-27T17:48:09.708 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.704+0000 7fa20846c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20006dcd0 con 0x7fa20006c430 2023-11-27T17:48:09.708 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.704+0000 7fa206a09700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa20006d840 0x7fa200072650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45398/0 (socket says 172.21.15.177:45398) 2023-11-27T17:48:09.708 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.704+0000 7fa206a09700 1 -- 172.21.15.177:0/2568488315 learned_addr learned my addr 172.21.15.177:0/2568488315 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa206208700 1 --2- 172.21.15.177:0/2568488315 >> v2:172.21.15.178:3300/0 conn(0x7fa200158040 0x7fa20015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa205a07700 1 --2- 172.21.15.177:0/2568488315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006c430 0x7fa20006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa205206700 1 -- 172.21.15.177:0/2568488315 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195353598 0 0) 0x7fa20006c000 con 0x7fa20006d840 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa205206700 1 -- 172.21.15.177:0/2568488315 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1ec0035b0 con 0x7fa20006d840 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa206208700 1 -- 172.21.15.177:0/2568488315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006c430 msgr2=0x7fa20006d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa206208700 1 --2- 172.21.15.177:0/2568488315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006c430 0x7fa20006d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa206208700 1 -- 172.21.15.177:0/2568488315 >> v1:172.21.15.177:6789/0 conn(0x7fa20006d840 legacy=0x7fa200072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa206208700 1 -- 172.21.15.177:0/2568488315 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200158420 con 0x7fa200158040 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.705+0000 7fa206208700 1 --2- 172.21.15.177:0/2568488315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 0x7fa20015b460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009840 tx=0x7fa1fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e75b3fa711f69ab9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa205206700 1 -- 172.21.15.177:0/2568488315 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc011830 con 0x7fa200158040 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa205206700 1 -- 172.21.15.177:0/2568488315 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc011990 con 0x7fa200158040 2023-11-27T17:48:09.709 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa205206700 1 -- 172.21.15.177:0/2568488315 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc011d00 con 0x7fa200158040 2023-11-27T17:48:09.712 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa20846c700 1 -- 172.21.15.177:0/2568488315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 msgr2=0x7fa20015b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:09.712 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa20846c700 1 --2- 172.21.15.177:0/2568488315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 0x7fa20015b460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009840 tx=0x7fa1fc009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:09.712 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa20846c700 1 -- 172.21.15.177:0/2568488315 shutdown_connections 2023-11-27T17:48:09.712 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa20846c700 1 --2- 172.21.15.177:0/2568488315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 0x7fa20015b460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.712 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa20846c700 1 --2- 172.21.15.177:0/2568488315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006c430 0x7fa20006d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa20846c700 1 -- 172.21.15.177:0/2568488315 >> 172.21.15.177:0/2568488315 conn(0x7fa2000717a0 msgr2=0x7fa2000b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa20846c700 1 -- 172.21.15.177:0/2568488315 shutdown_connections 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.706+0000 7fa20846c700 1 -- 172.21.15.177:0/2568488315 wait complete. 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa20846c700 1 Processor -- start 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa20846c700 1 -- start start 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa20846c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20006c430 0x7fa2001547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa20846c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006d840 0x7fa20014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa20846c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 0x7fa2000ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa20846c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200153a00 con 0x7fa20006c430 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa20846c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200153ce0 con 0x7fa200158040 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa20846c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa200153fc0 con 0x7fa20006d840 2023-11-27T17:48:09.713 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.708+0000 7fa206208700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20006c430 0x7fa2001547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206208700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20006c430 0x7fa2001547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51088/0 (socket says 172.21.15.177:51088) 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206208700 1 -- 172.21.15.177:0/1968123498 learned_addr learned my addr 172.21.15.177:0/1968123498 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206a09700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 0x7fa2000ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa205a07700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006d840 0x7fa20014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206208700 1 -- 172.21.15.177:0/1968123498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006d840 msgr2=0x7fa20014b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206208700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006d840 0x7fa20014b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206208700 1 -- 172.21.15.177:0/1968123498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 msgr2=0x7fa2000ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206208700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 0x7fa2000ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206208700 1 -- 172.21.15.177:0/1968123498 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc0094a0 con 0x7fa20006c430 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa206208700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20006c430 0x7fa2001547c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009fd0 tx=0x7fa1fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:09.714 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa1f6ffd700 1 -- 172.21.15.177:0/1968123498 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc004550 con 0x7fa20006c430 2023-11-27T17:48:09.715 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa1f6ffd700 1 -- 172.21.15.177:0/1968123498 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc01e070 con 0x7fa20006c430 2023-11-27T17:48:09.715 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa1f6ffd700 1 -- 172.21.15.177:0/1968123498 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0038e0 con 0x7fa20006c430 2023-11-27T17:48:09.715 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2001542a0 con 0x7fa20006c430 2023-11-27T17:48:09.715 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.709+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2000ad730 con 0x7fa20006c430 2023-11-27T17:48:09.715 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.710+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20009e570 con 0x7fa20006c430 2023-11-27T17:48:09.715 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.710+0000 7fa1f6ffd700 1 -- 172.21.15.177:0/1968123498 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7fa1fc003a40 con 0x7fa20006c430 2023-11-27T17:48:09.716 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.711+0000 7fa1f6ffd700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa1e406b1c0 0x7fa1e406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:09.716 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.711+0000 7fa205a07700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa1e406b1c0 0x7fa1e406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:09.716 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.711+0000 7fa1f6ffd700 1 -- 172.21.15.177:0/1968123498 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fa1fc08a1b0 con 0x7fa20006c430 2023-11-27T17:48:09.716 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.711+0000 7fa205a07700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa1e406b1c0 0x7fa1e406d680 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa2000b3320 tx=0x7fa1f000a320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:09.717 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.715+0000 7fa1f6ffd700 1 -- 172.21.15.177:0/1968123498 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa1fc055520 con 0x7fa20006c430 2023-11-27T17:48:09.915 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.913+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa200153b40 con 0x7fa20006c430 2023-11-27T17:48:09.916 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.914+0000 7fa1f6ffd700 1 -- 172.21.15.177:0/1968123498 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10945 (secure 0 0 0) 0x7fa200153b40 con 0x7fa20006c430 2023-11-27T17:48:09.917 INFO:teuthology.misc.health.smithi177.stdout: 2023-11-27T17:48:09.917 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":13,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:08.927368+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:09.919 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa1e406b1c0 msgr2=0x7fa1e406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:09.919 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa1e406b1c0 0x7fa1e406d680 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa2000b3320 tx=0x7fa1f000a320 comp rx=0 tx=0).stop 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20006c430 msgr2=0x7fa2001547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20006c430 0x7fa2001547c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009fd0 tx=0x7fa1fc004750 comp rx=0 tx=0).stop 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 shutdown_connections 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa1e406b1c0 0x7fa1e406d680 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa200158040 0x7fa2000ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20006c430 0x7fa2001547c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 --2- 172.21.15.177:0/1968123498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa20006d840 0x7fa20014b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 >> 172.21.15.177:0/1968123498 conn(0x7fa2000717a0 msgr2=0x7fa200155af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 shutdown_connections 2023-11-27T17:48:09.920 INFO:teuthology.misc.health.smithi177.stderr:2023-11-27T17:48:09.917+0000 7fa20846c700 1 -- 172.21.15.177:0/1968123498 wait complete. 2023-11-27T17:48:09.930 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-27T17:48:09.930 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-27T17:48:09.931 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T17:48:09.931 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T17:48:09.933 INFO:tasks.ceph.mds.a:Started 2023-11-27T17:48:09.933 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T17:48:09.933 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T17:48:09.935 INFO:tasks.ceph.mds.c:Started 2023-11-27T17:48:09.935 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T17:48:09.935 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T17:48:09.938 INFO:tasks.ceph.mds.b:Started 2023-11-27T17:48:09.938 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T17:48:09.938 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-27T17:48:09.940 INFO:tasks.ceph.mds.d:Started 2023-11-27T17:48:09.940 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-27T17:48:09.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:10.014 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-11-27T17:48:10.014 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-11-27T17:48:10.028 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-11-27T17:48:10.028 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-11-27T17:48:10.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.065+0000 7f5242201700 1 Processor -- start 2023-11-27T17:48:10.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.065+0000 7f5242201700 1 -- start start 2023-11-27T17:48:10.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.065+0000 7f5242201700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f523c06e280 0x7f523c15e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.065+0000 7f5242201700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f523c15ed40 0x7f523c1417f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f5242201700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c144720 con 0x7f523c141130 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f5242201700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c162670 con 0x7f523c15ed40 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f5242201700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c141510 con 0x7f523c06e280 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523b7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f523c141130 0x7f523c06db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45446/0 (socket says 172.21.15.177:45446) 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523b7fe700 1 -- 172.21.15.177:0/766190053 learned_addr learned my addr 172.21.15.177:0/766190053 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523bfff700 1 --2- 172.21.15.177:0/766190053 >> v2:172.21.15.177:3300/0 conn(0x7f523c15ed40 0x7f523c1417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523affd700 1 --2- 172.21.15.177:0/766190053 >> v2:172.21.15.178:3300/0 conn(0x7f523c06e280 0x7f523c15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523a7fc700 1 -- 172.21.15.177:0/766190053 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988291615 0 0) 0x7f523c144720 con 0x7f523c141130 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523a7fc700 1 -- 172.21.15.177:0/766190053 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52240035b0 con 0x7f523c141130 2023-11-27T17:48:10.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523bfff700 1 -- 172.21.15.177:0/766190053 >> v2:172.21.15.178:3300/0 conn(0x7f523c06e280 msgr2=0x7f523c15e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523bfff700 1 --2- 172.21.15.177:0/766190053 >> v2:172.21.15.178:3300/0 conn(0x7f523c06e280 0x7f523c15e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523bfff700 1 -- 172.21.15.177:0/766190053 >> v1:172.21.15.177:6789/0 conn(0x7f523c141130 legacy=0x7f523c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523bfff700 1 -- 172.21.15.177:0/766190053 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c15f5a0 con 0x7f523c15ed40 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523affd700 1 --2- 172.21.15.177:0/766190053 >> v2:172.21.15.178:3300/0 conn(0x7f523c06e280 0x7f523c15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523bfff700 1 --2- 172.21.15.177:0/766190053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c15ed40 0x7f523c1417f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f523c158d40 tx=0x7f523400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14e0c2ad0ccdc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523a7fc700 1 -- 172.21.15.177:0/766190053 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400e070 con 0x7f523c15ed40 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523a7fc700 1 -- 172.21.15.177:0/766190053 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523400bb20 con 0x7f523c15ed40 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.066+0000 7f523a7fc700 1 -- 172.21.15.177:0/766190053 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234012430 con 0x7f523c15ed40 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.067+0000 7f5242201700 1 -- 172.21.15.177:0/766190053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c15ed40 msgr2=0x7f523c1417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.067+0000 7f5242201700 1 --2- 172.21.15.177:0/766190053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c15ed40 0x7f523c1417f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f523c158d40 tx=0x7f523400b330 comp rx=0 tx=0).stop 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.067+0000 7f5242201700 1 -- 172.21.15.177:0/766190053 shutdown_connections 2023-11-27T17:48:10.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.067+0000 7f5242201700 1 --2- 172.21.15.177:0/766190053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c15ed40 0x7f523c1417f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.067+0000 7f5242201700 1 --2- 172.21.15.177:0/766190053 >> v2:172.21.15.178:3300/0 conn(0x7f523c06e280 0x7f523c15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.067+0000 7f5242201700 1 -- 172.21.15.177:0/766190053 >> 172.21.15.177:0/766190053 conn(0x7f523c067000 msgr2=0x7f523c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:10.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.067+0000 7f5242201700 1 -- 172.21.15.177:0/766190053 shutdown_connections 2023-11-27T17:48:10.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.067+0000 7f5242201700 1 -- 172.21.15.177:0/766190053 wait complete. 2023-11-27T17:48:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.068+0000 7f5242201700 1 Processor -- start 2023-11-27T17:48:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.068+0000 7f5242201700 1 -- start start 2023-11-27T17:48:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f5242201700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c06e280 0x7f523c071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f5242201700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f523c141130 0x7f523c1f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f5242201700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f523c15ed40 0x7f523c13f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f5242201700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c071d60 con 0x7f523c06e280 2023-11-27T17:48:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f5242201700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c1f6f70 con 0x7f523c15ed40 2023-11-27T17:48:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f5242201700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c1f7250 con 0x7f523c141130 2023-11-27T17:48:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c06e280 0x7f523c071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c06e280 0x7f523c071820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51136/0 (socket says 172.21.15.177:51136) 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523b7fe700 1 -- 172.21.15.177:0/700214226 learned_addr learned my addr 172.21.15.177:0/700214226 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523affd700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f523c141130 0x7f523c1f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523bfff700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f523c15ed40 0x7f523c13f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523b7fe700 1 -- 172.21.15.177:0/700214226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f523c141130 msgr2=0x7f523c1f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523b7fe700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f523c141130 0x7f523c1f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523b7fe700 1 -- 172.21.15.177:0/700214226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f523c15ed40 msgr2=0x7f523c13f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523b7fe700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f523c15ed40 0x7f523c13f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.069+0000 7f523b7fe700 1 -- 172.21.15.177:0/700214226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234009a70 con 0x7f523c06e280 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.070+0000 7f523b7fe700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c06e280 0x7f523c071820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f522c00c700 tx=0x7f522c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.070+0000 7f5223fff700 1 -- 172.21.15.177:0/700214226 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c005d70 con 0x7f523c06e280 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.070+0000 7f5223fff700 1 -- 172.21.15.177:0/700214226 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0070d0 con 0x7f523c06e280 2023-11-27T17:48:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.070+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c1f7530 con 0x7f523c06e280 2023-11-27T17:48:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.070+0000 7f5223fff700 1 -- 172.21.15.177:0/700214226 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c007460 con 0x7f523c06e280 2023-11-27T17:48:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.070+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c1f7af0 con 0x7f523c06e280 2023-11-27T17:48:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.071+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c073aa0 con 0x7f523c06e280 2023-11-27T17:48:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.071+0000 7f5223fff700 1 -- 172.21.15.177:0/700214226 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7f522c0075c0 con 0x7f523c06e280 2023-11-27T17:48:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.072+0000 7f5223fff700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f522806b1c0 0x7f522806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.072+0000 7f5223fff700 1 -- 172.21.15.177:0/700214226 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f522c088a30 con 0x7f523c06e280 2023-11-27T17:48:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.072+0000 7f523affd700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f522806b1c0 0x7f522806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.072+0000 7f523affd700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f522806b1c0 0x7f522806d680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f523c0b1bc0 tx=0x7f5230008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:10.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.076+0000 7f5223fff700 1 -- 172.21.15.177:0/700214226 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f522c053c80 con 0x7f523c06e280 2023-11-27T17:48:10.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.269+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f523c069400 con 0x7f523c06e280 2023-11-27T17:48:10.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.270+0000 7f5223fff700 1 -- 172.21.15.177:0/700214226 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11129 (secure 0 0 0) 0x7f522c0572a0 con 0x7f523c06e280 2023-11-27T17:48:10.272 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:10.273 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":14,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:10.136731+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f522806b1c0 msgr2=0x7f522806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f522806b1c0 0x7f522806d680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f523c0b1bc0 tx=0x7f5230008040 comp rx=0 tx=0).stop 2023-11-27T17:48:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c06e280 msgr2=0x7f523c071820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c06e280 0x7f523c071820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f522c00c700 tx=0x7f522c00cac0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 shutdown_connections 2023-11-27T17:48:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f522806b1c0 0x7f522806d680 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f523c15ed40 0x7f523c13f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f523c06e280 0x7f523c071820 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 --2- 172.21.15.177:0/700214226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f523c141130 0x7f523c1f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.272+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 >> 172.21.15.177:0/700214226 conn(0x7f523c067000 msgr2=0x7f523c143b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.273+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 shutdown_connections 2023-11-27T17:48:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.273+0000 7f5242201700 1 -- 172.21.15.177:0/700214226 wait complete. 2023-11-27T17:48:10.287 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-27T17:48:10.287 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.404+0000 7fb007614700 1 Processor -- start 2023-11-27T17:48:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.405+0000 7fb007614700 1 -- start start 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.405+0000 7fb007614700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb00015e880 0x7fb00006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb007614700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb00006dcf0 0x7fb00015b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb007614700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00006e520 con 0x7fb00006d910 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb007614700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00006efc0 con 0x7fb00006dcf0 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb007614700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00006f2a0 con 0x7fb00015e880 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb005bb1700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb00006dcf0 0x7fb00015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb005bb1700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb00006dcf0 0x7fb00015b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51152/0 (socket says 172.21.15.177:51152) 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb005bb1700 1 -- 172.21.15.177:0/3507524371 learned_addr learned my addr 172.21.15.177:0/3507524371 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb004baf700 1 --2- 172.21.15.177:0/3507524371 >> v2:172.21.15.178:3300/0 conn(0x7fb00015e880 0x7fb00006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb005bb1700 1 -- 172.21.15.177:0/3507524371 >> v2:172.21.15.178:3300/0 conn(0x7fb00015e880 msgr2=0x7fb00006e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb005bb1700 1 --2- 172.21.15.177:0/3507524371 >> v2:172.21.15.178:3300/0 conn(0x7fb00015e880 0x7fb00006e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb005bb1700 1 -- 172.21.15.177:0/3507524371 >> v1:172.21.15.178:6789/0 conn(0x7fb00006d910 legacy=0x7fb0000b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb005bb1700 1 -- 172.21.15.177:0/3507524371 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00006f580 con 0x7fb00006dcf0 2023-11-27T17:48:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7fb005bb1700 1 --2- 172.21.15.177:0/3507524371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00006dcf0 0x7fb00015b750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb0000b5530 tx=0x7faff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bce905d1d96a63d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7faff3fff700 1 -- 172.21.15.177:0/3507524371 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff800e070 con 0x7fb00006dcf0 2023-11-27T17:48:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7faff3fff700 1 -- 172.21.15.177:0/3507524371 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff800b910 con 0x7fb00006dcf0 2023-11-27T17:48:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.406+0000 7faff3fff700 1 -- 172.21.15.177:0/3507524371 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff800bcc0 con 0x7fb00006dcf0 2023-11-27T17:48:10.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.407+0000 7fb007614700 1 -- 172.21.15.177:0/3507524371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00006dcf0 msgr2=0x7fb00015b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.407+0000 7fb007614700 1 --2- 172.21.15.177:0/3507524371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00006dcf0 0x7fb00015b750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb0000b5530 tx=0x7faff800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:10.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.407+0000 7fb007614700 1 -- 172.21.15.177:0/3507524371 shutdown_connections 2023-11-27T17:48:10.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.407+0000 7fb007614700 1 --2- 172.21.15.177:0/3507524371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00006dcf0 0x7fb00015b750 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.407+0000 7fb007614700 1 --2- 172.21.15.177:0/3507524371 >> v2:172.21.15.178:3300/0 conn(0x7fb00015e880 0x7fb00006e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.407+0000 7fb007614700 1 -- 172.21.15.177:0/3507524371 >> 172.21.15.177:0/3507524371 conn(0x7fb0000b2130 msgr2=0x7fb0000b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:10.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.407+0000 7fb007614700 1 -- 172.21.15.177:0/3507524371 shutdown_connections 2023-11-27T17:48:10.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.407+0000 7fb007614700 1 -- 172.21.15.177:0/3507524371 wait complete. 2023-11-27T17:48:10.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.409+0000 7fb007614700 1 Processor -- start 2023-11-27T17:48:10.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.409+0000 7fb007614700 1 -- start start 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb007614700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00006d910 0x7fb000147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb007614700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00006dcf0 0x7fb0000cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb007614700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00015e880 0x7fb0000cff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb007614700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000a98f0 con 0x7fb00015e880 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb007614700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000afe80 con 0x7fb00006d910 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb007614700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000af8c0 con 0x7fb00006dcf0 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00015e880 0x7fb0000cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00015e880 0x7fb0000cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51158/0 (socket says 172.21.15.177:51158) 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 -- 172.21.15.177:0/3079416340 learned_addr learned my addr 172.21.15.177:0/3079416340 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:10.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb0053b0700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00006d910 0x7fb000147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb004baf700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00006dcf0 0x7fb0000cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 -- 172.21.15.177:0/3079416340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00006dcf0 msgr2=0x7fb0000cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00006dcf0 0x7fb0000cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 -- 172.21.15.177:0/3079416340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00006d910 msgr2=0x7fb000147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00006d910 0x7fb000147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 -- 172.21.15.177:0/3079416340 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8009b30 con 0x7fb00015e880 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb005bb1700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00015e880 0x7fb0000cff00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faff800b370 tx=0x7faff8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7faff1ffb700 1 -- 172.21.15.177:0/3079416340 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8004900 con 0x7fb00015e880 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7faff1ffb700 1 -- 172.21.15.177:0/3079416340 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80099b0 con 0x7fb00015e880 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7faff1ffb700 1 -- 172.21.15.177:0/3079416340 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff801c680 con 0x7fb00015e880 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.410+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0000afba0 con 0x7fb00015e880 2023-11-27T17:48:10.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.411+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0000aeb30 con 0x7fb00015e880 2023-11-27T17:48:10.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.411+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb000073aa0 con 0x7fb00015e880 2023-11-27T17:48:10.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.412+0000 7faff1ffb700 1 -- 172.21.15.177:0/3079416340 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7faff801c7e0 con 0x7fb00015e880 2023-11-27T17:48:10.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.412+0000 7faff1ffb700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafe406b1c0 0x7fafe406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:10.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.412+0000 7faff1ffb700 1 -- 172.21.15.177:0/3079416340 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7faff808afa0 con 0x7fb00015e880 2023-11-27T17:48:10.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.412+0000 7fb0053b0700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafe406b1c0 0x7fafe406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:10.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.412+0000 7fb0053b0700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafe406b1c0 0x7fafe406d680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faff4007fd0 tx=0x7faff4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.417+0000 7faff1ffb700 1 -- 172.21.15.177:0/3079416340 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faff8056310 con 0x7fb00015e880 2023-11-27T17:48:10.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.650+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb000069400 con 0x7fb00015e880 2023-11-27T17:48:10.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.663+0000 7faff1ffb700 1 -- 172.21.15.177:0/3079416340 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7faff805ee60 con 0x7fb00015e880 2023-11-27T17:48:10.665 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:10.665 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-27T17:48:10.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafe406b1c0 msgr2=0x7fafe406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafe406b1c0 0x7fafe406d680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faff4007fd0 tx=0x7faff4009040 comp rx=0 tx=0).stop 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00015e880 msgr2=0x7fb0000cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00015e880 0x7fb0000cff00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faff800b370 tx=0x7faff8004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 shutdown_connections 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafe406b1c0 0x7fafe406d680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb00015e880 0x7fb0000cff00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00006d910 0x7fb000147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 --2- 172.21.15.177:0/3079416340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00006dcf0 0x7fb0000cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 >> 172.21.15.177:0/3079416340 conn(0x7fb0000b2130 msgr2=0x7fb000158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 shutdown_connections 2023-11-27T17:48:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:10.665+0000 7fb007614700 1 -- 172.21.15.177:0/3079416340 wait complete. 2023-11-27T17:48:10.669 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 2 2023-11-27T17:48:12.680 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:12.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.802+0000 7f54134b7700 1 Processor -- start 2023-11-27T17:48:12.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.803+0000 7f54134b7700 1 -- start start 2023-11-27T17:48:12.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.803+0000 7f54134b7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f540c0cf3c0 0x7f540c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.803+0000 7f54134b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0b2690 0x7f540c15fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.803+0000 7f54134b7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f540c160180 0x7f540c144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.803+0000 7f54134b7700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c1609e0 con 0x7f540c160180 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.803+0000 7f54134b7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0b2af0 con 0x7f540c0cf3c0 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.803+0000 7f54134b7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0d0f40 con 0x7f540c0b2690 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f540c160180 0x7f540c144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f540c160180 0x7f540c144fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51204/0 (socket says 172.21.15.177:51204) 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 -- 172.21.15.177:0/1239023811 learned_addr learned my addr 172.21.15.177:0/1239023811 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5410a52700 1 --2- 172.21.15.177:0/1239023811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0b2690 0x7f540c15fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411253700 1 --2- 172.21.15.177:0/1239023811 >> v2:172.21.15.178:3300/0 conn(0x7f540c0cf3c0 0x7f540c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:12.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 -- 172.21.15.177:0/1239023811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0b2690 msgr2=0x7f540c15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 --2- 172.21.15.177:0/1239023811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0b2690 0x7f540c15fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 -- 172.21.15.177:0/1239023811 >> v2:172.21.15.178:3300/0 conn(0x7f540c0cf3c0 msgr2=0x7f540c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 --2- 172.21.15.177:0/1239023811 >> v2:172.21.15.178:3300/0 conn(0x7f540c0cf3c0 0x7f540c0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 -- 172.21.15.177:0/1239023811 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0d1220 con 0x7f540c160180 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5411a54700 1 --2- 172.21.15.177:0/1239023811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c160180 0x7f540c144fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f540c0b8320 tx=0x7f540400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de1474caa9bc608 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5403fff700 1 -- 172.21.15.177:0/1239023811 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400e070 con 0x7f540c160180 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5403fff700 1 -- 172.21.15.177:0/1239023811 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400b910 con 0x7f540c160180 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.804+0000 7f5403fff700 1 -- 172.21.15.177:0/1239023811 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400bcc0 con 0x7f540c160180 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 -- 172.21.15.177:0/1239023811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c160180 msgr2=0x7f540c144fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 --2- 172.21.15.177:0/1239023811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c160180 0x7f540c144fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f540c0b8320 tx=0x7f540400b330 comp rx=0 tx=0).stop 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 -- 172.21.15.177:0/1239023811 shutdown_connections 2023-11-27T17:48:12.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 --2- 172.21.15.177:0/1239023811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c160180 0x7f540c144fe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:12.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 --2- 172.21.15.177:0/1239023811 >> v2:172.21.15.178:3300/0 conn(0x7f540c0cf3c0 0x7f540c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:12.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 --2- 172.21.15.177:0/1239023811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0b2690 0x7f540c15fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:12.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 -- 172.21.15.177:0/1239023811 >> 172.21.15.177:0/1239023811 conn(0x7f540c072190 msgr2=0x7f540c0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:12.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 -- 172.21.15.177:0/1239023811 shutdown_connections 2023-11-27T17:48:12.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.805+0000 7f54134b7700 1 -- 172.21.15.177:0/1239023811 wait complete. 2023-11-27T17:48:12.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.806+0000 7f54134b7700 1 Processor -- start 2023-11-27T17:48:12.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.806+0000 7f54134b7700 1 -- start start 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f54134b7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c0b2690 0x7f540c147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f54134b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0cf3c0 0x7f540c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f54134b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c160180 0x7f540c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f54134b7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c15f0b0 con 0x7f540c0b2690 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f54134b7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c15e530 con 0x7f540c0cf3c0 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f54134b7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c15e810 con 0x7f540c160180 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c0b2690 0x7f540c147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c0b2690 0x7f540c147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51206/0 (socket says 172.21.15.177:51206) 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 -- 172.21.15.177:0/3545832633 learned_addr learned my addr 172.21.15.177:0/3545832633 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411a54700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c160180 0x7f540c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:12.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5410a52700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0cf3c0 0x7f540c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 -- 172.21.15.177:0/3545832633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c160180 msgr2=0x7f540c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c160180 0x7f540c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 -- 172.21.15.177:0/3545832633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0cf3c0 msgr2=0x7f540c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0cf3c0 0x7f540c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 -- 172.21.15.177:0/3545832633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404009b30 con 0x7f540c0b2690 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5411253700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c0b2690 0x7f540c147a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e9b0 tx=0x7f53fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5401ffb700 1 -- 172.21.15.177:0/3545832633 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc009710 con 0x7f540c0b2690 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5401ffb700 1 -- 172.21.15.177:0/3545832633 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00c850 con 0x7f540c0b2690 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c15eaf0 con 0x7f540c0b2690 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.807+0000 7f5401ffb700 1 -- 172.21.15.177:0/3545832633 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00cbc0 con 0x7f540c0b2690 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.808+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c15d7c0 con 0x7f540c0b2690 2023-11-27T17:48:12.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.809+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c1f1b00 con 0x7f540c0b2690 2023-11-27T17:48:12.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.809+0000 7f5401ffb700 1 -- 172.21.15.177:0/3545832633 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7f53fc00cd20 con 0x7f540c0b2690 2023-11-27T17:48:12.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.809+0000 7f5401ffb700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f53f006b1c0 0x7f53f006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:12.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.810+0000 7f5401ffb700 1 -- 172.21.15.177:0/3545832633 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f53fc089650 con 0x7f540c0b2690 2023-11-27T17:48:12.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.810+0000 7f5410a52700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f53f006b1c0 0x7f53f006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:12.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.810+0000 7f5410a52700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f53f006b1c0 0x7f53f006d680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f540c1541f0 tx=0x7f5408008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:12.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:12.814+0000 7f5401ffb700 1 -- 172.21.15.177:0/3545832633 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f53fc054840 con 0x7f540c0b2690 2023-11-27T17:48:13.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.062+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f540c073aa0 con 0x7f540c0b2690 2023-11-27T17:48:13.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.063+0000 7f5401ffb700 1 -- 172.21.15.177:0/3545832633 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f53fc021e90 con 0x7f540c0b2690 2023-11-27T17:48:13.065 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:13.066 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-27T17:48:13.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f53f006b1c0 msgr2=0x7f53f006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f53f006b1c0 0x7f53f006d680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f540c1541f0 tx=0x7f5408008040 comp rx=0 tx=0).stop 2023-11-27T17:48:13.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c0b2690 msgr2=0x7f540c147a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c0b2690 0x7f540c147a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e9b0 tx=0x7f53fc00ed70 comp rx=0 tx=0).stop 2023-11-27T17:48:13.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 shutdown_connections 2023-11-27T17:48:13.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f53f006b1c0 0x7f53f006d680 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c160180 0x7f540c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f540c0b2690 0x7f540c147a80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 --2- 172.21.15.177:0/3545832633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0cf3c0 0x7f540c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 >> 172.21.15.177:0/3545832633 conn(0x7f540c072190 msgr2=0x7f540c072570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:13.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 shutdown_connections 2023-11-27T17:48:13.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.065+0000 7f54134b7700 1 -- 172.21.15.177:0/3545832633 wait complete. 2023-11-27T17:48:13.069 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 3 2023-11-27T17:48:13.080 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:13.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.202+0000 7ff28287e700 1 Processor -- start 2023-11-27T17:48:13.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.202+0000 7ff28287e700 1 -- start start 2023-11-27T17:48:13.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff28287e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff27c0cf3c0 0x7ff27c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff28287e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff28287e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0b2af0 con 0x7ff27c0b2690 2023-11-27T17:48:13.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff28287e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27c1607e0 con 0x7ff27c0cf3c0 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff28287e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c1609e0 con 0x7ff27c160350 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff27b7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff27c0b2690 0x7ff27c15fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45546/0 (socket says 172.21.15.177:45546) 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff27b7fe700 1 -- 172.21.15.177:0/1267800147 learned_addr learned my addr 172.21.15.177:0/1267800147 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff280e1b700 1 --2- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff27bfff700 1 --2- 172.21.15.177:0/1267800147 >> v2:172.21.15.178:3300/0 conn(0x7ff27c0cf3c0 0x7ff27c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.203+0000 7ff27affd700 1 -- 172.21.15.177:0/1267800147 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448701590 0 0) 0x7ff27c0b2af0 con 0x7ff27c0b2690 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27affd700 1 -- 172.21.15.177:0/1267800147 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2640035b0 con 0x7ff27c0b2690 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27bfff700 1 -- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 msgr2=0x7ff27c144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27bfff700 1 --2- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27bfff700 1 -- 172.21.15.177:0/1267800147 >> v1:172.21.15.177:6789/0 conn(0x7ff27c0b2690 legacy=0x7ff27c15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27bfff700 1 -- 172.21.15.177:0/1267800147 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0b7490 con 0x7ff27c0cf3c0 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff280e1b700 1 --2- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27bfff700 1 --2- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0cf3c0 0x7ff27c0b2150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff270009840 tx=0x7ff270009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d437d053e7c09e74 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27affd700 1 -- 172.21.15.177:0/1267800147 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270011830 con 0x7ff27c0cf3c0 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27affd700 1 -- 172.21.15.177:0/1267800147 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff270011990 con 0x7ff27c0cf3c0 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff27affd700 1 -- 172.21.15.177:0/1267800147 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270011d00 con 0x7ff27c0cf3c0 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff28287e700 1 -- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0cf3c0 msgr2=0x7ff27c0b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff28287e700 1 --2- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0cf3c0 0x7ff27c0b2150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff270009840 tx=0x7ff270009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff28287e700 1 -- 172.21.15.177:0/1267800147 shutdown_connections 2023-11-27T17:48:13.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.204+0000 7ff28287e700 1 --2- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.205+0000 7ff28287e700 1 --2- 172.21.15.177:0/1267800147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0cf3c0 0x7ff27c0b2150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.205+0000 7ff28287e700 1 -- 172.21.15.177:0/1267800147 >> 172.21.15.177:0/1267800147 conn(0x7ff27c072190 msgr2=0x7ff27c0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:13.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.205+0000 7ff28287e700 1 -- 172.21.15.177:0/1267800147 shutdown_connections 2023-11-27T17:48:13.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.205+0000 7ff28287e700 1 -- 172.21.15.177:0/1267800147 wait complete. 2023-11-27T17:48:13.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.206+0000 7ff28287e700 1 Processor -- start 2023-11-27T17:48:13.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.206+0000 7ff28287e700 1 -- start start 2023-11-27T17:48:13.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff28287e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0b2690 0x7ff27c153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff28287e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c0cf3c0 0x7ff27c1f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff28287e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff28287e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c154080 con 0x7ff27c0cf3c0 2023-11-27T17:48:13.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff28287e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c154360 con 0x7ff27c0b2690 2023-11-27T17:48:13.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff28287e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c154640 con 0x7ff27c160350 2023-11-27T17:48:13.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c0cf3c0 0x7ff27c1f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff280e1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0b2690 0x7ff27c153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff280e1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c0cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:38700/0 (socket says 172.21.15.177:38700) 2023-11-27T17:48:13.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff280e1b700 1 -- 172.21.15.177:0/242723423 learned_addr learned my addr 172.21.15.177:0/242723423 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:13.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c0cf3c0 0x7ff27c1f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51232/0 (socket says 172.21.15.177:51232) 2023-11-27T17:48:13.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27bfff700 1 -- 172.21.15.177:0/242723423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 msgr2=0x7ff27c0cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27bfff700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c0cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27bfff700 1 -- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c0cf3c0 msgr2=0x7ff27c1f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27bfff700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c0cf3c0 0x7ff27c1f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27bfff700 1 -- 172.21.15.177:0/242723423 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009a70 con 0x7ff27c0b2690 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff27bfff700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0b2690 0x7ff27c153780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff270016000 tx=0x7ff270004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff278ff9700 1 -- 172.21.15.177:0/242723423 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270004550 con 0x7ff27c0b2690 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff278ff9700 1 -- 172.21.15.177:0/242723423 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27001f070 con 0x7ff27c0b2690 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff278ff9700 1 -- 172.21.15.177:0/242723423 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700038c0 con 0x7ff27c0b2690 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2700094a0 con 0x7ff27c0b2690 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.207+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c154c00 con 0x7ff27c0b2690 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.208+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c073aa0 con 0x7ff27c0b2690 2023-11-27T17:48:13.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.209+0000 7ff278ff9700 1 -- 172.21.15.177:0/242723423 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff270003a20 con 0x7ff27c0b2690 2023-11-27T17:48:13.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.209+0000 7ff278ff9700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff26806b250 0x7ff26806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.209+0000 7ff278ff9700 1 -- 172.21.15.177:0/242723423 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff270021070 con 0x7ff27c0b2690 2023-11-27T17:48:13.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.209+0000 7ff27b7fe700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff26806b250 0x7ff26806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.210+0000 7ff27b7fe700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff26806b250 0x7ff26806d710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff26c007fd0 tx=0x7ff26c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.214+0000 7ff278ff9700 1 -- 172.21.15.177:0/242723423 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff270055e40 con 0x7ff27c0b2690 2023-11-27T17:48:13.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.415+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff27c0ce330 con 0x7ff27c0b2690 2023-11-27T17:48:13.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.416+0000 7ff278ff9700 1 -- 172.21.15.177:0/242723423 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12887 (secure 0 0 0) 0x7ff270015020 con 0x7ff27c0b2690 2023-11-27T17:48:13.418 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:13.418 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":17,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:13.144518+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:13.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff26806b250 msgr2=0x7ff26806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff26806b250 0x7ff26806d710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff26c007fd0 tx=0x7ff26c009040 comp rx=0 tx=0).stop 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0b2690 msgr2=0x7ff27c153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0b2690 0x7ff27c153780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff270016000 tx=0x7ff270004750 comp rx=0 tx=0).stop 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 shutdown_connections 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff26806b250 0x7ff26806d710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff27c160350 0x7ff27c0cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff27c0b2690 0x7ff27c153780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 --2- 172.21.15.177:0/242723423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff27c0cf3c0 0x7ff27c1f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 >> 172.21.15.177:0/242723423 conn(0x7ff27c072190 msgr2=0x7ff27c157c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 shutdown_connections 2023-11-27T17:48:13.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.418+0000 7ff28287e700 1 -- 172.21.15.177:0/242723423 wait complete. 2023-11-27T17:48:13.432 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:13.433 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:13.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.554+0000 7eff78ef7700 1 Processor -- start 2023-11-27T17:48:13.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.554+0000 7eff78ef7700 1 -- start start 2023-11-27T17:48:13.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.555+0000 7eff78ef7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff740cdf60 0x7eff740b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.555+0000 7eff78ef7700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7415b870 con 0x7eff740afa50 2023-11-27T17:48:13.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.555+0000 7eff78ef7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7415bb50 con 0x7eff7415b3d0 2023-11-27T17:48:13.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.555+0000 7eff78ef7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff740afe30 con 0x7eff740cdf60 2023-11-27T17:48:13.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.555+0000 7eff7259c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7eff740afa50 0x7eff7415e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45562/0 (socket says 172.21.15.177:45562) 2023-11-27T17:48:13.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.555+0000 7eff7259c700 1 -- 172.21.15.177:0/300769395 learned_addr learned my addr 172.21.15.177:0/300769395 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:13.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff72d9d700 1 --2- 172.21.15.177:0/300769395 >> v2:172.21.15.178:3300/0 conn(0x7eff740cdf60 0x7eff740b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631631241 0 0) 0x7eff7415b870 con 0x7eff740afa50 2023-11-27T17:48:13.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff5c0035b0 con 0x7eff740afa50 2023-11-27T17:48:13.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063252223 0 0) 0x7eff7415bb50 con 0x7eff7415b3d0 2023-11-27T17:48:13.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff7415b870 con 0x7eff7415b3d0 2023-11-27T17:48:13.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199028436 0 0) 0x7eff5c0035b0 con 0x7eff740afa50 2023-11-27T17:48:13.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 >> v2:172.21.15.178:3300/0 conn(0x7eff740cdf60 msgr2=0x7eff740b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:13.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 --2- 172.21.15.177:0/300769395 >> v2:172.21.15.178:3300/0 conn(0x7eff740cdf60 0x7eff740b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 >> v1:172.21.15.178:6789/0 conn(0x7eff7415b3d0 legacy=0x7eff740cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7415be30 con 0x7eff740afa50 2023-11-27T17:48:13.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7eff68001670 con 0x7eff740afa50 2023-11-27T17:48:13.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 >> v1:172.21.15.177:6789/0 conn(0x7eff740afa50 legacy=0x7eff7415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c003b90 0x7eff5c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5c005210 0x7eff5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740afe30 con 0x7eff5c004850 2023-11-27T17:48:13.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c00c090 con 0x7eff5c003b90 2023-11-27T17:48:13.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c00c250 con 0x7eff5c005210 2023-11-27T17:48:13.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff72d9d700 1 --2- 172.21.15.177:0/300769395 >> v2:172.21.15.178:3300/0 conn(0x7eff740cdf60 0x7eff740b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:13.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff71d9b700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff7259c700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c003b90 0x7eff5c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff72d9d700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5c005210 0x7eff5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff71d9b700 1 -- 172.21.15.177:0/300769395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5c005210 msgr2=0x7eff5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:13.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff71d9b700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5c005210 0x7eff5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff71d9b700 1 -- 172.21.15.177:0/300769395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c003b90 msgr2=0x7eff5c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:13.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff71d9b700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c003b90 0x7eff5c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff72d9d700 1 -- 172.21.15.177:0/300769395 reap_dead start 2023-11-27T17:48:13.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.556+0000 7eff71d9b700 1 -- 172.21.15.177:0/300769395 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0035b0 con 0x7eff5c004850 2023-11-27T17:48:13.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff71d9b700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff64001940 tx=0x7eff5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdb3195e1be7363 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64001430 con 0x7eff5c004850 2023-11-27T17:48:13.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64001d70 con 0x7eff5c004850 2023-11-27T17:48:13.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff7159a700 1 -- 172.21.15.177:0/300769395 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64005510 con 0x7eff5c004850 2023-11-27T17:48:13.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff78ef7700 1 -- 172.21.15.177:0/300769395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c004850 msgr2=0x7eff5c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff78ef7700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff64001940 tx=0x7eff5c005880 comp rx=0 tx=0).stop 2023-11-27T17:48:13.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff78ef7700 1 -- 172.21.15.177:0/300769395 shutdown_connections 2023-11-27T17:48:13.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff78ef7700 1 --2- 172.21.15.177:0/300769395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff78ef7700 1 -- 172.21.15.177:0/300769395 >> 172.21.15.177:0/300769395 conn(0x7eff740b38b0 msgr2=0x7eff740b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:13.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff78ef7700 1 -- 172.21.15.177:0/300769395 shutdown_connections 2023-11-27T17:48:13.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.557+0000 7eff78ef7700 1 -- 172.21.15.177:0/300769395 wait complete. 2023-11-27T17:48:13.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff78ef7700 1 Processor -- start 2023-11-27T17:48:13.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff78ef7700 1 -- start start 2023-11-27T17:48:13.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff78ef7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c004850 0x7eff74148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff78ef7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff74144400 0x7eff7414ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff78ef7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7414f2a0 0x7eff740ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff78ef7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7414f720 con 0x7eff74144400 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff78ef7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff74144880 con 0x7eff5c004850 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff78ef7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff74148940 con 0x7eff7414f2a0 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff71d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff74144400 0x7eff7414ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.559+0000 7eff71d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff74144400 0x7eff7414ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51256/0 (socket says 172.21.15.177:51256) 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff71d9b700 1 -- 172.21.15.177:0/1701904474 learned_addr learned my addr 172.21.15.177:0/1701904474 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff7259c700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c004850 0x7eff74148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff72d9d700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7414f2a0 0x7eff740ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff71d9b700 1 -- 172.21.15.177:0/1701904474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7414f2a0 msgr2=0x7eff740ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff71d9b700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7414f2a0 0x7eff740ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff71d9b700 1 -- 172.21.15.177:0/1701904474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c004850 msgr2=0x7eff74148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff71d9b700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c004850 0x7eff74148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff71d9b700 1 -- 172.21.15.177:0/1701904474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74148050 con 0x7eff74144400 2023-11-27T17:48:13.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff71d9b700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff74144400 0x7eff7414ed60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c060 tx=0x7eff640012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff62ffd700 1 -- 172.21.15.177:0/1701904474 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640013d0 con 0x7eff74144400 2023-11-27T17:48:13.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff62ffd700 1 -- 172.21.15.177:0/1701904474 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64006a70 con 0x7eff74144400 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff741482f0 con 0x7eff74144400 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff62ffd700 1 -- 172.21.15.177:0/1701904474 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64006e00 con 0x7eff74144400 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.560+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff740aee20 con 0x7eff74144400 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.561+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff74069400 con 0x7eff74144400 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.562+0000 7eff62ffd700 1 -- 172.21.15.177:0/1701904474 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7eff64007040 con 0x7eff74144400 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.562+0000 7eff62ffd700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7eff5406b280 0x7eff5406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.562+0000 7eff62ffd700 1 -- 172.21.15.177:0/1701904474 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff6408a1c0 con 0x7eff74144400 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.562+0000 7eff7259c700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7eff5406b280 0x7eff5406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.562+0000 7eff7259c700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7eff5406b280 0x7eff5406d740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff68001c40 tx=0x7eff68001e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.567+0000 7eff62ffd700 1 -- 172.21.15.177:0/1701904474 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7eff64058eb0 con 0x7eff74144400 2023-11-27T17:48:13.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.757+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff740731d0 con 0x7eff74144400 2023-11-27T17:48:13.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.757+0000 7eff62ffd700 1 -- 172.21.15.177:0/1701904474 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff64021020 con 0x7eff74144400 2023-11-27T17:48:13.759 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:13.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7eff5406b280 msgr2=0x7eff5406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7eff5406b280 0x7eff5406d740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff68001c40 tx=0x7eff68001e20 comp rx=0 tx=0).stop 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff74144400 msgr2=0x7eff7414ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff74144400 0x7eff7414ed60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c060 tx=0x7eff640012d0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 shutdown_connections 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7eff5406b280 0x7eff5406d740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7414f2a0 0x7eff740ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff5c004850 0x7eff74148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 --2- 172.21.15.177:0/1701904474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff74144400 0x7eff7414ed60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 >> 172.21.15.177:0/1701904474 conn(0x7eff740b38b0 msgr2=0x7eff7415dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:13.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 shutdown_connections 2023-11-27T17:48:13.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.759+0000 7eff78ef7700 1 -- 172.21.15.177:0/1701904474 wait complete. 2023-11-27T17:48:13.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T17:48:13.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.891+0000 7f7fe45fd700 1 Processor -- start 2023-11-27T17:48:13.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.891+0000 7f7fe45fd700 1 -- start start 2023-11-27T17:48:13.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe45fd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7fdc15e880 0x7f7fdc06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe45fd700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc06e520 con 0x7f7fdc06dcf0 2023-11-27T17:48:13.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe45fd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc06efc0 con 0x7f7fdc06d910 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe45fd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc06f2a0 con 0x7f7fdc15e880 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe2b9a700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7fdc06dcf0 0x7f7fdc15b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45582/0 (socket says 172.21.15.177:45582) 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe2b9a700 1 -- 172.21.15.177:0/1280665314 learned_addr learned my addr 172.21.15.177:0/1280665314 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe1b98700 1 --2- 172.21.15.177:0/1280665314 >> v2:172.21.15.178:3300/0 conn(0x7f7fdc15e880 0x7f7fdc06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe1397700 1 -- 172.21.15.177:0/1280665314 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605968979 0 0) 0x7f7fdc06e520 con 0x7f7fdc06dcf0 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.892+0000 7f7fe1397700 1 -- 172.21.15.177:0/1280665314 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc80035b0 con 0x7f7fdc06dcf0 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1397700 1 -- 172.21.15.177:0/1280665314 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815293094 0 0) 0x7f7fdc06efc0 con 0x7f7fdc06d910 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1397700 1 -- 172.21.15.177:0/1280665314 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fdc06e520 con 0x7f7fdc06d910 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1397700 1 -- 172.21.15.177:0/1280665314 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1760808076 0 0) 0x7f7fc80035b0 con 0x7f7fdc06dcf0 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1b98700 1 -- 172.21.15.177:0/1280665314 >> v1:172.21.15.178:6789/0 conn(0x7f7fdc06d910 legacy=0x7f7fdc0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1b98700 1 -- 172.21.15.177:0/1280665314 >> v1:172.21.15.177:6789/0 conn(0x7f7fdc06dcf0 legacy=0x7f7fdc15b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1b98700 1 -- 172.21.15.177:0/1280665314 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc06f580 con 0x7f7fdc15e880 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1b98700 1 --2- 172.21.15.177:0/1280665314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 0x7f7fdc06e8c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009840 tx=0x7f7fd8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f511ae4ce36c009 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1397700 1 -- 172.21.15.177:0/1280665314 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40019f0 con 0x7f7fdc15e880 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1397700 1 -- 172.21.15.177:0/1280665314 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8004030 con 0x7f7fdc15e880 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe1397700 1 -- 172.21.15.177:0/1280665314 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80043c0 con 0x7f7fdc15e880 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe45fd700 1 -- 172.21.15.177:0/1280665314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 msgr2=0x7f7fdc06e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.893+0000 7f7fe45fd700 1 --2- 172.21.15.177:0/1280665314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 0x7f7fdc06e8c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009840 tx=0x7f7fd8009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.894+0000 7f7fe45fd700 1 -- 172.21.15.177:0/1280665314 shutdown_connections 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.894+0000 7f7fe45fd700 1 --2- 172.21.15.177:0/1280665314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 0x7f7fdc06e8c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.894+0000 7f7fe45fd700 1 -- 172.21.15.177:0/1280665314 >> 172.21.15.177:0/1280665314 conn(0x7f7fdc0b2130 msgr2=0x7f7fdc0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.894+0000 7f7fe45fd700 1 -- 172.21.15.177:0/1280665314 shutdown_connections 2023-11-27T17:48:13.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.894+0000 7f7fe45fd700 1 -- 172.21.15.177:0/1280665314 wait complete. 2023-11-27T17:48:13.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.895+0000 7f7fe45fd700 1 Processor -- start 2023-11-27T17:48:13.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.895+0000 7f7fe45fd700 1 -- start start 2023-11-27T17:48:13.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.895+0000 7f7fe45fd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fdc06d910 0x7f7fdc0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.895+0000 7f7fe45fd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fdc06dcf0 0x7f7fdc1f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.895+0000 7f7fe45fd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 0x7f7fdc15d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe45fd700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0ae610 con 0x7f7fdc06d910 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe45fd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0ada00 con 0x7f7fdc15e880 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe45fd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0adce0 con 0x7f7fdc06dcf0 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fdc06d910 0x7f7fdc0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fdc06d910 0x7f7fdc0cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51268/0 (socket says 172.21.15.177:51268) 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 -- 172.21.15.177:0/3121084190 learned_addr learned my addr 172.21.15.177:0/3121084190 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2b9a700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 0x7f7fdc15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe1b98700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fdc06dcf0 0x7f7fdc1f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 -- 172.21.15.177:0/3121084190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fdc06dcf0 msgr2=0x7f7fdc1f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fdc06dcf0 0x7f7fdc1f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 -- 172.21.15.177:0/3121084190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 msgr2=0x7f7fdc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:13.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 0x7f7fdc15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 -- 172.21.15.177:0/3121084190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd80094a0 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe2399700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fdc06d910 0x7f7fdc0cf3b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c520 tx=0x7f7fcc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fd2ffd700 1 -- 172.21.15.177:0/3121084190 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0052d0 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fd2ffd700 1 -- 172.21.15.177:0/3121084190 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc005430 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc0adfc0 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fd2ffd700 1 -- 172.21.15.177:0/3121084190 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0038c0 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.896+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc1f4450 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.897+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc073aa0 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.898+0000 7f7fd2ffd700 1 -- 172.21.15.177:0/3121084190 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7fcc003a20 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.898+0000 7f7fd2ffd700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fc006b250 0x7f7fc006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.898+0000 7f7fd2ffd700 1 -- 172.21.15.177:0/3121084190 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7fcc088b60 con 0x7f7fdc06d910 2023-11-27T17:48:13.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.898+0000 7f7fe1b98700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fc006b250 0x7f7fc006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:13.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.899+0000 7f7fe1b98700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fc006b250 0x7f7fc006d710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80090b0 tx=0x7f7fd8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:13.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:13.903+0000 7f7fd2ffd700 1 -- 172.21.15.177:0/3121084190 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7fcc053b60 con 0x7f7fdc06d910 2023-11-27T17:48:14.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.098+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7fdc069400 con 0x7f7fdc06d910 2023-11-27T17:48:14.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.099+0000 7f7fd2ffd700 1 -- 172.21.15.177:0/3121084190 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7fcc057180 con 0x7f7fdc06d910 2023-11-27T17:48:14.101 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:14.101 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-11-27T17:48:14.102 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:48:14.102 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-11-27T17:48:14.102 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-11-27T17:48:14.102 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:48:14.102 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fc006b250 msgr2=0x7f7fc006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fc006b250 0x7f7fc006d710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80090b0 tx=0x7f7fd8008030 comp rx=0 tx=0).stop 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fdc06d910 msgr2=0x7f7fdc0cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fdc06d910 0x7f7fdc0cf3b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c520 tx=0x7f7fcc00c830 comp rx=0 tx=0).stop 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 shutdown_connections 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fc006b250 0x7f7fc006d710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fdc15e880 0x7f7fdc15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fdc06d910 0x7f7fdc0cf3b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 --2- 172.21.15.177:0/3121084190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fdc06dcf0 0x7f7fdc1f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 >> 172.21.15.177:0/3121084190 conn(0x7f7fdc0b2130 msgr2=0x7f7fdc159c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:14.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 shutdown_connections 2023-11-27T17:48:14.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.101+0000 7f7fe45fd700 1 -- 172.21.15.177:0/3121084190 wait complete. 2023-11-27T17:48:14.115 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T17:48:14.116 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T17:48:14.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.239+0000 7feddc6f5700 1 Processor -- start 2023-11-27T17:48:14.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.239+0000 7feddc6f5700 1 -- start start 2023-11-27T17:48:14.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.240+0000 7feddc6f5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd4147b10 0x7fedd40b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:14.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.240+0000 7feddc6f5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fedd4072a60 0x7fedd40b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:14.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.240+0000 7feddc6f5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40b6440 con 0x7fedd40b6f50 2023-11-27T17:48:14.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.240+0000 7feddc6f5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd40b5ae0 con 0x7fedd4072a60 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.240+0000 7feddc6f5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40b7cf0 con 0x7fedd4147b10 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedda491700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd4147b10 0x7fedd40b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7feddac92700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fedd4072a60 0x7fedd40b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedd9c90700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fedd40b6f50 0x7fedd4072350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:44574/0 (socket says 172.21.15.177:44574) 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedd9c90700 1 -- 172.21.15.177:0/3313198476 learned_addr learned my addr 172.21.15.177:0/3313198476 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedd948f700 1 -- 172.21.15.177:0/3313198476 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378611099 0 0) 0x7fedd0001110 con 0x7fedd40b6f50 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedd948f700 1 -- 172.21.15.177:0/3313198476 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc00035b0 con 0x7fedd40b6f50 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedda491700 1 -- 172.21.15.177:0/3313198476 >> v2:172.21.15.178:3300/0 conn(0x7fedd4072a60 msgr2=0x7fedd40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedda491700 1 --2- 172.21.15.177:0/3313198476 >> v2:172.21.15.178:3300/0 conn(0x7fedd4072a60 0x7fedd40b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedda491700 1 -- 172.21.15.177:0/3313198476 >> v1:172.21.15.178:6789/0 conn(0x7fedd40b6f50 legacy=0x7fedd4072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedda491700 1 -- 172.21.15.177:0/3313198476 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40b51d0 con 0x7fedd4147b10 2023-11-27T17:48:14.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7feddac92700 1 --2- 172.21.15.177:0/3313198476 >> v2:172.21.15.178:3300/0 conn(0x7fedd4072a60 0x7fedd40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedda491700 1 --2- 172.21.15.177:0/3313198476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd4147b10 0x7fedd40b5f00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009840 tx=0x7fedc4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418effce203da564 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedd948f700 1 -- 172.21.15.177:0/3313198476 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011830 con 0x7fedd4147b10 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedd948f700 1 -- 172.21.15.177:0/3313198476 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4011990 con 0x7fedd4147b10 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.241+0000 7fedd948f700 1 -- 172.21.15.177:0/3313198476 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011d20 con 0x7fedd4147b10 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.242+0000 7feddc6f5700 1 -- 172.21.15.177:0/3313198476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd4147b10 msgr2=0x7fedd40b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.242+0000 7feddc6f5700 1 --2- 172.21.15.177:0/3313198476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd4147b10 0x7fedd40b5f00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009840 tx=0x7fedc4009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.242+0000 7feddc6f5700 1 -- 172.21.15.177:0/3313198476 shutdown_connections 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.242+0000 7feddc6f5700 1 --2- 172.21.15.177:0/3313198476 >> v2:172.21.15.178:3300/0 conn(0x7fedd4072a60 0x7fedd40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.242+0000 7feddc6f5700 1 --2- 172.21.15.177:0/3313198476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd4147b10 0x7fedd40b5f00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.242+0000 7feddc6f5700 1 -- 172.21.15.177:0/3313198476 >> 172.21.15.177:0/3313198476 conn(0x7fedd40b3240 msgr2=0x7fedd40b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.242+0000 7feddc6f5700 1 -- 172.21.15.177:0/3313198476 shutdown_connections 2023-11-27T17:48:14.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.242+0000 7feddc6f5700 1 -- 172.21.15.177:0/3313198476 wait complete. 2023-11-27T17:48:14.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.243+0000 7feddc6f5700 1 Processor -- start 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.243+0000 7feddc6f5700 1 -- start start 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7feddc6f5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd4072a60 0x7fedd415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7feddc6f5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd40b6f50 0x7fedd40cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7feddc6f5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedd4147b10 0x7fedd40cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7feddc6f5700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd415e000 con 0x7fedd4072a60 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7feddc6f5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd415f820 con 0x7fedd4147b10 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7feddc6f5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd415fb00 con 0x7fedd40b6f50 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd4072a60 0x7fedd415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:14.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd4072a60 0x7fedd415dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51280/0 (socket says 172.21.15.177:51280) 2023-11-27T17:48:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 -- 172.21.15.177:0/2954075412 learned_addr learned my addr 172.21.15.177:0/2954075412 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedd9c90700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd40b6f50 0x7fedd40cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7feddac92700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedd4147b10 0x7fedd40cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:14.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 -- 172.21.15.177:0/2954075412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd40b6f50 msgr2=0x7fedd40cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:14.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd40b6f50 0x7fedd40cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 -- 172.21.15.177:0/2954075412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedd4147b10 msgr2=0x7fedd40cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedd4147b10 0x7fedd40cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 -- 172.21.15.177:0/2954075412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009a70 con 0x7fedd4072a60 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.244+0000 7fedda491700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd4072a60 0x7fedd415dac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fedc40090b0 tx=0x7fedc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.245+0000 7fedcaffd700 1 -- 172.21.15.177:0/2954075412 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4004550 con 0x7fedd4072a60 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.245+0000 7fedcaffd700 1 -- 172.21.15.177:0/2954075412 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc401f070 con 0x7fedd4072a60 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.245+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc40094a0 con 0x7fedd4072a60 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.245+0000 7fedcaffd700 1 -- 172.21.15.177:0/2954075412 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40038c0 con 0x7fedd4072a60 2023-11-27T17:48:14.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.245+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd41600c0 con 0x7fedd4072a60 2023-11-27T17:48:14.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.246+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd4068450 con 0x7fedd4072a60 2023-11-27T17:48:14.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.246+0000 7fedcaffd700 1 -- 172.21.15.177:0/2954075412 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fedc4003a20 con 0x7fedd4072a60 2023-11-27T17:48:14.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.247+0000 7fedcaffd700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fedb806b250 0x7fedb806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:14.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.247+0000 7fedd9c90700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fedb806b250 0x7fedb806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:14.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.247+0000 7fedcaffd700 1 -- 172.21.15.177:0/2954075412 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fedc4021070 con 0x7fedd4072a60 2023-11-27T17:48:14.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.247+0000 7fedd9c90700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fedb806b250 0x7fedb806d710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fedd0007fd0 tx=0x7fedd0007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:14.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.251+0000 7fedcaffd700 1 -- 172.21.15.177:0/2954075412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fedc4055f60 con 0x7fedd4072a60 2023-11-27T17:48:14.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:14.440+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fedd404f7b0 con 0x7fedd4072a60 2023-11-27T17:48:15.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.156+0000 7fedcaffd700 1 -- 172.21.15.177:0/2954075412 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fedc4059580 con 0x7fedd4072a60 2023-11-27T17:48:15.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.159+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fedb806b250 msgr2=0x7fedb806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:15.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.159+0000 7feddc6f5700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fedb806b250 0x7fedb806d710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fedd0007fd0 tx=0x7fedd0007c40 comp rx=0 tx=0).stop 2023-11-27T17:48:15.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.159+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd4072a60 msgr2=0x7fedd415dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:15.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.159+0000 7feddc6f5700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd4072a60 0x7fedd415dac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fedc40090b0 tx=0x7fedc4004750 comp rx=0 tx=0).stop 2023-11-27T17:48:15.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.161+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 shutdown_connections 2023-11-27T17:48:15.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.161+0000 7feddc6f5700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fedb806b250 0x7fedb806d710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.161+0000 7feddc6f5700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedd4147b10 0x7fedd40cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.161+0000 7feddc6f5700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedd4072a60 0x7fedd415dac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.161+0000 7feddc6f5700 1 --2- 172.21.15.177:0/2954075412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedd40b6f50 0x7fedd40cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.161+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 >> 172.21.15.177:0/2954075412 conn(0x7fedd40b3240 msgr2=0x7fedd40cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:15.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.162+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 shutdown_connections 2023-11-27T17:48:15.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.162+0000 7feddc6f5700 1 -- 172.21.15.177:0/2954075412 wait complete. 2023-11-27T17:48:15.168 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-11-27T17:48:15.181 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T17:48:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.311+0000 7fab023a6700 1 Processor -- start 2023-11-27T17:48:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.311+0000 7fab023a6700 1 -- start start 2023-11-27T17:48:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7fab023a6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faafc161dc0 0x7faafc162250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7fab023a6700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc141600 con 0x7faafc141220 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7fab023a6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc0aeb50 con 0x7faafc0708d0 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7fab023a6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc0728a0 con 0x7faafc161dc0 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafbfff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7faafc141220 0x7faafc0ae090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45606/0 (socket says 172.21.15.177:45606) 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafbfff700 1 -- 172.21.15.177:0/1434929471 learned_addr learned my addr 172.21.15.177:0/1434929471 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162212607 0 0) 0x7faaf0001110 con 0x7faafc141220 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae40035b0 con 0x7faafc141220 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafb7fe700 1 --2- 172.21.15.177:0/1434929471 >> v2:172.21.15.178:3300/0 conn(0x7faafc161dc0 0x7faafc162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595130550 0 0) 0x7faae40035b0 con 0x7faafc141220 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 >> v2:172.21.15.178:3300/0 conn(0x7faafc161dc0 msgr2=0x7faafc162250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 --2- 172.21.15.177:0/1434929471 >> v2:172.21.15.178:3300/0 conn(0x7faafc161dc0 0x7faafc162250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 >> v1:172.21.15.178:6789/0 conn(0x7faafc0708d0 legacy=0x7faafc070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0aee30 con 0x7faafc141220 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7faaf0001800 con 0x7faafc141220 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.312+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 >> v1:172.21.15.177:6789/0 conn(0x7faafc141220 legacy=0x7faafc0ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faae4003a00 0x7faae4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faae4004850 0x7faae4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4005210 0x7faae400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0728a0 con 0x7faae4003a00 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae400c0b0 con 0x7faae4004850 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae400c270 con 0x7faae4005210 2023-11-27T17:48:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafbfff700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faae4003a00 0x7faae4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafb7fe700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faae4004850 0x7faae4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7fab00943700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4005210 0x7faae400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafbfff700 1 -- 172.21.15.177:0/1434929471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4005210 msgr2=0x7faae400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafbfff700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4005210 0x7faae400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafbfff700 1 -- 172.21.15.177:0/1434929471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faae4004850 msgr2=0x7faae4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafbfff700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faae4004850 0x7faae4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafbfff700 1 -- 172.21.15.177:0/1434929471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40035b0 con 0x7faae4003a00 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7fab00943700 1 -- 172.21.15.177:0/1434929471 reap_dead start 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafbfff700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faae4003a00 0x7faae4003e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c240 tx=0x7faae4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9838715be2554047 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0007db0 con 0x7faae4003a00 2023-11-27T17:48:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf000cde0 con 0x7faae4003a00 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.313+0000 7faafaffd700 1 -- 172.21.15.177:0/1434929471 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0005b80 con 0x7faae4003a00 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.314+0000 7fab023a6700 1 -- 172.21.15.177:0/1434929471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faae4003a00 msgr2=0x7faae4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.314+0000 7fab023a6700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faae4003a00 0x7faae4003e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c240 tx=0x7faae4005880 comp rx=0 tx=0).stop 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.314+0000 7fab023a6700 1 -- 172.21.15.177:0/1434929471 shutdown_connections 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.314+0000 7fab023a6700 1 --2- 172.21.15.177:0/1434929471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faae4003a00 0x7faae4003e20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.314+0000 7fab023a6700 1 -- 172.21.15.177:0/1434929471 >> 172.21.15.177:0/1434929471 conn(0x7faafc0b1ff0 msgr2=0x7faafc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.314+0000 7fab023a6700 1 -- 172.21.15.177:0/1434929471 shutdown_connections 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.314+0000 7fab023a6700 1 -- 172.21.15.177:0/1434929471 wait complete. 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.315+0000 7fab023a6700 1 Processor -- start 2023-11-27T17:48:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.315+0000 7fab023a6700 1 -- start start 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab023a6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4003a00 0x7faafc154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab023a6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faafc13f520 0x7faafc156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab023a6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faafc157340 0x7faafc158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab023a6700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc158340 con 0x7faafc13f520 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab023a6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc142fe0 con 0x7faafc157340 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab023a6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc157cf0 con 0x7faae4003a00 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faafc13f520 0x7faafc156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faafc13f520 0x7faafc156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51302/0 (socket says 172.21.15.177:51302) 2023-11-27T17:48:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 -- 172.21.15.177:0/3138881703 learned_addr learned my addr 172.21.15.177:0/3138881703 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafbfff700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4003a00 0x7faafc154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab00943700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faafc157340 0x7faafc158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 -- 172.21.15.177:0/3138881703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4003a00 msgr2=0x7faafc154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4003a00 0x7faafc154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 -- 172.21.15.177:0/3138881703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faafc157340 msgr2=0x7faafc158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faafc157340 0x7faafc158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 -- 172.21.15.177:0/3138881703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc157fd0 con 0x7faafc13f520 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faafb7fe700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faafc13f520 0x7faafc156e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faaec011aa0 tx=0x7faaec011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faaf8ff9700 1 -- 172.21.15.177:0/3138881703 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00f940 con 0x7faafc13f520 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faaf8ff9700 1 -- 172.21.15.177:0/3138881703 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec00faa0 con 0x7faafc13f520 2023-11-27T17:48:15.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc1577c0 con 0x7faafc13f520 2023-11-27T17:48:15.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7faaf8ff9700 1 -- 172.21.15.177:0/3138881703 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00fe50 con 0x7faafc13f520 2023-11-27T17:48:15.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.316+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc159500 con 0x7faafc13f520 2023-11-27T17:48:15.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.317+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc073aa0 con 0x7faafc13f520 2023-11-27T17:48:15.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.318+0000 7faaf8ff9700 1 -- 172.21.15.177:0/3138881703 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faaec014440 con 0x7faafc13f520 2023-11-27T17:48:15.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.318+0000 7faaf8ff9700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faae806b250 0x7faae806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:15.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.318+0000 7faafbfff700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faae806b250 0x7faae806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:15.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.318+0000 7faaf8ff9700 1 -- 172.21.15.177:0/3138881703 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7faaec089e50 con 0x7faafc13f520 2023-11-27T17:48:15.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.319+0000 7faafbfff700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faae806b250 0x7faae806d710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faaf0000c00 tx=0x7faaf0007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:15.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.323+0000 7faaf8ff9700 1 -- 172.21.15.177:0/3138881703 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faaec054d60 con 0x7faafc13f520 2023-11-27T17:48:15.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:15.514+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faafc069400 con 0x7faafc13f520 2023-11-27T17:48:16.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.162+0000 7faaf8ff9700 1 -- 172.21.15.177:0/3138881703 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7faaec058380 con 0x7faafc13f520 2023-11-27T17:48:16.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.166+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faae806b250 msgr2=0x7faae806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:16.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.166+0000 7fab023a6700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faae806b250 0x7faae806d710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faaf0000c00 tx=0x7faaf0007000 comp rx=0 tx=0).stop 2023-11-27T17:48:16.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.166+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faafc13f520 msgr2=0x7faafc156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:16.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.166+0000 7fab023a6700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faafc13f520 0x7faafc156e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faaec011aa0 tx=0x7faaec011db0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.167+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 shutdown_connections 2023-11-27T17:48:16.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.167+0000 7fab023a6700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faae806b250 0x7faae806d710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.167+0000 7fab023a6700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faafc157340 0x7faafc158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.167+0000 7fab023a6700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faae4003a00 0x7faafc154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.167+0000 7fab023a6700 1 --2- 172.21.15.177:0/3138881703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faafc13f520 0x7faafc156e00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.167+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 >> 172.21.15.177:0/3138881703 conn(0x7faafc0b1ff0 msgr2=0x7faafc15d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:16.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.167+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 shutdown_connections 2023-11-27T17:48:16.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.167+0000 7fab023a6700 1 -- 172.21.15.177:0/3138881703 wait complete. 2023-11-27T17:48:16.175 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-11-27T17:48:16.192 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T17:48:16.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.314+0000 7fb7c0b84700 1 Processor -- start 2023-11-27T17:48:16.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.314+0000 7fb7c0b84700 1 -- start start 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7c0b84700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc0cd560 0x7fb7bc15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7c0b84700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7bc15b070 0x7fb7bc0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7c0b84700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc15b8a0 con 0x7fb7bc13d250 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7c0b84700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cf110 con 0x7fb7bc15b070 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7c0b84700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cf3f0 con 0x7fb7bc0cd560 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7ba59c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb7bc13d250 0x7fb7bc0cce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45626/0 (socket says 172.21.15.177:45626) 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7ba59c700 1 -- 172.21.15.177:0/3399511953 learned_addr learned my addr 172.21.15.177:0/3399511953 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7b9d9b700 1 --2- 172.21.15.177:0/3399511953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc0cd560 0x7fb7bc15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7bad9d700 1 --2- 172.21.15.177:0/3399511953 >> v2:172.21.15.178:3300/0 conn(0x7fb7bc15b070 0x7fb7bc0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7b959a700 1 -- 172.21.15.177:0/3399511953 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772974565 0 0) 0x7fb7bc15b8a0 con 0x7fb7bc13d250 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7b959a700 1 -- 172.21.15.177:0/3399511953 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7a40035b0 con 0x7fb7bc13d250 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7b959a700 1 -- 172.21.15.177:0/3399511953 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4072305811 0 0) 0x7fb7a40035b0 con 0x7fb7bc13d250 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7b9d9b700 1 -- 172.21.15.177:0/3399511953 >> v2:172.21.15.178:3300/0 conn(0x7fb7bc15b070 msgr2=0x7fb7bc0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7b9d9b700 1 --2- 172.21.15.177:0/3399511953 >> v2:172.21.15.178:3300/0 conn(0x7fb7bc15b070 0x7fb7bc0714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7b9d9b700 1 -- 172.21.15.177:0/3399511953 >> v1:172.21.15.177:6789/0 conn(0x7fb7bc13d250 legacy=0x7fb7bc0cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7b9d9b700 1 -- 172.21.15.177:0/3399511953 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0cf6d0 con 0x7fb7bc0cd560 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.315+0000 7fb7bad9d700 1 --2- 172.21.15.177:0/3399511953 >> v2:172.21.15.178:3300/0 conn(0x7fb7bc15b070 0x7fb7bc0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7b9d9b700 1 --2- 172.21.15.177:0/3399511953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc0cd560 0x7fb7bc15ab30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009840 tx=0x7fb7b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe980dcfe7094569 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7b959a700 1 -- 172.21.15.177:0/3399511953 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac001670 con 0x7fb7bc0cd560 2023-11-27T17:48:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7b959a700 1 -- 172.21.15.177:0/3399511953 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b0004030 con 0x7fb7bc0cd560 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7b959a700 1 -- 172.21.15.177:0/3399511953 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b00043a0 con 0x7fb7bc0cd560 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7c0b84700 1 -- 172.21.15.177:0/3399511953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc0cd560 msgr2=0x7fb7bc15ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/3399511953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc0cd560 0x7fb7bc15ab30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009840 tx=0x7fb7b0009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7c0b84700 1 -- 172.21.15.177:0/3399511953 shutdown_connections 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/3399511953 >> v2:172.21.15.178:3300/0 conn(0x7fb7bc15b070 0x7fb7bc0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/3399511953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc0cd560 0x7fb7bc15ab30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7c0b84700 1 -- 172.21.15.177:0/3399511953 >> 172.21.15.177:0/3399511953 conn(0x7fb7bc0b1d50 msgr2=0x7fb7bc0b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7c0b84700 1 -- 172.21.15.177:0/3399511953 shutdown_connections 2023-11-27T17:48:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.316+0000 7fb7c0b84700 1 -- 172.21.15.177:0/3399511953 wait complete. 2023-11-27T17:48:16.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7c0b84700 1 Processor -- start 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7c0b84700 1 -- start start 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7c0b84700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7bc0cd560 0x7fb7bc072850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7c0b84700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc13d250 0x7fb7bc14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7c0b84700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc15b070 0x7fb7bc14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7c0b84700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc14f3b0 con 0x7fb7bc13d250 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7c0b84700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc13f070 con 0x7fb7bc0cd560 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7c0b84700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc150150 con 0x7fb7bc15b070 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.318+0000 7fb7b9d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc13d250 0x7fb7bc14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7b9d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc13d250 0x7fb7bc14fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51316/0 (socket says 172.21.15.177:51316) 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7b9d9b700 1 -- 172.21.15.177:0/324605776 learned_addr learned my addr 172.21.15.177:0/324605776 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7bad9d700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc15b070 0x7fb7bc14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7ba59c700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7bc0cd560 0x7fb7bc072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7b9d9b700 1 -- 172.21.15.177:0/324605776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc15b070 msgr2=0x7fb7bc14df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7b9d9b700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc15b070 0x7fb7bc14df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7b9d9b700 1 -- 172.21.15.177:0/324605776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7bc0cd560 msgr2=0x7fb7bc072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7b9d9b700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7bc0cd560 0x7fb7bc072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7b9d9b700 1 -- 172.21.15.177:0/324605776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b400ab80 con 0x7fb7bc13d250 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7b9d9b700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc13d250 0x7fb7bc14fc10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009b90 tx=0x7fb7b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7aaffd700 1 -- 172.21.15.177:0/324605776 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0003ea0 con 0x7fb7bc13d250 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7aaffd700 1 -- 172.21.15.177:0/324605776 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b001f070 con 0x7fb7bc13d250 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7aaffd700 1 -- 172.21.15.177:0/324605776 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0011850 con 0x7fb7bc13d250 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b00094a0 con 0x7fb7bc13d250 2023-11-27T17:48:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.319+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc14f0d0 con 0x7fb7bc13d250 2023-11-27T17:48:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.320+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc069400 con 0x7fb7bc13d250 2023-11-27T17:48:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.320+0000 7fb7aaffd700 1 -- 172.21.15.177:0/324605776 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb7b00119b0 con 0x7fb7bc13d250 2023-11-27T17:48:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.321+0000 7fb7aaffd700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb79c06b250 0x7fb79c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.321+0000 7fb7aaffd700 1 -- 172.21.15.177:0/324605776 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb7b0021070 con 0x7fb7bc13d250 2023-11-27T17:48:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.321+0000 7fb7ba59c700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb79c06b250 0x7fb79c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.321+0000 7fb7ba59c700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb79c06b250 0x7fb79c06d710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac001eb0 tx=0x7fb7ac001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.326+0000 7fb7aaffd700 1 -- 172.21.15.177:0/324605776 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb7b0055f40 con 0x7fb7bc13d250 2023-11-27T17:48:16.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:16.561+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb7bc06d550 con 0x7fb7bc13d250 2023-11-27T17:48:17.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.172+0000 7fb7aaffd700 1 -- 172.21.15.177:0/324605776 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb7b002b0c0 con 0x7fb7bc13d250 2023-11-27T17:48:17.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.179+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb79c06b250 msgr2=0x7fb79c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.179+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb79c06b250 0x7fb79c06d710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac001eb0 tx=0x7fb7ac001e40 comp rx=0 tx=0).stop 2023-11-27T17:48:17.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.179+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc13d250 msgr2=0x7fb7bc14fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.179+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc13d250 0x7fb7bc14fc10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009b90 tx=0x7fb7b0004750 comp rx=0 tx=0).stop 2023-11-27T17:48:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.180+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 shutdown_connections 2023-11-27T17:48:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.180+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb79c06b250 0x7fb79c06d710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.180+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7bc15b070 0x7fb7bc14df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.180+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7bc0cd560 0x7fb7bc072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.180+0000 7fb7c0b84700 1 --2- 172.21.15.177:0/324605776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc13d250 0x7fb7bc14fc10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.180+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 >> 172.21.15.177:0/324605776 conn(0x7fb7bc0b1d50 msgr2=0x7fb7bc06f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.182+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 shutdown_connections 2023-11-27T17:48:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.182+0000 7fb7c0b84700 1 -- 172.21.15.177:0/324605776 wait complete. 2023-11-27T17:48:17.189 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 2 and data pool 3 2023-11-27T17:48:17.207 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:17.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.328+0000 7faf03085700 1 Processor -- start 2023-11-27T17:48:17.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.328+0000 7faf03085700 1 -- start start 2023-11-27T17:48:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faf03085700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faefc0b6170 0x7faefc0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faf03085700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc0b5ce0 con 0x7faefc0b6600 2023-11-27T17:48:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faf03085700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc0b5700 con 0x7faefc147880 2023-11-27T17:48:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faf03085700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc06e020 con 0x7faefc0b6170 2023-11-27T17:48:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faf01622700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7faefc0b6600 0x7faefc15f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45644/0 (socket says 172.21.15.177:45644) 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faf01622700 1 -- 172.21.15.177:0/3448555283 learned_addr learned my addr 172.21.15.177:0/3448555283 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefbfff700 1 --2- 172.21.15.177:0/3448555283 >> v2:172.21.15.178:3300/0 conn(0x7faefc0b6170 0x7faefc0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193739759 0 0) 0x7faefc0b5ce0 con 0x7faefc0b6600 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeec0035b0 con 0x7faefc0b6600 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637069993 0 0) 0x7faeec0035b0 con 0x7faefc0b6600 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 >> v2:172.21.15.178:3300/0 conn(0x7faefc0b6170 msgr2=0x7faefc0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 --2- 172.21.15.177:0/3448555283 >> v2:172.21.15.178:3300/0 conn(0x7faefc0b6170 0x7faefc0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 >> v1:172.21.15.178:6789/0 conn(0x7faefc147880 legacy=0x7faefc06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc06e230 con 0x7faefc0b6600 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7faef40019f0 con 0x7faefc0b6600 2023-11-27T17:48:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefbfff700 1 --2- 172.21.15.177:0/3448555283 >> v2:172.21.15.178:3300/0 conn(0x7faefc0b6170 0x7faefc0704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 >> v1:172.21.15.177:6789/0 conn(0x7faefc0b6600 legacy=0x7faefc15f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec003a00 0x7faeec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeec004850 0x7faeec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.329+0000 7faefb7fe700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faeec005210 0x7faeec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc06e020 con 0x7faeec004850 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec00c0b0 con 0x7faeec003a00 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec00c270 con 0x7faeec005210 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefbfff700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeec004850 0x7faeec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faf00e21700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec003a00 0x7faeec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faf01622700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faeec005210 0x7faeec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefbfff700 1 -- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faeec005210 msgr2=0x7faeec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefbfff700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faeec005210 0x7faeec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefbfff700 1 -- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec003a00 msgr2=0x7faeec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefbfff700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec003a00 0x7faeec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefbfff700 1 -- 172.21.15.177:0/3448555283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0035b0 con 0x7faeec004850 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faf01622700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faeec005210 0x7faeec00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faf01622700 1 -- 172.21.15.177:0/3448555283 reap_dead start 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefbfff700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeec004850 0x7faeec004cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faee8009d30 tx=0x7faeec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8e534f41c682d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8009e80 con 0x7faeec004850 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee800e9a0 con 0x7faeec004850 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.330+0000 7faefb7fe700 1 -- 172.21.15.177:0/3448555283 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee800ed10 con 0x7faeec004850 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.331+0000 7faf03085700 1 -- 172.21.15.177:0/3448555283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeec004850 msgr2=0x7faeec004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.331+0000 7faf03085700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeec004850 0x7faeec004cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faee8009d30 tx=0x7faeec005880 comp rx=0 tx=0).stop 2023-11-27T17:48:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.331+0000 7faf03085700 1 -- 172.21.15.177:0/3448555283 shutdown_connections 2023-11-27T17:48:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.331+0000 7faf03085700 1 --2- 172.21.15.177:0/3448555283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeec004850 0x7faeec004cd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.331+0000 7faf03085700 1 -- 172.21.15.177:0/3448555283 >> 172.21.15.177:0/3448555283 conn(0x7faefc0b2130 msgr2=0x7faefc0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.331+0000 7faf03085700 1 -- 172.21.15.177:0/3448555283 shutdown_connections 2023-11-27T17:48:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.331+0000 7faf03085700 1 -- 172.21.15.177:0/3448555283 wait complete. 2023-11-27T17:48:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.332+0000 7faf03085700 1 Processor -- start 2023-11-27T17:48:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.332+0000 7faf03085700 1 -- start start 2023-11-27T17:48:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf03085700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec004850 0x7faefc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf03085700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faefc0c5ee0 0x7faefc0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf03085700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faefc0c8920 0x7faefc0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf03085700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0c6ff0 con 0x7faefc0c5ee0 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf03085700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0c9310 con 0x7faeec004850 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf03085700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc139200 con 0x7faefc0c8920 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faefc0c5ee0 0x7faefc0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faefc0c5ee0 0x7faefc0aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51336/0 (socket says 172.21.15.177:51336) 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 -- 172.21.15.177:0/701393514 learned_addr learned my addr 172.21.15.177:0/701393514 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf01622700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faefc0c8920 0x7faefc0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf00e21700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec004850 0x7faefc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 -- 172.21.15.177:0/701393514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faefc0c8920 msgr2=0x7faefc0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faefc0c8920 0x7faefc0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 -- 172.21.15.177:0/701393514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec004850 msgr2=0x7faefc138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec004850 0x7faefc138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 -- 172.21.15.177:0/701393514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0c6370 con 0x7faefc0c5ee0 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faefbfff700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faefc0c5ee0 0x7faefc0aebd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faee80090b0 tx=0x7faee8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faef97fa700 1 -- 172.21.15.177:0/701393514 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8009e80 con 0x7faefc0c5ee0 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faef97fa700 1 -- 172.21.15.177:0/701393514 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee8013d80 con 0x7faefc0c5ee0 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faef97fa700 1 -- 172.21.15.177:0/701393514 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee801c690 con 0x7faefc0c5ee0 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc0c6650 con 0x7faefc0c5ee0 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.333+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc0c6c10 con 0x7faefc0c5ee0 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.334+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc0c6dd0 con 0x7faefc0c5ee0 2023-11-27T17:48:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.335+0000 7faef97fa700 1 -- 172.21.15.177:0/701393514 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faee801c7f0 con 0x7faefc0c5ee0 2023-11-27T17:48:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.335+0000 7faef97fa700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faee006b250 0x7faee006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.335+0000 7faef97fa700 1 -- 172.21.15.177:0/701393514 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faee808b130 con 0x7faefc0c5ee0 2023-11-27T17:48:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.335+0000 7faf00e21700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faee006b250 0x7faee006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.335+0000 7faf00e21700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faee006b250 0x7faee006d710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faef0007fd0 tx=0x7faef0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.339+0000 7faef97fa700 1 -- 172.21.15.177:0/701393514 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faee8055ef0 con 0x7faefc0c5ee0 2023-11-27T17:48:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.531+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faefc162bb0 con 0x7faefc0c5ee0 2023-11-27T17:48:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.533+0000 7faef97fa700 1 -- 172.21.15.177:0/701393514 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16555 (secure 0 0 0) 0x7faee8059510 con 0x7faefc0c5ee0 2023-11-27T17:48:17.535 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:17.535 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:16.563531+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:17.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faee006b250 msgr2=0x7faee006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faee006b250 0x7faee006d710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faef0007fd0 tx=0x7faef0009040 comp rx=0 tx=0).stop 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faefc0c5ee0 msgr2=0x7faefc0aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faefc0c5ee0 0x7faefc0aebd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faee80090b0 tx=0x7faee8004750 comp rx=0 tx=0).stop 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 shutdown_connections 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7faee006b250 0x7faee006d710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faefc0c8920 0x7faefc0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faeec004850 0x7faefc138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 --2- 172.21.15.177:0/701393514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faefc0c5ee0 0x7faefc0aebd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 >> 172.21.15.177:0/701393514 conn(0x7faefc0b2130 msgr2=0x7faefc161f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 shutdown_connections 2023-11-27T17:48:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.535+0000 7faf03085700 1 -- 172.21.15.177:0/701393514 wait complete. 2023-11-27T17:48:17.550 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.667+0000 7f5b217c3700 1 Processor -- start 2023-11-27T17:48:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.667+0000 7f5b217c3700 1 -- start start 2023-11-27T17:48:17.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b217c3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b1c0b2860 0x7f5b1c15fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b217c3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c160180 0x7f5b1c144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b217c3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c0d0f40 con 0x7f5b1c0cf3c0 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b217c3700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c1609e0 con 0x7f5b1c0b2860 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b217c3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0b7490 con 0x7f5b1c160180 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b1a7fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b1c0b2860 0x7f5b1c15fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b1a7fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b1c0b2860 0x7f5b1c15fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51344/0 (socket says 172.21.15.177:51344) 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b1affd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5b1c0cf3c0 0x7f5b1c0b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45660/0 (socket says 172.21.15.177:45660) 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b1a7fc700 1 -- 172.21.15.177:0/1584156851 learned_addr learned my addr 172.21.15.177:0/1584156851 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.668+0000 7f5b1b7fe700 1 --2- 172.21.15.177:0/1584156851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c160180 0x7f5b1c144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b1a7fc700 1 -- 172.21.15.177:0/1584156851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c160180 msgr2=0x7f5b1c144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:17.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b1a7fc700 1 --2- 172.21.15.177:0/1584156851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c160180 0x7f5b1c144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b1a7fc700 1 -- 172.21.15.177:0/1584156851 >> v1:172.21.15.177:6789/0 conn(0x7f5b1c0cf3c0 legacy=0x7f5b1c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b1a7fc700 1 -- 172.21.15.177:0/1584156851 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0d1220 con 0x7f5b1c0b2860 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b19ffb700 1 -- 172.21.15.177:0/1584156851 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741561696 0 0) 0x7f5b1c0d0f40 con 0x7f5b1c0cf3c0 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b1a7fc700 1 --2- 172.21.15.177:0/1584156851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c15fc40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0098f0 tx=0x7f5b0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd84397211c8d22 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b19ffb700 1 -- 172.21.15.177:0/1584156851 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00b8a0 con 0x7f5b1c0b2860 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b19ffb700 1 -- 172.21.15.177:0/1584156851 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00ba00 con 0x7f5b1c0b2860 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b19ffb700 1 -- 172.21.15.177:0/1584156851 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00bd90 con 0x7f5b1c0b2860 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b217c3700 1 -- 172.21.15.177:0/1584156851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 msgr2=0x7f5b1c15fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1584156851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c15fc40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0098f0 tx=0x7f5b0c009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b217c3700 1 -- 172.21.15.177:0/1584156851 shutdown_connections 2023-11-27T17:48:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1584156851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c160180 0x7f5b1c144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1584156851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c15fc40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.669+0000 7f5b217c3700 1 -- 172.21.15.177:0/1584156851 >> 172.21.15.177:0/1584156851 conn(0x7f5b1c072190 msgr2=0x7f5b1c0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.670+0000 7f5b217c3700 1 -- 172.21.15.177:0/1584156851 shutdown_connections 2023-11-27T17:48:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.670+0000 7f5b217c3700 1 -- 172.21.15.177:0/1584156851 wait complete. 2023-11-27T17:48:17.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.671+0000 7f5b217c3700 1 Processor -- start 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.671+0000 7f5b217c3700 1 -- start start 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.671+0000 7f5b217c3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.671+0000 7f5b217c3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c0cf3c0 0x7f5b1c155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b217c3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c160180 0x7f5b1c06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b217c3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c149dc0 con 0x7f5b1c0b2860 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b217c3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c156ba0 con 0x7f5b1c160180 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b217c3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c155f90 con 0x7f5b1c0cf3c0 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51348/0 (socket says 172.21.15.177:51348) 2023-11-27T17:48:17.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 -- 172.21.15.177:0/1064433998 learned_addr learned my addr 172.21.15.177:0/1064433998 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1a7fc700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c0cf3c0 0x7f5b1c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1b7fe700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c160180 0x7f5b1c06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 -- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c0cf3c0 msgr2=0x7f5b1c155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c0cf3c0 0x7f5b1c155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 -- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c160180 msgr2=0x7f5b1c06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c160180 0x7f5b1c06bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 -- 172.21.15.177:0/1064433998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c009550 con 0x7f5b1c0b2860 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1b7fe700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c160180 0x7f5b1c06bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b1affd700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c149880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b100011e0 tx=0x7f5b1000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b037fe700 1 -- 172.21.15.177:0/1064433998 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10004c80 con 0x7f5b1c0b2860 2023-11-27T17:48:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b037fe700 1 -- 172.21.15.177:0/1064433998 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b10004de0 con 0x7f5b1c0b2860 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c156270 con 0x7f5b1c0b2860 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b037fe700 1 -- 172.21.15.177:0/1064433998 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10007310 con 0x7f5b1c0b2860 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.672+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c156830 con 0x7f5b1c0b2860 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.673+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c156e80 con 0x7f5b1c0b2860 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.673+0000 7f5b037fe700 1 -- 172.21.15.177:0/1064433998 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5b10007470 con 0x7f5b1c0b2860 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.674+0000 7f5b037fe700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b0806b250 0x7f5b0806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.674+0000 7f5b037fe700 1 -- 172.21.15.177:0/1064433998 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b10089760 con 0x7f5b1c0b2860 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.674+0000 7f5b1a7fc700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b0806b250 0x7f5b0806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.674+0000 7f5b1a7fc700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b0806b250 0x7f5b0806d710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009c40 tx=0x7f5b0c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.678+0000 7f5b037fe700 1 -- 172.21.15.177:0/1064433998 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5b10054490 con 0x7f5b1c0b2860 2023-11-27T17:48:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.868+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b1c073aa0 con 0x7f5b1c0b2860 2023-11-27T17:48:17.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.869+0000 7f5b037fe700 1 -- 172.21.15.177:0/1064433998 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16555 (secure 0 0 0) 0x7f5b10057ab0 con 0x7f5b1c0b2860 2023-11-27T17:48:17.872 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:17.872 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:16.563531+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:17.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b0806b250 msgr2=0x7f5b0806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b0806b250 0x7f5b0806d710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009c40 tx=0x7f5b0c008030 comp rx=0 tx=0).stop 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 msgr2=0x7f5b1c149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c149880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b100011e0 tx=0x7f5b1000ca30 comp rx=0 tx=0).stop 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 shutdown_connections 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b0806b250 0x7f5b0806d710 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c160180 0x7f5b1c06bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c0b2860 0x7f5b1c149880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 --2- 172.21.15.177:0/1064433998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c0cf3c0 0x7f5b1c155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.871+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 >> 172.21.15.177:0/1064433998 conn(0x7f5b1c072190 msgr2=0x7f5b1c06e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.872+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 shutdown_connections 2023-11-27T17:48:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:17.872+0000 7f5b217c3700 1 -- 172.21.15.177:0/1064433998 wait complete. 2023-11-27T17:48:17.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T17:48:18.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.007+0000 7fed34061700 1 Processor -- start 2023-11-27T17:48:18.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.007+0000 7fed34061700 1 -- start start 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed34061700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c072950 0x7fed2c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed34061700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c0d0630 con 0x7fed2c1626e0 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed34061700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c162b90 con 0x7fed2c1479a0 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed34061700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c147d80 con 0x7fed2c072950 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed325fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fed2c1626e0 0x7fed2c0d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45678/0 (socket says 172.21.15.177:45678) 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed325fe700 1 -- 172.21.15.177:0/3850340770 learned_addr learned my addr 172.21.15.177:0/3850340770 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed315fc700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c072950 0x7fed2c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589093511 0 0) 0x7fed2c0d0630 con 0x7fed2c1626e0 2023-11-27T17:48:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed180035b0 con 0x7fed2c1626e0 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 996348691 0 0) 0x7fed180035b0 con 0x7fed2c1626e0 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c072950 msgr2=0x7fed2c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c072950 0x7fed2c06aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 >> v1:172.21.15.178:6789/0 conn(0x7fed2c1479a0 legacy=0x7fed2c072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c06b9b0 con 0x7fed2c1626e0 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fed240019f0 con 0x7fed2c1626e0 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.008+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 >> v1:172.21.15.177:6789/0 conn(0x7fed2c1626e0 legacy=0x7fed2c0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed18003a30 0x7fed18003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c072950 0x7fed18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:18.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed18005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c147d80 con 0x7fed18004d90 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1800bb40 con 0x7fed18003a30 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1800bd00 con 0x7fed2c072950 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed325fe700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed18005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed31dfd700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed18003a30 0x7fed18003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed315fc700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c072950 0x7fed18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed325fe700 1 -- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c072950 msgr2=0x7fed18004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed325fe700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c072950 0x7fed18004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed325fe700 1 -- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed18003a30 msgr2=0x7fed18003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed325fe700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed18003a30 0x7fed18003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:18.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed325fe700 1 -- 172.21.15.177:0/3850340770 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180035b0 con 0x7fed18004d90 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed325fe700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed18005210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed2400a820 tx=0x7fed18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9864cabda38357 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400a2f0 con 0x7fed18004d90 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24012600 con 0x7fed18004d90 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.009+0000 7fed30dfb700 1 -- 172.21.15.177:0/3850340770 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240129b0 con 0x7fed18004d90 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.010+0000 7fed34061700 1 -- 172.21.15.177:0/3850340770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 msgr2=0x7fed18005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.010+0000 7fed34061700 1 --2- 172.21.15.177:0/3850340770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed18005210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed2400a820 tx=0x7fed18005880 comp rx=0 tx=0).stop 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.010+0000 7fed325fe700 1 -- 172.21.15.177:0/3850340770 reap_dead start 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.010+0000 7fed34061700 1 -- 172.21.15.177:0/3850340770 shutdown_connections 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.010+0000 7fed34061700 1 -- 172.21.15.177:0/3850340770 >> 172.21.15.177:0/3850340770 conn(0x7fed2c0b3160 msgr2=0x7fed2c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.010+0000 7fed34061700 1 -- 172.21.15.177:0/3850340770 shutdown_connections 2023-11-27T17:48:18.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.010+0000 7fed34061700 1 -- 172.21.15.177:0/3850340770 wait complete. 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.011+0000 7fed34061700 1 Processor -- start 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.011+0000 7fed34061700 1 -- start start 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed34061700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed2c0aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed34061700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cca10 0x7fed2c15da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed34061700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c1f4000 0x7fed2c1f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed34061700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0cd1f0 con 0x7fed18004d90 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed34061700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0cd4d0 con 0x7fed2c1f4000 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed34061700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c0cd7b0 con 0x7fed2c0cca10 2023-11-27T17:48:18.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed2c0aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed2c0aa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51368/0 (socket says 172.21.15.177:51368) 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 -- 172.21.15.177:0/2215515395 learned_addr learned my addr 172.21.15.177:0/2215515395 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 -- 172.21.15.177:0/2215515395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cca10 msgr2=0x7fed2c15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cca10 0x7fed2c15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed325fe700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c1f4000 0x7fed2c1f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 -- 172.21.15.177:0/2215515395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c1f4000 msgr2=0x7fed2c1f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c1f4000 0x7fed2c1f4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 -- 172.21.15.177:0/2215515395 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c0cda90 con 0x7fed18004d90 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed31dfd700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed2c0aa190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed2800f7f0 tx=0x7fed2800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed227fc700 1 -- 172.21.15.177:0/2215515395 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed280052e0 con 0x7fed18004d90 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed227fc700 1 -- 172.21.15.177:0/2215515395 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed28005440 con 0x7fed18004d90 2023-11-27T17:48:18.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c0cdd70 con 0x7fed18004d90 2023-11-27T17:48:18.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed227fc700 1 -- 172.21.15.177:0/2215515395 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed280038c0 con 0x7fed18004d90 2023-11-27T17:48:18.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.012+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c15dfd0 con 0x7fed18004d90 2023-11-27T17:48:18.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.013+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c06cfa0 con 0x7fed18004d90 2023-11-27T17:48:18.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.014+0000 7fed227fc700 1 -- 172.21.15.177:0/2215515395 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fed28003a20 con 0x7fed18004d90 2023-11-27T17:48:18.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.014+0000 7fed227fc700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed1006b250 0x7fed1006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:18.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.014+0000 7fed315fc700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed1006b250 0x7fed1006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:18.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.014+0000 7fed227fc700 1 -- 172.21.15.177:0/2215515395 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed28089790 con 0x7fed18004d90 2023-11-27T17:48:18.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.015+0000 7fed315fc700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed1006b250 0x7fed1006d710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009b50 tx=0x7fed1c009670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:18.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.019+0000 7fed227fc700 1 -- 172.21.15.177:0/2215515395 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fed28054550 con 0x7fed18004d90 2023-11-27T17:48:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:18.257+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fed2c0cdf60 con 0x7fed18004d90 2023-11-27T17:48:19.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.182+0000 7fed227fc700 1 -- 172.21.15.177:0/2215515395 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fed28057b70 con 0x7fed18004d90 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed1006b250 msgr2=0x7fed1006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed1006b250 0x7fed1006d710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009b50 tx=0x7fed1c009670 comp rx=0 tx=0).stop 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 msgr2=0x7fed2c0aa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed2c0aa190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed2800f7f0 tx=0x7fed2800fbb0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 shutdown_connections 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed1006b250 0x7fed1006d710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c1f4000 0x7fed2c1f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed18004d90 0x7fed2c0aa190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 --2- 172.21.15.177:0/2215515395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cca10 0x7fed2c15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 >> 172.21.15.177:0/2215515395 conn(0x7fed2c0b3160 msgr2=0x7fed2c0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:19.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 shutdown_connections 2023-11-27T17:48:19.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.185+0000 7fed34061700 1 -- 172.21.15.177:0/2215515395 wait complete. 2023-11-27T17:48:19.202 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T17:48:19.202 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T17:48:19.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.329+0000 7fad0fe02700 1 Processor -- start 2023-11-27T17:48:19.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.329+0000 7fad0fe02700 1 -- start start 2023-11-27T17:48:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0fe02700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0fe02700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad080cd850 0x7fad080cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0fe02700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080ce1e0 con 0x7fad0815b3d0 2023-11-27T17:48:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0fe02700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080afe30 con 0x7fad080cd850 2023-11-27T17:48:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0fe02700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815b870 con 0x7fad080afa50 2023-11-27T17:48:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0d39d700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fad0815b3d0 0x7fad0815e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45694/0 (socket says 172.21.15.177:45694) 2023-11-27T17:48:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0d39d700 1 -- 172.21.15.177:0/2294581041 learned_addr learned my addr 172.21.15.177:0/2294581041 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:19.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0e39f700 1 --2- 172.21.15.177:0/2294581041 >> v2:172.21.15.178:3300/0 conn(0x7fad080cd850 0x7fad080cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0db9e700 1 --2- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0cb9c700 1 -- 172.21.15.177:0/2294581041 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042091899 0 0) 0x7fad080ce1e0 con 0x7fad0815b3d0 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.330+0000 7fad0cb9c700 1 -- 172.21.15.177:0/2294581041 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf40035b0 con 0x7fad0815b3d0 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0e39f700 1 -- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 msgr2=0x7fad080b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0e39f700 1 --2- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0e39f700 1 -- 172.21.15.177:0/2294581041 >> v1:172.21.15.177:6789/0 conn(0x7fad0815b3d0 legacy=0x7fad0815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0e39f700 1 -- 172.21.15.177:0/2294581041 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0815bb50 con 0x7fad080cd850 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0db9e700 1 --2- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0e39f700 1 --2- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 0x7fad080cdca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad00009d90 tx=0x7fad0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17898bc230474785 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0cb9c700 1 -- 172.21.15.177:0/2294581041 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000e070 con 0x7fad080cd850 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0cb9c700 1 -- 172.21.15.177:0/2294581041 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000bb20 con 0x7fad080cd850 2023-11-27T17:48:19.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0cb9c700 1 -- 172.21.15.177:0/2294581041 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000be90 con 0x7fad080cd850 2023-11-27T17:48:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0fe02700 1 -- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 msgr2=0x7fad080cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0fe02700 1 --2- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 0x7fad080cdca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad00009d90 tx=0x7fad0000b330 comp rx=0 tx=0).stop 2023-11-27T17:48:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0fe02700 1 -- 172.21.15.177:0/2294581041 shutdown_connections 2023-11-27T17:48:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0fe02700 1 --2- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 0x7fad080cdca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0fe02700 1 --2- 172.21.15.177:0/2294581041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.331+0000 7fad0fe02700 1 -- 172.21.15.177:0/2294581041 >> 172.21.15.177:0/2294581041 conn(0x7fad080b38b0 msgr2=0x7fad080b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.332+0000 7fad0fe02700 1 -- 172.21.15.177:0/2294581041 shutdown_connections 2023-11-27T17:48:19.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.332+0000 7fad0fe02700 1 -- 172.21.15.177:0/2294581041 wait complete. 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.333+0000 7fad0fe02700 1 Processor -- start 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.333+0000 7fad0fe02700 1 -- start start 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0fe02700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0fe02700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 0x7fad080ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0fe02700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0815b3d0 0x7fad080ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0fe02700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080aa4f0 con 0x7fad0815b3d0 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0fe02700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080a9450 con 0x7fad080cd850 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0fe02700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080a9730 con 0x7fad080afa50 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0e39f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0815b3d0 0x7fad080ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:19.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0e39f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0815b3d0 0x7fad080ab590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51386/0 (socket says 172.21.15.177:51386) 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0e39f700 1 -- 172.21.15.177:0/973540054 learned_addr learned my addr 172.21.15.177:0/973540054 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0db9e700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0d39d700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 0x7fad080ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0e39f700 1 -- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 msgr2=0x7fad080b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0e39f700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0e39f700 1 -- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 msgr2=0x7fad080ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0e39f700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 0x7fad080ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0e39f700 1 -- 172.21.15.177:0/973540054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80094a0 con 0x7fad0815b3d0 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0db9e700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.334+0000 7fad0d39d700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 0x7fad080ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.335+0000 7fad0e39f700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0815b3d0 0x7fad080ab590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad00014040 tx=0x7fad00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:19.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.335+0000 7facfe7fc700 1 -- 172.21.15.177:0/973540054 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000098f0 con 0x7fad0815b3d0 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.335+0000 7facfe7fc700 1 -- 172.21.15.177:0/973540054 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00020070 con 0x7fad0815b3d0 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.335+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad00009a70 con 0x7fad0815b3d0 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.335+0000 7facfe7fc700 1 -- 172.21.15.177:0/973540054 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000276a0 con 0x7fad0815b3d0 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.335+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad080a9cf0 con 0x7fad0815b3d0 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.336+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad08069400 con 0x7fad0815b3d0 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.336+0000 7facfe7fc700 1 -- 172.21.15.177:0/973540054 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fad00027800 con 0x7fad0815b3d0 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.336+0000 7facfe7fc700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facec06b250 0x7facec06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.337+0000 7facfe7fc700 1 -- 172.21.15.177:0/973540054 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad00022070 con 0x7fad0815b3d0 2023-11-27T17:48:19.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.337+0000 7fad0db9e700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facec06b250 0x7facec06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:19.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.337+0000 7fad0db9e700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facec06b250 0x7facec06d710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad081e7180 tx=0x7facf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:19.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.341+0000 7facfe7fc700 1 -- 172.21.15.177:0/973540054 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fad00056740 con 0x7fad0815b3d0 2023-11-27T17:48:19.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:19.574+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fad080731d0 con 0x7fad0815b3d0 2023-11-27T17:48:20.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:48:20.064 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:48:20.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.187+0000 7facfe7fc700 1 -- 172.21.15.177:0/973540054 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fad00059d60 con 0x7fad0815b3d0 2023-11-27T17:48:20.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facec06b250 msgr2=0x7facec06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facec06b250 0x7facec06d710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad081e7180 tx=0x7facf8008040 comp rx=0 tx=0).stop 2023-11-27T17:48:20.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0815b3d0 msgr2=0x7fad080ab590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0815b3d0 0x7fad080ab590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad00014040 tx=0x7fad00004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 shutdown_connections 2023-11-27T17:48:20.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facec06b250 0x7facec06d710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad0815b3d0 0x7fad080ab590 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad080afa50 0x7fad080b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 --2- 172.21.15.177:0/973540054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad080cd850 0x7fad080ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 >> 172.21.15.177:0/973540054 conn(0x7fad080b38b0 msgr2=0x7fad0815eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:20.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 shutdown_connections 2023-11-27T17:48:20.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.189+0000 7fad0fe02700 1 -- 172.21.15.177:0/973540054 wait complete. 2023-11-27T17:48:20.206 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T17:48:20.206 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:20.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.328+0000 7f6009eb0700 1 Processor -- start 2023-11-27T17:48:20.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.328+0000 7f6009eb0700 1 -- start start 2023-11-27T17:48:20.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f6009eb0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f60040b6170 0x7f60040704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f6009eb0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60040b5ce0 con 0x7f60040b6600 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f6009eb0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60040b5700 con 0x7f6004147880 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f6009eb0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600406e020 con 0x7f60040b6170 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f6003fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f60040b6600 0x7f600415f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45712/0 (socket says 172.21.15.177:45712) 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f6003fff700 1 -- 172.21.15.177:0/3197188146 learned_addr learned my addr 172.21.15.177:0/3197188146 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f6002ffd700 1 --2- 172.21.15.177:0/3197188146 >> v2:172.21.15.178:3300/0 conn(0x7f60040b6170 0x7f60040704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833062559 0 0) 0x7f60040b5ce0 con 0x7f60040b6600 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.329+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff00035b0 con 0x7f60040b6600 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807186549 0 0) 0x7f60040b5700 con 0x7f6004147880 2023-11-27T17:48:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60040b5ce0 con 0x7f6004147880 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1478932295 0 0) 0x7f5ff00035b0 con 0x7f60040b6600 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 >> v2:172.21.15.178:3300/0 conn(0x7f60040b6170 msgr2=0x7f60040704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 --2- 172.21.15.177:0/3197188146 >> v2:172.21.15.178:3300/0 conn(0x7f60040b6170 0x7f60040704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 >> v1:172.21.15.178:6789/0 conn(0x7f6004147880 legacy=0x7f600406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600406e230 con 0x7f60040b6600 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f5ffc0019f0 con 0x7f60040b6600 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 >> v1:172.21.15.177:6789/0 conn(0x7f60040b6600 legacy=0x7f600415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f5ff0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0004850 0x7f5ff0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff0005210 0x7f5ff000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600406e020 con 0x7f5ff0003b90 2023-11-27T17:48:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff000c090 con 0x7f5ff0004850 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff000c250 con 0x7f5ff0005210 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60037fe700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f5ff0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f6002ffd700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0004850 0x7f5ff0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f6003fff700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff0005210 0x7f5ff000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60037fe700 1 -- 172.21.15.177:0/3197188146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff0005210 msgr2=0x7f5ff000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60037fe700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff0005210 0x7f5ff000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60037fe700 1 -- 172.21.15.177:0/3197188146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0004850 msgr2=0x7f5ff0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60037fe700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0004850 0x7f5ff0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60037fe700 1 -- 172.21.15.177:0/3197188146 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00035b0 con 0x7f5ff0003b90 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f6003fff700 1 -- 172.21.15.177:0/3197188146 reap_dead start 2023-11-27T17:48:20.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60037fe700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f5ff0003f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fec001940 tx=0x7f5ff0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da352440450f07c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec001430 con 0x7f5ff0003b90 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec001d70 con 0x7f5ff0003b90 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.330+0000 7f60027fc700 1 -- 172.21.15.177:0/3197188146 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec005510 con 0x7f5ff0003b90 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.331+0000 7f6009eb0700 1 -- 172.21.15.177:0/3197188146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 msgr2=0x7f5ff0003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.331+0000 7f6009eb0700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f5ff0003f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fec001940 tx=0x7f5ff0005880 comp rx=0 tx=0).stop 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.331+0000 7f6009eb0700 1 -- 172.21.15.177:0/3197188146 shutdown_connections 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.331+0000 7f6009eb0700 1 --2- 172.21.15.177:0/3197188146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f5ff0003f90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.331+0000 7f6009eb0700 1 -- 172.21.15.177:0/3197188146 >> 172.21.15.177:0/3197188146 conn(0x7f60040b2130 msgr2=0x7f60040b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.331+0000 7f6009eb0700 1 -- 172.21.15.177:0/3197188146 shutdown_connections 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.331+0000 7f6009eb0700 1 -- 172.21.15.177:0/3197188146 wait complete. 2023-11-27T17:48:20.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.332+0000 7f6009eb0700 1 Processor -- start 2023-11-27T17:48:20.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.332+0000 7f6009eb0700 1 -- start start 2023-11-27T17:48:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f6009eb0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f600415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f6009eb0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60040c9630 0x7f60040c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f6009eb0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60040aea70 0x7f60040aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f6009eb0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040c9ff0 con 0x7f5ff0003b90 2023-11-27T17:48:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f6009eb0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040c6dc0 con 0x7f60040c9630 2023-11-27T17:48:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f6009eb0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040c70a0 con 0x7f60040aea70 2023-11-27T17:48:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f600415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f600415d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51402/0 (socket says 172.21.15.177:51402) 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 -- 172.21.15.177:0/1428635594 learned_addr learned my addr 172.21.15.177:0/1428635594 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f6003fff700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60040aea70 0x7f60040aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 -- 172.21.15.177:0/1428635594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60040aea70 msgr2=0x7f60040aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60040aea70 0x7f60040aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 -- 172.21.15.177:0/1428635594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60040c9630 msgr2=0x7f60040c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60040c9630 0x7f60040c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 -- 172.21.15.177:0/1428635594 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040c7380 con 0x7f5ff0003b90 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.333+0000 7f60037fe700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f600415d9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5fec005040 tx=0x7f5fec0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:20.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.334+0000 7f5ffbfff700 1 -- 172.21.15.177:0/1428635594 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec006a70 con 0x7f5ff0003b90 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.334+0000 7f5ffbfff700 1 -- 172.21.15.177:0/1428635594 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec006bd0 con 0x7f5ff0003b90 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.334+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60040c7660 con 0x7f5ff0003b90 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.334+0000 7f5ffbfff700 1 -- 172.21.15.177:0/1428635594 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec007040 con 0x7f5ff0003b90 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.334+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600415dee0 con 0x7f5ff0003b90 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.334+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004073aa0 con 0x7f5ff0003b90 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.335+0000 7f5ffbfff700 1 -- 172.21.15.177:0/1428635594 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5fec0071a0 con 0x7f5ff0003b90 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.335+0000 7f5ffbfff700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fe406b250 0x7f5fe406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.335+0000 7f5ffbfff700 1 -- 172.21.15.177:0/1428635594 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fec08a680 con 0x7f5ff0003b90 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.335+0000 7f6002ffd700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fe406b250 0x7f5fe406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.336+0000 7f6002ffd700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fe406b250 0x7f5fe406d710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4006f10 tx=0x7f5ff4006e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:20.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.340+0000 7f5ffbfff700 1 -- 172.21.15.177:0/1428635594 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5fec055560 con 0x7f5ff0003b90 2023-11-27T17:48:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.575+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60040c6f00 con 0x7f5ff0003b90 2023-11-27T17:48:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.576+0000 7f5ffbfff700 1 -- 172.21.15.177:0/1428635594 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f60040c6f00 con 0x7f5ff0003b90 2023-11-27T17:48:20.580 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:20.580 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:48:16.563848+0000","modified":"2023-11-27T17:48:19.576268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:48:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fe406b250 msgr2=0x7f5fe406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fe406b250 0x7f5fe406d710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4006f10 tx=0x7f5ff4006e80 comp rx=0 tx=0).stop 2023-11-27T17:48:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 msgr2=0x7f600415d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f600415d9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5fec005040 tx=0x7f5fec0012d0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 shutdown_connections 2023-11-27T17:48:20.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fe406b250 0x7f5fe406d710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60040aea70 0x7f60040aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff0003b90 0x7f600415d9a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 --2- 172.21.15.177:0/1428635594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60040c9630 0x7f60040c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 >> 172.21.15.177:0/1428635594 conn(0x7f60040b2130 msgr2=0x7f600406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:20.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 shutdown_connections 2023-11-27T17:48:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.578+0000 7f6009eb0700 1 -- 172.21.15.177:0/1428635594 wait complete. 2023-11-27T17:48:20.589 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-27T17:48:20.593 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:20.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.711+0000 7f8ac292e700 1 Processor -- start 2023-11-27T17:48:20.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.711+0000 7f8ac292e700 1 -- start start 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8ac292e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8abc070c00 0x7f8abc169010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8ac292e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc0b5ce0 con 0x7f8abc147880 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8ac292e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc0b5700 con 0x7f8abc0b6170 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8ac292e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc06e020 con 0x7f8abc070c00 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8abbfff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f8abc147880 0x7f8abc06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45728/0 (socket says 172.21.15.177:45728) 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8abbfff700 1 -- 172.21.15.177:0/3139463655 learned_addr learned my addr 172.21.15.177:0/3139463655 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116077070 0 0) 0x7f8abc0b5ce0 con 0x7f8abc147880 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8ac0ecb700 1 --2- 172.21.15.177:0/3139463655 >> v2:172.21.15.178:3300/0 conn(0x7f8abc070c00 0x7f8abc169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.712+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa40035b0 con 0x7f8abc147880 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3745588827 0 0) 0x7f8aa40035b0 con 0x7f8abc147880 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 >> v2:172.21.15.178:3300/0 conn(0x7f8abc070c00 msgr2=0x7f8abc169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 --2- 172.21.15.177:0/3139463655 >> v2:172.21.15.178:3300/0 conn(0x7f8abc070c00 0x7f8abc169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 >> v1:172.21.15.178:6789/0 conn(0x7f8abc0b6170 legacy=0x7f8abc0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc06e230 con 0x7f8abc147880 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f8ab0001670 con 0x7f8abc147880 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 >> v1:172.21.15.177:6789/0 conn(0x7f8abc147880 legacy=0x7f8abc06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa4003a00 0x7f8aa4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4004850 0x7f8aa4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aa4005210 0x7f8aa400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc06e020 con 0x7f8aa4005210 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa400c0b0 con 0x7f8aa4004850 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa400c270 con 0x7f8aa4003a00 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8ac0ecb700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aa4005210 0x7f8aa400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abbfff700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa4003a00 0x7f8aa4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abb7fe700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4004850 0x7f8aa4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8ac0ecb700 1 -- 172.21.15.177:0/3139463655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa4003a00 msgr2=0x7f8aa4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8ac0ecb700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa4003a00 0x7f8aa4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8ac0ecb700 1 -- 172.21.15.177:0/3139463655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4004850 msgr2=0x7f8aa4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8ac0ecb700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4004850 0x7f8aa4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8ac0ecb700 1 -- 172.21.15.177:0/3139463655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40035b0 con 0x7f8aa4005210 2023-11-27T17:48:20.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8ac0ecb700 1 -- 172.21.15.177:0/3139463655 reap_dead start 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8ac0ecb700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aa4005210 0x7f8aa400ba10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009fc0 tx=0x7f8aa4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703f2bd6c5b36c88 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4003a20 con 0x7f8aa4005210 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab400f040 con 0x7f8aa4005210 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.713+0000 7f8abaffd700 1 -- 172.21.15.177:0/3139463655 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4003de0 con 0x7f8aa4005210 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.714+0000 7f8ac292e700 1 -- 172.21.15.177:0/3139463655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aa4005210 msgr2=0x7f8aa400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.714+0000 7f8ac292e700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aa4005210 0x7f8aa400ba10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009fc0 tx=0x7f8aa4005880 comp rx=0 tx=0).stop 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.714+0000 7f8ac292e700 1 -- 172.21.15.177:0/3139463655 shutdown_connections 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.714+0000 7f8ac292e700 1 --2- 172.21.15.177:0/3139463655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8aa4005210 0x7f8aa400ba10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.714+0000 7f8ac292e700 1 -- 172.21.15.177:0/3139463655 >> 172.21.15.177:0/3139463655 conn(0x7f8abc0b2130 msgr2=0x7f8abc0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.714+0000 7f8ac292e700 1 -- 172.21.15.177:0/3139463655 shutdown_connections 2023-11-27T17:48:20.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.714+0000 7f8ac292e700 1 -- 172.21.15.177:0/3139463655 wait complete. 2023-11-27T17:48:20.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.715+0000 7f8ac292e700 1 Processor -- start 2023-11-27T17:48:20.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.716+0000 7f8ac292e700 1 -- start start 2023-11-27T17:48:20.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac292e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4005210 0x7f8abc145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac292e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8abc1f4980 0x7f8abc1f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac292e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9d40 0x7f8abc0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac292e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc146130 con 0x7f8abc0c9d40 2023-11-27T17:48:20.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac292e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c8ce0 con 0x7f8aa4005210 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac292e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c8f80 con 0x7f8abc1f4980 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9d40 0x7f8abc0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9d40 0x7f8abc0ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51426/0 (socket says 172.21.15.177:51426) 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 -- 172.21.15.177:0/4246428003 learned_addr learned my addr 172.21.15.177:0/4246428003 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8abbfff700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4005210 0x7f8abc145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8abb7fe700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8abc1f4980 0x7f8abc1f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 -- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8abc1f4980 msgr2=0x7f8abc1f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8abc1f4980 0x7f8abc1f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 -- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4005210 msgr2=0x7f8abc145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4005210 0x7f8abc145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 -- 172.21.15.177:0/4246428003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc0c9260 con 0x7f8abc0c9d40 2023-11-27T17:48:20.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8abb7fe700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8abc1f4980 0x7f8abc1f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac0ecb700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9d40 0x7f8abc0ca1c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0b19b0 tx=0x7f8ab4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ab8ff9700 1 -- 172.21.15.177:0/4246428003 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4003e10 con 0x7f8abc0c9d40 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ab8ff9700 1 -- 172.21.15.177:0/4246428003 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4004230 con 0x7f8abc0c9d40 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc0c9540 con 0x7f8abc0c9d40 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ab8ff9700 1 -- 172.21.15.177:0/4246428003 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40043e0 con 0x7f8abc0c9d40 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.717+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc161940 con 0x7f8abc0c9d40 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.718+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc0c9b90 con 0x7f8abc0c9d40 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.719+0000 7f8ab8ff9700 1 -- 172.21.15.177:0/4246428003 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8ab4004540 con 0x7f8abc0c9d40 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.719+0000 7f8ab8ff9700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8aa806b250 0x7f8aa806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.719+0000 7f8ab8ff9700 1 -- 172.21.15.177:0/4246428003 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab408af90 con 0x7f8abc0c9d40 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.719+0000 7f8abbfff700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8aa806b250 0x7f8aa806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:20.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.719+0000 7f8abbfff700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8aa806b250 0x7f8aa806d710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0000c00 tx=0x7f8ab0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:20.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.724+0000 7f8ab8ff9700 1 -- 172.21.15.177:0/4246428003 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8ab4055e70 con 0x7f8abc0c9d40 2023-11-27T17:48:20.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.917+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8abc073aa0 con 0x7f8abc0c9d40 2023-11-27T17:48:20.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.918+0000 7f8ab8ff9700 1 -- 172.21.15.177:0/4246428003 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f8ab4059490 con 0x7f8abc0c9d40 2023-11-27T17:48:20.920 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:20.921 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:20.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8aa806b250 msgr2=0x7f8aa806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8aa806b250 0x7f8aa806d710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0000c00 tx=0x7f8ab0009040 comp rx=0 tx=0).stop 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9d40 msgr2=0x7f8abc0ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9d40 0x7f8abc0ca1c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0b19b0 tx=0x7f8ab4009750 comp rx=0 tx=0).stop 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 shutdown_connections 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8aa806b250 0x7f8aa806d710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9d40 0x7f8abc0ca1c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa4005210 0x7f8abc145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 --2- 172.21.15.177:0/4246428003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8abc1f4980 0x7f8abc1f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 >> 172.21.15.177:0/4246428003 conn(0x7f8abc0b2130 msgr2=0x7f8abc0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 shutdown_connections 2023-11-27T17:48:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:20.920+0000 7f8ac292e700 1 -- 172.21.15.177:0/4246428003 wait complete. 2023-11-27T17:48:20.934 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T17:48:20.935 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:48:21.028 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-11-27T17:48:21.026+0000 7fbc18604700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T17:48:21.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.053+0000 7fa76cd9d700 1 Processor -- start 2023-11-27T17:48:21.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.053+0000 7fa76cd9d700 1 -- start start 2023-11-27T17:48:21.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa76cd9d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa768158520 0x7fa7680726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa76cd9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa768072bf0 0x7fa76806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa76cd9d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76806dee0 con 0x7fa76806da90 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa76cd9d700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa768158900 con 0x7fa768158520 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa76cd9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa768072220 con 0x7fa768072bf0 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7677fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa768158520 0x7fa7680726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7677fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa768158520 0x7fa7680726b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51430/0 (socket says 172.21.15.177:51430) 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7677fe700 1 -- 172.21.15.177:0/1151461714 learned_addr learned my addr 172.21.15.177:0/1151461714 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa766ffd700 1 --2- 172.21.15.177:0/1151461714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa768072bf0 0x7fa76806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7677fe700 1 -- 172.21.15.177:0/1151461714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa768072bf0 msgr2=0x7fa76806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7677fe700 1 --2- 172.21.15.177:0/1151461714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa768072bf0 0x7fa76806d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7677fe700 1 -- 172.21.15.177:0/1151461714 >> v1:172.21.15.178:6789/0 conn(0x7fa76806da90 legacy=0x7fa7680b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7677fe700 1 -- 172.21.15.177:0/1151461714 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76806f660 con 0x7fa768158520 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7677fe700 1 --2- 172.21.15.177:0/1151461714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7680726b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098f0 tx=0x7fa75c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447cbcf520c14aab server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7667fc700 1 -- 172.21.15.177:0/1151461714 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c004230 con 0x7fa768158520 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7667fc700 1 -- 172.21.15.177:0/1151461714 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c004390 con 0x7fa768158520 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.054+0000 7fa7667fc700 1 -- 172.21.15.177:0/1151461714 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0036a0 con 0x7fa768158520 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.055+0000 7fa76cd9d700 1 -- 172.21.15.177:0/1151461714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 msgr2=0x7fa7680726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.055+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/1151461714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7680726b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098f0 tx=0x7fa75c009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.055+0000 7fa76cd9d700 1 -- 172.21.15.177:0/1151461714 shutdown_connections 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.055+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/1151461714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7680726b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.055+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/1151461714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa768072bf0 0x7fa76806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.055+0000 7fa76cd9d700 1 -- 172.21.15.177:0/1151461714 >> 172.21.15.177:0/1151461714 conn(0x7fa76806aff0 msgr2=0x7fa76806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.055+0000 7fa76cd9d700 1 -- 172.21.15.177:0/1151461714 shutdown_connections 2023-11-27T17:48:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.055+0000 7fa76cd9d700 1 -- 172.21.15.177:0/1151461714 wait complete. 2023-11-27T17:48:21.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.056+0000 7fa76cd9d700 1 Processor -- start 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.056+0000 7fa76cd9d700 1 -- start start 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa76cd9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76806da90 0x7fa76815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa76cd9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa768072bf0 0x7fa768158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa76cd9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7681f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa76cd9d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680d0a40 con 0x7fa768158520 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa76cd9d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768153010 con 0x7fa768072bf0 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa76cd9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680d0760 con 0x7fa76806da90 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa767fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7681f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa767fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7681f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51440/0 (socket says 172.21.15.177:51440) 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa767fff700 1 -- 172.21.15.177:0/3910340226 learned_addr learned my addr 172.21.15.177:0/3910340226 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.057+0000 7fa7677fe700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76806da90 0x7fa76815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa766ffd700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa768072bf0 0x7fa768158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa767fff700 1 -- 172.21.15.177:0/3910340226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76806da90 msgr2=0x7fa76815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa767fff700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76806da90 0x7fa76815a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa767fff700 1 -- 172.21.15.177:0/3910340226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa768072bf0 msgr2=0x7fa768158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa767fff700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa768072bf0 0x7fa768158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa767fff700 1 -- 172.21.15.177:0/3910340226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c009550 con 0x7fa768158520 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa767fff700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7681f5ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa76000cc10 tx=0x7fa76000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa74ffff700 1 -- 172.21.15.177:0/3910340226 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76000abb0 con 0x7fa768158520 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa74ffff700 1 -- 172.21.15.177:0/3910340226 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76000ad10 con 0x7fa768158520 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa74ffff700 1 -- 172.21.15.177:0/3910340226 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760012660 con 0x7fa768158520 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7681f4fe0 con 0x7fa768158520 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.058+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7681f55a0 con 0x7fa768158520 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.059+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa768073aa0 con 0x7fa768158520 2023-11-27T17:48:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.059+0000 7fa74ffff700 1 -- 172.21.15.177:0/3910340226 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa7600127c0 con 0x7fa768158520 2023-11-27T17:48:21.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.060+0000 7fa74ffff700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa75406b250 0x7fa75406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.060+0000 7fa7677fe700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa75406b250 0x7fa75406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.060+0000 7fa74ffff700 1 -- 172.21.15.177:0/3910340226 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa76008a150 con 0x7fa768158520 2023-11-27T17:48:21.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.060+0000 7fa7677fe700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa75406b250 0x7fa75406d710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009c40 tx=0x7fa75c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.064+0000 7fa74ffff700 1 -- 172.21.15.177:0/3910340226 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa760054e80 con 0x7fa768158520 2023-11-27T17:48:21.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.253+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7681f4e70 con 0x7fa75406b250 2023-11-27T17:48:21.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.261+0000 7fa74ffff700 1 -- 172.21.15.177:0/3910340226 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264657 (secure 0 0 0) 0x7fa7681f4e70 con 0x7fa75406b250 2023-11-27T17:48:21.266 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:21.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa75406b250 msgr2=0x7fa75406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa75406b250 0x7fa75406d710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009c40 tx=0x7fa75c008030 comp rx=0 tx=0).stop 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 msgr2=0x7fa7681f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7681f5ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa76000cc10 tx=0x7fa76000a060 comp rx=0 tx=0).stop 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 shutdown_connections 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa75406b250 0x7fa75406d710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa768158520 0x7fa7681f5ac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76806da90 0x7fa76815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 --2- 172.21.15.177:0/3910340226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa768072bf0 0x7fa768158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 >> 172.21.15.177:0/3910340226 conn(0x7fa76806aff0 msgr2=0x7fa76815ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 shutdown_connections 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.264+0000 7fa76cd9d700 1 -- 172.21.15.177:0/3910340226 wait complete. 2023-11-27T17:48:21.269 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:48:21.279 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-27T17:48:20.620626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2953216,"data_stored":1771304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.460818"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180718+0000","last_change":"2023-11-27T17:48:17.200652+0000","last_active":"2023-11-27T17:48:18.180718+0000","last_peered":"2023-11-27T17:48:18.180718+0000","last_clean":"2023-11-27T17:48:18.180718+0000","last_became_active":"2023-11-27T17:48:17.200367+0000","last_became_peered":"2023-11-27T17:48:17.200367+0000","last_unstale":"2023-11-27T17:48:18.180718+0000","last_undegraded":"2023-11-27T17:48:18.180718+0000","last_fullsized":"2023-11-27T17:48:18.180718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:48.898798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.180041+0000","last_change":"2023-11-27T17:48:17.178900+0000","last_active":"2023-11-27T17:48:17.180041+0000","last_peered":"2023-11-27T17:48:17.180041+0000","last_clean":"2023-11-27T17:48:17.180041+0000","last_became_active":"2023-11-27T17:48:17.178688+0000","last_became_peered":"2023-11-27T17:48:17.178688+0000","last_unstale":"2023-11-27T17:48:17.180041+0000","last_undegraded":"2023-11-27T17:48:17.180041+0000","last_fullsized":"2023-11-27T17:48:17.180041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:40.893618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349059+0000","last_change":"2023-11-27T17:48:17.183900+0000","last_active":"2023-11-27T17:48:19.349059+0000","last_peered":"2023-11-27T17:48:19.349059+0000","last_clean":"2023-11-27T17:48:19.349059+0000","last_became_active":"2023-11-27T17:48:17.183057+0000","last_became_peered":"2023-11-27T17:48:17.183057+0000","last_unstale":"2023-11-27T17:48:19.349059+0000","last_undegraded":"2023-11-27T17:48:19.349059+0000","last_fullsized":"2023-11-27T17:48:19.349059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:35.744910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196471+0000","last_change":"2023-11-27T17:48:17.194895+0000","last_active":"2023-11-27T17:48:17.196471+0000","last_peered":"2023-11-27T17:48:17.196471+0000","last_clean":"2023-11-27T17:48:17.196471+0000","last_became_active":"2023-11-27T17:48:17.194569+0000","last_became_peered":"2023-11-27T17:48:17.194569+0000","last_unstale":"2023-11-27T17:48:17.196471+0000","last_undegraded":"2023-11-27T17:48:17.196471+0000","last_fullsized":"2023-11-27T17:48:17.196471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180037+0000","last_change":"2023-11-27T17:48:17.190418+0000","last_active":"2023-11-27T17:48:18.180037+0000","last_peered":"2023-11-27T17:48:18.180037+0000","last_clean":"2023-11-27T17:48:18.180037+0000","last_became_active":"2023-11-27T17:48:17.190089+0000","last_became_peered":"2023-11-27T17:48:17.190089+0000","last_unstale":"2023-11-27T17:48:18.180037+0000","last_undegraded":"2023-11-27T17:48:18.180037+0000","last_fullsized":"2023-11-27T17:48:18.180037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.184735+0000","last_change":"2023-11-27T17:48:17.183458+0000","last_active":"2023-11-27T17:48:17.184735+0000","last_peered":"2023-11-27T17:48:17.184735+0000","last_clean":"2023-11-27T17:48:17.184735+0000","last_became_active":"2023-11-27T17:48:17.183168+0000","last_became_peered":"2023-11-27T17:48:17.183168+0000","last_unstale":"2023-11-27T17:48:17.184735+0000","last_undegraded":"2023-11-27T17:48:17.184735+0000","last_fullsized":"2023-11-27T17:48:17.184735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180103+0000","last_change":"2023-11-27T17:48:17.185791+0000","last_active":"2023-11-27T17:48:18.180103+0000","last_peered":"2023-11-27T17:48:18.180103+0000","last_clean":"2023-11-27T17:48:18.180103+0000","last_became_active":"2023-11-27T17:48:17.185040+0000","last_became_peered":"2023-11-27T17:48:17.185040+0000","last_unstale":"2023-11-27T17:48:18.180103+0000","last_undegraded":"2023-11-27T17:48:18.180103+0000","last_fullsized":"2023-11-27T17:48:18.180103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026403+0000","last_change":"2023-11-27T17:48:17.189241+0000","last_active":"2023-11-27T17:48:19.026403+0000","last_peered":"2023-11-27T17:48:19.026403+0000","last_clean":"2023-11-27T17:48:19.026403+0000","last_became_active":"2023-11-27T17:48:17.188950+0000","last_became_peered":"2023-11-27T17:48:17.188950+0000","last_unstale":"2023-11-27T17:48:19.026403+0000","last_undegraded":"2023-11-27T17:48:19.026403+0000","last_fullsized":"2023-11-27T17:48:19.026403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180691+0000","last_change":"2023-11-27T17:48:17.196341+0000","last_active":"2023-11-27T17:48:18.180691+0000","last_peered":"2023-11-27T17:48:18.180691+0000","last_clean":"2023-11-27T17:48:18.180691+0000","last_became_active":"2023-11-27T17:48:17.195932+0000","last_became_peered":"2023-11-27T17:48:17.195932+0000","last_unstale":"2023-11-27T17:48:18.180691+0000","last_undegraded":"2023-11-27T17:48:18.180691+0000","last_fullsized":"2023-11-27T17:48:18.180691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:12:54.004348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199431+0000","last_change":"2023-11-27T17:48:17.182144+0000","last_active":"2023-11-27T17:48:17.199431+0000","last_peered":"2023-11-27T17:48:17.199431+0000","last_clean":"2023-11-27T17:48:17.199431+0000","last_became_active":"2023-11-27T17:48:17.181882+0000","last_became_peered":"2023-11-27T17:48:17.181882+0000","last_unstale":"2023-11-27T17:48:17.199431+0000","last_undegraded":"2023-11-27T17:48:17.199431+0000","last_fullsized":"2023-11-27T17:48:17.199431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:45.637872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199458+0000","last_change":"2023-11-27T17:48:17.182351+0000","last_active":"2023-11-27T17:48:17.199458+0000","last_peered":"2023-11-27T17:48:17.199458+0000","last_clean":"2023-11-27T17:48:17.199458+0000","last_became_active":"2023-11-27T17:48:17.182036+0000","last_became_peered":"2023-11-27T17:48:17.182036+0000","last_unstale":"2023-11-27T17:48:17.199458+0000","last_undegraded":"2023-11-27T17:48:17.199458+0000","last_fullsized":"2023-11-27T17:48:17.199458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:07:10.469711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181409+0000","last_change":"2023-11-27T17:48:17.179857+0000","last_active":"2023-11-27T17:48:18.181409+0000","last_peered":"2023-11-27T17:48:18.181409+0000","last_clean":"2023-11-27T17:48:18.181409+0000","last_became_active":"2023-11-27T17:48:17.179396+0000","last_became_peered":"2023-11-27T17:48:17.179396+0000","last_unstale":"2023-11-27T17:48:18.181409+0000","last_undegraded":"2023-11-27T17:48:18.181409+0000","last_fullsized":"2023-11-27T17:48:18.181409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026911+0000","last_change":"2023-11-27T17:48:17.201660+0000","last_active":"2023-11-27T17:48:19.026911+0000","last_peered":"2023-11-27T17:48:19.026911+0000","last_clean":"2023-11-27T17:48:19.026911+0000","last_became_active":"2023-11-27T17:48:17.201412+0000","last_became_peered":"2023-11-27T17:48:17.201412+0000","last_unstale":"2023-11-27T17:48:19.026911+0000","last_undegraded":"2023-11-27T17:48:19.026911+0000","last_fullsized":"2023-11-27T17:48:19.026911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349083+0000","last_change":"2023-11-27T17:48:17.179417+0000","last_active":"2023-11-27T17:48:19.349083+0000","last_peered":"2023-11-27T17:48:19.349083+0000","last_clean":"2023-11-27T17:48:19.349083+0000","last_became_active":"2023-11-27T17:48:17.178865+0000","last_became_peered":"2023-11-27T17:48:17.178865+0000","last_unstale":"2023-11-27T17:48:19.349083+0000","last_undegraded":"2023-11-27T17:48:19.349083+0000","last_fullsized":"2023-11-27T17:48:19.349083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.176511+0000","last_change":"2023-11-27T17:48:17.171870+0000","last_active":"2023-11-27T17:48:17.176511+0000","last_peered":"2023-11-27T17:48:17.176511+0000","last_clean":"2023-11-27T17:48:17.176511+0000","last_became_active":"2023-11-27T17:48:17.171444+0000","last_became_peered":"2023-11-27T17:48:17.171444+0000","last_unstale":"2023-11-27T17:48:17.176511+0000","last_undegraded":"2023-11-27T17:48:17.176511+0000","last_fullsized":"2023-11-27T17:48:17.176511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:45.637872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.185178+0000","last_change":"2023-11-27T17:48:17.183467+0000","last_active":"2023-11-27T17:48:17.185178+0000","last_peered":"2023-11-27T17:48:17.185178+0000","last_clean":"2023-11-27T17:48:17.185178+0000","last_became_active":"2023-11-27T17:48:17.183203+0000","last_became_peered":"2023-11-27T17:48:17.183203+0000","last_unstale":"2023-11-27T17:48:17.185178+0000","last_undegraded":"2023-11-27T17:48:17.185178+0000","last_fullsized":"2023-11-27T17:48:17.185178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.195691+0000","last_change":"2023-11-27T17:48:17.193109+0000","last_active":"2023-11-27T17:48:17.195691+0000","last_peered":"2023-11-27T17:48:17.195691+0000","last_clean":"2023-11-27T17:48:17.195691+0000","last_became_active":"2023-11-27T17:48:17.192836+0000","last_became_peered":"2023-11-27T17:48:17.192836+0000","last_unstale":"2023-11-27T17:48:17.195691+0000","last_undegraded":"2023-11-27T17:48:17.195691+0000","last_fullsized":"2023-11-27T17:48:17.195691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:58.369189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178610+0000","last_change":"2023-11-27T17:48:17.178927+0000","last_active":"2023-11-27T17:48:18.178610+0000","last_peered":"2023-11-27T17:48:18.178610+0000","last_clean":"2023-11-27T17:48:18.178610+0000","last_became_active":"2023-11-27T17:48:17.178668+0000","last_became_peered":"2023-11-27T17:48:17.178668+0000","last_unstale":"2023-11-27T17:48:18.178610+0000","last_undegraded":"2023-11-27T17:48:18.178610+0000","last_fullsized":"2023-11-27T17:48:18.178610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180294+0000","last_change":"2023-11-27T17:48:17.196844+0000","last_active":"2023-11-27T17:48:18.180294+0000","last_peered":"2023-11-27T17:48:18.180294+0000","last_clean":"2023-11-27T17:48:18.180294+0000","last_became_active":"2023-11-27T17:48:17.196588+0000","last_became_peered":"2023-11-27T17:48:17.196588+0000","last_unstale":"2023-11-27T17:48:18.180294+0000","last_undegraded":"2023-11-27T17:48:18.180294+0000","last_fullsized":"2023-11-27T17:48:18.180294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:03.113296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349135+0000","last_change":"2023-11-27T17:48:16.182157+0000","last_active":"2023-11-27T17:48:19.349135+0000","last_peered":"2023-11-27T17:48:19.349135+0000","last_clean":"2023-11-27T17:48:19.349135+0000","last_became_active":"2023-11-27T17:48:16.181789+0000","last_became_peered":"2023-11-27T17:48:16.181789+0000","last_unstale":"2023-11-27T17:48:19.349135+0000","last_undegraded":"2023-11-27T17:48:19.349135+0000","last_fullsized":"2023-11-27T17:48:19.349135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:55.133591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026801+0000","last_change":"2023-11-27T17:48:17.184258+0000","last_active":"2023-11-27T17:48:19.026801+0000","last_peered":"2023-11-27T17:48:19.026801+0000","last_clean":"2023-11-27T17:48:19.026801+0000","last_became_active":"2023-11-27T17:48:17.183985+0000","last_became_peered":"2023-11-27T17:48:17.183985+0000","last_unstale":"2023-11-27T17:48:19.026801+0000","last_undegraded":"2023-11-27T17:48:19.026801+0000","last_fullsized":"2023-11-27T17:48:19.026801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:51.585949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026822+0000","last_change":"2023-11-27T17:48:16.189592+0000","last_active":"2023-11-27T17:48:19.026822+0000","last_peered":"2023-11-27T17:48:19.026822+0000","last_clean":"2023-11-27T17:48:19.026822+0000","last_became_active":"2023-11-27T17:48:16.189296+0000","last_became_peered":"2023-11-27T17:48:16.189296+0000","last_unstale":"2023-11-27T17:48:19.026822+0000","last_undegraded":"2023-11-27T17:48:19.026822+0000","last_fullsized":"2023-11-27T17:48:19.026822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:44.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349044+0000","last_change":"2023-11-27T17:48:17.181599+0000","last_active":"2023-11-27T17:48:19.349044+0000","last_peered":"2023-11-27T17:48:19.349044+0000","last_clean":"2023-11-27T17:48:19.349044+0000","last_became_active":"2023-11-27T17:48:17.180736+0000","last_became_peered":"2023-11-27T17:48:17.180736+0000","last_unstale":"2023-11-27T17:48:19.349044+0000","last_undegraded":"2023-11-27T17:48:19.349044+0000","last_fullsized":"2023-11-27T17:48:19.349044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:48.392176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180482+0000","last_change":"2023-11-27T17:48:16.185981+0000","last_active":"2023-11-27T17:48:18.180482+0000","last_peered":"2023-11-27T17:48:18.180482+0000","last_clean":"2023-11-27T17:48:18.180482+0000","last_became_active":"2023-11-27T17:48:16.185648+0000","last_became_peered":"2023-11-27T17:48:16.185648+0000","last_unstale":"2023-11-27T17:48:18.180482+0000","last_undegraded":"2023-11-27T17:48:18.180482+0000","last_fullsized":"2023-11-27T17:48:18.180482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:27.226337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.195284+0000","last_change":"2023-11-27T17:48:17.192478+0000","last_active":"2023-11-27T17:48:17.195284+0000","last_peered":"2023-11-27T17:48:17.195284+0000","last_clean":"2023-11-27T17:48:17.195284+0000","last_became_active":"2023-11-27T17:48:17.191295+0000","last_became_peered":"2023-11-27T17:48:17.191295+0000","last_unstale":"2023-11-27T17:48:17.195284+0000","last_undegraded":"2023-11-27T17:48:17.195284+0000","last_fullsized":"2023-11-27T17:48:17.195284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:40.893618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179959+0000","last_change":"2023-11-27T17:48:16.182525+0000","last_active":"2023-11-27T17:48:18.179959+0000","last_peered":"2023-11-27T17:48:18.179959+0000","last_clean":"2023-11-27T17:48:18.179959+0000","last_became_active":"2023-11-27T17:48:16.182208+0000","last_became_peered":"2023-11-27T17:48:16.182208+0000","last_unstale":"2023-11-27T17:48:18.179959+0000","last_undegraded":"2023-11-27T17:48:18.179959+0000","last_fullsized":"2023-11-27T17:48:18.179959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.192657+0000","last_change":"2023-11-27T17:48:17.190913+0000","last_active":"2023-11-27T17:48:17.192657+0000","last_peered":"2023-11-27T17:48:17.192657+0000","last_clean":"2023-11-27T17:48:17.192657+0000","last_became_active":"2023-11-27T17:48:17.190591+0000","last_became_peered":"2023-11-27T17:48:17.190591+0000","last_unstale":"2023-11-27T17:48:17.192657+0000","last_undegraded":"2023-11-27T17:48:17.192657+0000","last_fullsized":"2023-11-27T17:48:17.192657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026931+0000","last_change":"2023-11-27T17:48:16.188491+0000","last_active":"2023-11-27T17:48:19.026931+0000","last_peered":"2023-11-27T17:48:19.026931+0000","last_clean":"2023-11-27T17:48:19.026931+0000","last_became_active":"2023-11-27T17:48:16.188301+0000","last_became_peered":"2023-11-27T17:48:16.188301+0000","last_unstale":"2023-11-27T17:48:19.026931+0000","last_undegraded":"2023-11-27T17:48:19.026931+0000","last_fullsized":"2023-11-27T17:48:19.026931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180319+0000","last_change":"2023-11-27T17:48:17.178657+0000","last_active":"2023-11-27T17:48:18.180319+0000","last_peered":"2023-11-27T17:48:18.180319+0000","last_clean":"2023-11-27T17:48:18.180319+0000","last_became_active":"2023-11-27T17:48:17.178374+0000","last_became_peered":"2023-11-27T17:48:17.178374+0000","last_unstale":"2023-11-27T17:48:18.180319+0000","last_undegraded":"2023-11-27T17:48:18.180319+0000","last_fullsized":"2023-11-27T17:48:18.180319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199782+0000","last_change":"2023-11-27T17:48:16.182101+0000","last_active":"2023-11-27T17:48:17.199782+0000","last_peered":"2023-11-27T17:48:17.199782+0000","last_clean":"2023-11-27T17:48:17.199782+0000","last_became_active":"2023-11-27T17:48:16.181767+0000","last_became_peered":"2023-11-27T17:48:16.181767+0000","last_unstale":"2023-11-27T17:48:17.199782+0000","last_undegraded":"2023-11-27T17:48:17.199782+0000","last_fullsized":"2023-11-27T17:48:17.199782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349273+0000","last_change":"2023-11-27T17:48:17.180782+0000","last_active":"2023-11-27T17:48:19.349273+0000","last_peered":"2023-11-27T17:48:19.349273+0000","last_clean":"2023-11-27T17:48:19.349273+0000","last_became_active":"2023-11-27T17:48:17.180463+0000","last_became_peered":"2023-11-27T17:48:17.180463+0000","last_unstale":"2023-11-27T17:48:19.349273+0000","last_undegraded":"2023-11-27T17:48:19.349273+0000","last_fullsized":"2023-11-27T17:48:19.349273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026513+0000","last_change":"2023-11-27T17:48:16.186582+0000","last_active":"2023-11-27T17:48:19.026513+0000","last_peered":"2023-11-27T17:48:19.026513+0000","last_clean":"2023-11-27T17:48:19.026513+0000","last_became_active":"2023-11-27T17:48:16.186290+0000","last_became_peered":"2023-11-27T17:48:16.186290+0000","last_unstale":"2023-11-27T17:48:19.026513+0000","last_undegraded":"2023-11-27T17:48:19.026513+0000","last_fullsized":"2023-11-27T17:48:19.026513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026554+0000","last_change":"2023-11-27T17:48:17.189577+0000","last_active":"2023-11-27T17:48:19.026554+0000","last_peered":"2023-11-27T17:48:19.026554+0000","last_clean":"2023-11-27T17:48:19.026554+0000","last_became_active":"2023-11-27T17:48:17.188679+0000","last_became_peered":"2023-11-27T17:48:17.188679+0000","last_unstale":"2023-11-27T17:48:19.026554+0000","last_undegraded":"2023-11-27T17:48:19.026554+0000","last_fullsized":"2023-11-27T17:48:19.026554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.172634+0000","last_change":"2023-11-27T17:48:16.180119+0000","last_active":"2023-11-27T17:48:17.172634+0000","last_peered":"2023-11-27T17:48:17.172634+0000","last_clean":"2023-11-27T17:48:17.172634+0000","last_became_active":"2023-11-27T17:48:16.179826+0000","last_became_peered":"2023-11-27T17:48:16.179826+0000","last_unstale":"2023-11-27T17:48:17.172634+0000","last_undegraded":"2023-11-27T17:48:17.172634+0000","last_fullsized":"2023-11-27T17:48:17.172634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:47.385160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.188085+0000","last_change":"2023-11-27T17:48:17.186966+0000","last_active":"2023-11-27T17:48:17.188085+0000","last_peered":"2023-11-27T17:48:17.188085+0000","last_clean":"2023-11-27T17:48:17.188085+0000","last_became_active":"2023-11-27T17:48:17.186650+0000","last_became_peered":"2023-11-27T17:48:17.186650+0000","last_unstale":"2023-11-27T17:48:17.188085+0000","last_undegraded":"2023-11-27T17:48:17.188085+0000","last_fullsized":"2023-11-27T17:48:17.188085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.172103+0000","last_change":"2023-11-27T17:48:16.180021+0000","last_active":"2023-11-27T17:48:17.172103+0000","last_peered":"2023-11-27T17:48:17.172103+0000","last_clean":"2023-11-27T17:48:17.172103+0000","last_became_active":"2023-11-27T17:48:16.179702+0000","last_became_peered":"2023-11-27T17:48:16.179702+0000","last_unstale":"2023-11-27T17:48:17.172103+0000","last_undegraded":"2023-11-27T17:48:17.172103+0000","last_fullsized":"2023-11-27T17:48:17.172103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:55.133591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.189243+0000","last_change":"2023-11-27T17:48:17.186938+0000","last_active":"2023-11-27T17:48:17.189243+0000","last_peered":"2023-11-27T17:48:17.189243+0000","last_clean":"2023-11-27T17:48:17.189243+0000","last_became_active":"2023-11-27T17:48:17.186711+0000","last_became_peered":"2023-11-27T17:48:17.186711+0000","last_unstale":"2023-11-27T17:48:17.189243+0000","last_undegraded":"2023-11-27T17:48:17.189243+0000","last_fullsized":"2023-11-27T17:48:17.189243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.172293+0000","last_change":"2023-11-27T17:48:16.182253+0000","last_active":"2023-11-27T17:48:17.172293+0000","last_peered":"2023-11-27T17:48:17.172293+0000","last_clean":"2023-11-27T17:48:17.172293+0000","last_became_active":"2023-11-27T17:48:16.181399+0000","last_became_peered":"2023-11-27T17:48:16.181399+0000","last_unstale":"2023-11-27T17:48:17.172293+0000","last_undegraded":"2023-11-27T17:48:17.172293+0000","last_fullsized":"2023-11-27T17:48:17.172293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:44.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349254+0000","last_change":"2023-11-27T17:48:17.181837+0000","last_active":"2023-11-27T17:48:19.349254+0000","last_peered":"2023-11-27T17:48:19.349254+0000","last_clean":"2023-11-27T17:48:19.349254+0000","last_became_active":"2023-11-27T17:48:17.181271+0000","last_became_peered":"2023-11-27T17:48:17.181271+0000","last_unstale":"2023-11-27T17:48:19.349254+0000","last_undegraded":"2023-11-27T17:48:19.349254+0000","last_fullsized":"2023-11-27T17:48:19.349254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.192067+0000","last_change":"2023-11-27T17:48:16.177994+0000","last_active":"2023-11-27T17:48:17.192067+0000","last_peered":"2023-11-27T17:48:17.192067+0000","last_clean":"2023-11-27T17:48:17.192067+0000","last_became_active":"2023-11-27T17:48:16.177727+0000","last_became_peered":"2023-11-27T17:48:16.177727+0000","last_unstale":"2023-11-27T17:48:17.192067+0000","last_undegraded":"2023-11-27T17:48:17.192067+0000","last_fullsized":"2023-11-27T17:48:17.192067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181325+0000","last_change":"2023-11-27T17:48:17.198710+0000","last_active":"2023-11-27T17:48:18.181325+0000","last_peered":"2023-11-27T17:48:18.181325+0000","last_clean":"2023-11-27T17:48:18.181325+0000","last_became_active":"2023-11-27T17:48:17.198406+0000","last_became_peered":"2023-11-27T17:48:17.198406+0000","last_unstale":"2023-11-27T17:48:18.181325+0000","last_undegraded":"2023-11-27T17:48:18.181325+0000","last_fullsized":"2023-11-27T17:48:18.181325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.203511+0000","last_change":"2023-11-27T17:48:16.191881+0000","last_active":"2023-11-27T17:48:17.203511+0000","last_peered":"2023-11-27T17:48:17.203511+0000","last_clean":"2023-11-27T17:48:17.203511+0000","last_became_active":"2023-11-27T17:48:16.191647+0000","last_became_peered":"2023-11-27T17:48:16.191647+0000","last_unstale":"2023-11-27T17:48:17.203511+0000","last_undegraded":"2023-11-27T17:48:17.203511+0000","last_fullsized":"2023-11-27T17:48:17.203511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180322+0000","last_change":"2023-11-27T17:48:17.196086+0000","last_active":"2023-11-27T17:48:18.180322+0000","last_peered":"2023-11-27T17:48:18.180322+0000","last_clean":"2023-11-27T17:48:18.180322+0000","last_became_active":"2023-11-27T17:48:17.195707+0000","last_became_peered":"2023-11-27T17:48:17.195707+0000","last_unstale":"2023-11-27T17:48:18.180322+0000","last_undegraded":"2023-11-27T17:48:18.180322+0000","last_fullsized":"2023-11-27T17:48:18.180322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:36.527615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349199+0000","last_change":"2023-11-27T17:48:16.178114+0000","last_active":"2023-11-27T17:48:19.349199+0000","last_peered":"2023-11-27T17:48:19.349199+0000","last_clean":"2023-11-27T17:48:19.349199+0000","last_became_active":"2023-11-27T17:48:16.177834+0000","last_became_peered":"2023-11-27T17:48:16.177834+0000","last_unstale":"2023-11-27T17:48:19.349199+0000","last_undegraded":"2023-11-27T17:48:19.349199+0000","last_fullsized":"2023-11-27T17:48:19.349199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349059+0000","last_change":"2023-11-27T17:48:17.187918+0000","last_active":"2023-11-27T17:48:19.349059+0000","last_peered":"2023-11-27T17:48:19.349059+0000","last_clean":"2023-11-27T17:48:19.349059+0000","last_became_active":"2023-11-27T17:48:17.187649+0000","last_became_peered":"2023-11-27T17:48:17.187649+0000","last_unstale":"2023-11-27T17:48:19.349059+0000","last_undegraded":"2023-11-27T17:48:19.349059+0000","last_fullsized":"2023-11-27T17:48:19.349059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:40.893618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.174191+0000","last_change":"2023-11-27T17:48:16.188695+0000","last_active":"2023-11-27T17:48:17.174191+0000","last_peered":"2023-11-27T17:48:17.174191+0000","last_clean":"2023-11-27T17:48:17.174191+0000","last_became_active":"2023-11-27T17:48:16.188414+0000","last_became_peered":"2023-11-27T17:48:16.188414+0000","last_unstale":"2023-11-27T17:48:17.174191+0000","last_undegraded":"2023-11-27T17:48:17.174191+0000","last_fullsized":"2023-11-27T17:48:17.174191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:17.074762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180262+0000","last_change":"2023-11-27T17:48:17.192145+0000","last_active":"2023-11-27T17:48:18.180262+0000","last_peered":"2023-11-27T17:48:18.180262+0000","last_clean":"2023-11-27T17:48:18.180262+0000","last_became_active":"2023-11-27T17:48:17.191826+0000","last_became_peered":"2023-11-27T17:48:17.191826+0000","last_unstale":"2023-11-27T17:48:18.180262+0000","last_undegraded":"2023-11-27T17:48:18.180262+0000","last_fullsized":"2023-11-27T17:48:18.180262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.171426+0000","last_change":"2023-11-27T17:48:16.181257+0000","last_active":"2023-11-27T17:48:17.171426+0000","last_peered":"2023-11-27T17:48:17.171426+0000","last_clean":"2023-11-27T17:48:17.171426+0000","last_became_active":"2023-11-27T17:48:16.180955+0000","last_became_peered":"2023-11-27T17:48:16.180955+0000","last_unstale":"2023-11-27T17:48:17.171426+0000","last_undegraded":"2023-11-27T17:48:17.171426+0000","last_fullsized":"2023-11-27T17:48:17.171426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:57.362173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199563+0000","last_change":"2023-11-27T17:48:17.184780+0000","last_active":"2023-11-27T17:48:17.199563+0000","last_peered":"2023-11-27T17:48:17.199563+0000","last_clean":"2023-11-27T17:48:17.199563+0000","last_became_active":"2023-11-27T17:48:17.184496+0000","last_became_peered":"2023-11-27T17:48:17.184496+0000","last_unstale":"2023-11-27T17:48:17.199563+0000","last_undegraded":"2023-11-27T17:48:17.199563+0000","last_fullsized":"2023-11-27T17:48:17.199563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:31:18.198472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178470+0000","last_change":"2023-11-27T17:48:16.176239+0000","last_active":"2023-11-27T17:48:18.178470+0000","last_peered":"2023-11-27T17:48:18.178470+0000","last_clean":"2023-11-27T17:48:18.178470+0000","last_became_active":"2023-11-27T17:48:16.175935+0000","last_became_peered":"2023-11-27T17:48:16.175935+0000","last_unstale":"2023-11-27T17:48:18.178470+0000","last_undegraded":"2023-11-27T17:48:18.178470+0000","last_fullsized":"2023-11-27T17:48:18.178470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:31:17.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180890+0000","last_change":"2023-11-27T17:48:17.192173+0000","last_active":"2023-11-27T17:48:18.180890+0000","last_peered":"2023-11-27T17:48:18.180890+0000","last_clean":"2023-11-27T17:48:18.180890+0000","last_became_active":"2023-11-27T17:48:17.191886+0000","last_became_peered":"2023-11-27T17:48:17.191886+0000","last_unstale":"2023-11-27T17:48:18.180890+0000","last_undegraded":"2023-11-27T17:48:18.180890+0000","last_fullsized":"2023-11-27T17:48:18.180890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:59.251403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181348+0000","last_change":"2023-11-27T17:48:16.178737+0000","last_active":"2023-11-27T17:48:18.181348+0000","last_peered":"2023-11-27T17:48:18.181348+0000","last_clean":"2023-11-27T17:48:18.181348+0000","last_became_active":"2023-11-27T17:48:16.178440+0000","last_became_peered":"2023-11-27T17:48:16.178440+0000","last_unstale":"2023-11-27T17:48:18.181348+0000","last_undegraded":"2023-11-27T17:48:18.181348+0000","last_fullsized":"2023-11-27T17:48:18.181348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:46:28.658758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180221+0000","last_change":"2023-11-27T17:48:17.199254+0000","last_active":"2023-11-27T17:48:18.180221+0000","last_peered":"2023-11-27T17:48:18.180221+0000","last_clean":"2023-11-27T17:48:18.180221+0000","last_became_active":"2023-11-27T17:48:17.198787+0000","last_became_peered":"2023-11-27T17:48:17.198787+0000","last_unstale":"2023-11-27T17:48:18.180221+0000","last_undegraded":"2023-11-27T17:48:18.180221+0000","last_fullsized":"2023-11-27T17:48:18.180221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.170301+0000","last_change":"2023-11-27T17:48:16.178655+0000","last_active":"2023-11-27T17:48:17.170301+0000","last_peered":"2023-11-27T17:48:17.170301+0000","last_clean":"2023-11-27T17:48:17.170301+0000","last_became_active":"2023-11-27T17:48:16.178370+0000","last_became_peered":"2023-11-27T17:48:16.178370+0000","last_unstale":"2023-11-27T17:48:17.170301+0000","last_undegraded":"2023-11-27T17:48:17.170301+0000","last_fullsized":"2023-11-27T17:48:17.170301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:34.737894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196644+0000","last_change":"2023-11-27T17:48:17.194445+0000","last_active":"2023-11-27T17:48:17.196644+0000","last_peered":"2023-11-27T17:48:17.196644+0000","last_clean":"2023-11-27T17:48:17.196644+0000","last_became_active":"2023-11-27T17:48:17.194134+0000","last_became_peered":"2023-11-27T17:48:17.194134+0000","last_unstale":"2023-11-27T17:48:17.196644+0000","last_undegraded":"2023-11-27T17:48:17.196644+0000","last_fullsized":"2023-11-27T17:48:17.196644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:07:10.469711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.174049+0000","last_change":"2023-11-27T17:48:16.182152+0000","last_active":"2023-11-27T17:48:17.174049+0000","last_peered":"2023-11-27T17:48:17.174049+0000","last_clean":"2023-11-27T17:48:17.174049+0000","last_became_active":"2023-11-27T17:48:16.181769+0000","last_became_peered":"2023-11-27T17:48:16.181769+0000","last_unstale":"2023-11-27T17:48:17.174049+0000","last_undegraded":"2023-11-27T17:48:17.174049+0000","last_fullsized":"2023-11-27T17:48:17.174049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:48.481068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181152+0000","last_change":"2023-11-27T17:48:17.189104+0000","last_active":"2023-11-27T17:48:18.181152+0000","last_peered":"2023-11-27T17:48:18.181152+0000","last_clean":"2023-11-27T17:48:18.181152+0000","last_became_active":"2023-11-27T17:48:17.188416+0000","last_became_peered":"2023-11-27T17:48:17.188416+0000","last_unstale":"2023-11-27T17:48:18.181152+0000","last_undegraded":"2023-11-27T17:48:18.181152+0000","last_fullsized":"2023-11-27T17:48:18.181152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.180115+0000","last_change":"2023-11-27T17:48:17.177845+0000","last_active":"2023-11-27T17:48:17.180115+0000","last_peered":"2023-11-27T17:48:17.180115+0000","last_clean":"2023-11-27T17:48:17.180115+0000","last_became_active":"2023-11-27T17:48:17.177556+0000","last_became_peered":"2023-11-27T17:48:17.177556+0000","last_unstale":"2023-11-27T17:48:17.180115+0000","last_undegraded":"2023-11-27T17:48:17.180115+0000","last_fullsized":"2023-11-27T17:48:17.180115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178490+0000","last_change":"2023-11-27T17:48:16.189008+0000","last_active":"2023-11-27T17:48:18.178490+0000","last_peered":"2023-11-27T17:48:18.178490+0000","last_clean":"2023-11-27T17:48:18.178490+0000","last_became_active":"2023-11-27T17:48:16.188800+0000","last_became_peered":"2023-11-27T17:48:16.188800+0000","last_unstale":"2023-11-27T17:48:18.178490+0000","last_undegraded":"2023-11-27T17:48:18.178490+0000","last_fullsized":"2023-11-27T17:48:18.178490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:00.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026519+0000","last_change":"2023-11-27T17:48:17.186845+0000","last_active":"2023-11-27T17:48:19.026519+0000","last_peered":"2023-11-27T17:48:19.026519+0000","last_clean":"2023-11-27T17:48:19.026519+0000","last_became_active":"2023-11-27T17:48:17.186071+0000","last_became_peered":"2023-11-27T17:48:17.186071+0000","last_unstale":"2023-11-27T17:48:19.026519+0000","last_undegraded":"2023-11-27T17:48:19.026519+0000","last_fullsized":"2023-11-27T17:48:19.026519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.172525+0000","last_change":"2023-11-27T17:48:16.183104+0000","last_active":"2023-11-27T17:48:17.172525+0000","last_peered":"2023-11-27T17:48:17.172525+0000","last_clean":"2023-11-27T17:48:17.172525+0000","last_became_active":"2023-11-27T17:48:16.182831+0000","last_became_peered":"2023-11-27T17:48:16.182831+0000","last_unstale":"2023-11-27T17:48:17.172525+0000","last_undegraded":"2023-11-27T17:48:17.172525+0000","last_fullsized":"2023-11-27T17:48:17.172525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.177763+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:48:17.177763+0000","last_peered":"2023-11-27T17:48:17.177763+0000","last_clean":"2023-11-27T17:48:17.177763+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:48:17.177763+0000","last_undegraded":"2023-11-27T17:48:17.177763+0000","last_fullsized":"2023-11-27T17:48:17.177763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.348882+0000","last_change":"2023-11-27T17:48:17.179815+0000","last_active":"2023-11-27T17:48:19.348882+0000","last_peered":"2023-11-27T17:48:19.348882+0000","last_clean":"2023-11-27T17:48:19.348882+0000","last_became_active":"2023-11-27T17:48:17.179567+0000","last_became_peered":"2023-11-27T17:48:17.179567+0000","last_unstale":"2023-11-27T17:48:19.348882+0000","last_undegraded":"2023-11-27T17:48:19.348882+0000","last_fullsized":"2023-11-27T17:48:19.348882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:49.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179912+0000","last_change":"2023-11-27T17:48:16.178695+0000","last_active":"2023-11-27T17:48:18.179912+0000","last_peered":"2023-11-27T17:48:18.179912+0000","last_clean":"2023-11-27T17:48:18.179912+0000","last_became_active":"2023-11-27T17:48:16.178387+0000","last_became_peered":"2023-11-27T17:48:16.178387+0000","last_unstale":"2023-11-27T17:48:18.179912+0000","last_undegraded":"2023-11-27T17:48:18.179912+0000","last_fullsized":"2023-11-27T17:48:18.179912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180387+0000","last_change":"2023-11-27T17:48:16.187600+0000","last_active":"2023-11-27T17:48:18.180387+0000","last_peered":"2023-11-27T17:48:18.180387+0000","last_clean":"2023-11-27T17:48:18.180387+0000","last_became_active":"2023-11-27T17:48:16.187268+0000","last_became_peered":"2023-11-27T17:48:16.187268+0000","last_unstale":"2023-11-27T17:48:18.180387+0000","last_undegraded":"2023-11-27T17:48:18.180387+0000","last_fullsized":"2023-11-27T17:48:18.180387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:17.074762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.179505+0000","last_change":"2023-11-27T17:48:17.175788+0000","last_active":"2023-11-27T17:48:17.179505+0000","last_peered":"2023-11-27T17:48:17.179505+0000","last_clean":"2023-11-27T17:48:17.179505+0000","last_became_active":"2023-11-27T17:48:17.175498+0000","last_became_peered":"2023-11-27T17:48:17.175498+0000","last_unstale":"2023-11-27T17:48:17.179505+0000","last_undegraded":"2023-11-27T17:48:17.179505+0000","last_fullsized":"2023-11-27T17:48:17.179505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.169731+0000","last_change":"2023-11-27T17:48:16.182683+0000","last_active":"2023-11-27T17:48:17.169731+0000","last_peered":"2023-11-27T17:48:17.169731+0000","last_clean":"2023-11-27T17:48:17.169731+0000","last_became_active":"2023-11-27T17:48:16.182410+0000","last_became_peered":"2023-11-27T17:48:16.182410+0000","last_unstale":"2023-11-27T17:48:17.169731+0000","last_undegraded":"2023-11-27T17:48:17.169731+0000","last_fullsized":"2023-11-27T17:48:17.169731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026903+0000","last_change":"2023-11-27T17:48:17.193285+0000","last_active":"2023-11-27T17:48:19.026903+0000","last_peered":"2023-11-27T17:48:19.026903+0000","last_clean":"2023-11-27T17:48:19.026903+0000","last_became_active":"2023-11-27T17:48:17.192965+0000","last_became_peered":"2023-11-27T17:48:17.192965+0000","last_unstale":"2023-11-27T17:48:19.026903+0000","last_undegraded":"2023-11-27T17:48:19.026903+0000","last_fullsized":"2023-11-27T17:48:19.026903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199876+0000","last_change":"2023-11-27T17:48:16.182590+0000","last_active":"2023-11-27T17:48:17.199876+0000","last_peered":"2023-11-27T17:48:17.199876+0000","last_clean":"2023-11-27T17:48:17.199876+0000","last_became_active":"2023-11-27T17:48:16.182327+0000","last_became_peered":"2023-11-27T17:48:16.182327+0000","last_unstale":"2023-11-27T17:48:17.199876+0000","last_undegraded":"2023-11-27T17:48:17.199876+0000","last_fullsized":"2023-11-27T17:48:17.199876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349130+0000","last_change":"2023-11-27T17:48:17.182568+0000","last_active":"2023-11-27T17:48:19.349130+0000","last_peered":"2023-11-27T17:48:19.349130+0000","last_clean":"2023-11-27T17:48:19.349130+0000","last_became_active":"2023-11-27T17:48:17.182245+0000","last_became_peered":"2023-11-27T17:48:17.182245+0000","last_unstale":"2023-11-27T17:48:19.349130+0000","last_undegraded":"2023-11-27T17:48:19.349130+0000","last_fullsized":"2023-11-27T17:48:19.349130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179561+0000","last_change":"2023-11-27T17:48:16.188084+0000","last_active":"2023-11-27T17:48:18.179561+0000","last_peered":"2023-11-27T17:48:18.179561+0000","last_clean":"2023-11-27T17:48:18.179561+0000","last_became_active":"2023-11-27T17:48:16.187806+0000","last_became_peered":"2023-11-27T17:48:16.187806+0000","last_unstale":"2023-11-27T17:48:18.179561+0000","last_undegraded":"2023-11-27T17:48:18.179561+0000","last_fullsized":"2023-11-27T17:48:18.179561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:57.362173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180842+0000","last_change":"2023-11-27T17:48:17.175327+0000","last_active":"2023-11-27T17:48:18.180842+0000","last_peered":"2023-11-27T17:48:18.180842+0000","last_clean":"2023-11-27T17:48:18.180842+0000","last_became_active":"2023-11-27T17:48:17.173427+0000","last_became_peered":"2023-11-27T17:48:17.173427+0000","last_unstale":"2023-11-27T17:48:18.180842+0000","last_undegraded":"2023-11-27T17:48:18.180842+0000","last_fullsized":"2023-11-27T17:48:18.180842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:58.369189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.170129+0000","last_change":"2023-11-27T17:48:16.181314+0000","last_active":"2023-11-27T17:48:17.170129+0000","last_peered":"2023-11-27T17:48:17.170129+0000","last_clean":"2023-11-27T17:48:17.170129+0000","last_became_active":"2023-11-27T17:48:16.181069+0000","last_became_peered":"2023-11-27T17:48:16.181069+0000","last_unstale":"2023-11-27T17:48:17.170129+0000","last_undegraded":"2023-11-27T17:48:17.170129+0000","last_fullsized":"2023-11-27T17:48:17.170129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:47.385160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026499+0000","last_change":"2023-11-27T17:48:17.189442+0000","last_active":"2023-11-27T17:48:19.026499+0000","last_peered":"2023-11-27T17:48:19.026499+0000","last_clean":"2023-11-27T17:48:19.026499+0000","last_became_active":"2023-11-27T17:48:17.188944+0000","last_became_peered":"2023-11-27T17:48:17.188944+0000","last_unstale":"2023-11-27T17:48:19.026499+0000","last_undegraded":"2023-11-27T17:48:19.026499+0000","last_fullsized":"2023-11-27T17:48:19.026499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.168724+0000","last_change":"2023-11-27T17:48:16.188610+0000","last_active":"2023-11-27T17:48:17.168724+0000","last_peered":"2023-11-27T17:48:17.168724+0000","last_clean":"2023-11-27T17:48:17.168724+0000","last_became_active":"2023-11-27T17:48:16.188323+0000","last_became_peered":"2023-11-27T17:48:16.188323+0000","last_unstale":"2023-11-27T17:48:17.168724+0000","last_undegraded":"2023-11-27T17:48:17.168724+0000","last_fullsized":"2023-11-27T17:48:17.168724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:07:09.462696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.027010+0000","last_change":"2023-11-27T17:48:17.191974+0000","last_active":"2023-11-27T17:48:19.027010+0000","last_peered":"2023-11-27T17:48:19.027010+0000","last_clean":"2023-11-27T17:48:19.027010+0000","last_became_active":"2023-11-27T17:48:17.191681+0000","last_became_peered":"2023-11-27T17:48:17.191681+0000","last_unstale":"2023-11-27T17:48:19.027010+0000","last_undegraded":"2023-11-27T17:48:19.027010+0000","last_fullsized":"2023-11-27T17:48:19.027010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180165+0000","last_change":"2023-11-27T17:48:16.186595+0000","last_active":"2023-11-27T17:48:18.180165+0000","last_peered":"2023-11-27T17:48:18.180165+0000","last_clean":"2023-11-27T17:48:18.180165+0000","last_became_active":"2023-11-27T17:48:16.186241+0000","last_became_peered":"2023-11-27T17:48:16.186241+0000","last_unstale":"2023-11-27T17:48:18.180165+0000","last_undegraded":"2023-11-27T17:48:18.180165+0000","last_fullsized":"2023-11-27T17:48:18.180165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199470+0000","last_change":"2023-11-27T17:48:17.183997+0000","last_active":"2023-11-27T17:48:17.199470+0000","last_peered":"2023-11-27T17:48:17.199470+0000","last_clean":"2023-11-27T17:48:17.199470+0000","last_became_active":"2023-11-27T17:48:17.183811+0000","last_became_peered":"2023-11-27T17:48:17.183811+0000","last_unstale":"2023-11-27T17:48:17.199470+0000","last_undegraded":"2023-11-27T17:48:17.199470+0000","last_fullsized":"2023-11-27T17:48:17.199470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:49.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178737+0000","last_change":"2023-11-27T17:48:16.181997+0000","last_active":"2023-11-27T17:48:18.178737+0000","last_peered":"2023-11-27T17:48:18.178737+0000","last_clean":"2023-11-27T17:48:18.178737+0000","last_became_active":"2023-11-27T17:48:16.181707+0000","last_became_peered":"2023-11-27T17:48:16.181707+0000","last_unstale":"2023-11-27T17:48:18.178737+0000","last_undegraded":"2023-11-27T17:48:18.178737+0000","last_fullsized":"2023-11-27T17:48:18.178737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:40:57.780308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180474+0000","last_change":"2023-11-27T17:48:17.193351+0000","last_active":"2023-11-27T17:48:18.180474+0000","last_peered":"2023-11-27T17:48:18.180474+0000","last_clean":"2023-11-27T17:48:18.180474+0000","last_became_active":"2023-11-27T17:48:17.193076+0000","last_became_peered":"2023-11-27T17:48:17.193076+0000","last_unstale":"2023-11-27T17:48:18.180474+0000","last_undegraded":"2023-11-27T17:48:18.180474+0000","last_fullsized":"2023-11-27T17:48:18.180474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:30:58.565092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.198596+0000","last_change":"2023-11-27T17:48:16.178672+0000","last_active":"2023-11-27T17:48:17.198596+0000","last_peered":"2023-11-27T17:48:17.198596+0000","last_clean":"2023-11-27T17:48:17.198596+0000","last_became_active":"2023-11-27T17:48:16.178391+0000","last_became_peered":"2023-11-27T17:48:16.178391+0000","last_unstale":"2023-11-27T17:48:17.198596+0000","last_undegraded":"2023-11-27T17:48:17.198596+0000","last_fullsized":"2023-11-27T17:48:17.198596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196432+0000","last_change":"2023-11-27T17:48:17.194730+0000","last_active":"2023-11-27T17:48:17.196432+0000","last_peered":"2023-11-27T17:48:17.196432+0000","last_clean":"2023-11-27T17:48:17.196432+0000","last_became_active":"2023-11-27T17:48:17.194183+0000","last_became_peered":"2023-11-27T17:48:17.194183+0000","last_unstale":"2023-11-27T17:48:17.196432+0000","last_undegraded":"2023-11-27T17:48:17.196432+0000","last_fullsized":"2023-11-27T17:48:17.196432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:16.361646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178784+0000","last_change":"2023-11-27T17:48:16.188442+0000","last_active":"2023-11-27T17:48:18.178784+0000","last_peered":"2023-11-27T17:48:18.178784+0000","last_clean":"2023-11-27T17:48:18.178784+0000","last_became_active":"2023-11-27T17:48:16.188146+0000","last_became_peered":"2023-11-27T17:48:16.188146+0000","last_unstale":"2023-11-27T17:48:18.178784+0000","last_undegraded":"2023-11-27T17:48:18.178784+0000","last_fullsized":"2023-11-27T17:48:18.178784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:08.552823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180553+0000","last_change":"2023-11-27T17:48:17.199070+0000","last_active":"2023-11-27T17:48:18.180553+0000","last_peered":"2023-11-27T17:48:18.180553+0000","last_clean":"2023-11-27T17:48:18.180553+0000","last_became_active":"2023-11-27T17:48:17.198789+0000","last_became_peered":"2023-11-27T17:48:17.198789+0000","last_unstale":"2023-11-27T17:48:18.180553+0000","last_undegraded":"2023-11-27T17:48:18.180553+0000","last_fullsized":"2023-11-27T17:48:18.180553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:16.621575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199595+0000","last_change":"2023-11-27T17:48:17.184790+0000","last_active":"2023-11-27T17:48:17.199595+0000","last_peered":"2023-11-27T17:48:17.199595+0000","last_clean":"2023-11-27T17:48:17.199595+0000","last_became_active":"2023-11-27T17:48:17.184506+0000","last_became_peered":"2023-11-27T17:48:17.184506+0000","last_unstale":"2023-11-27T17:48:17.199595+0000","last_undegraded":"2023-11-27T17:48:17.199595+0000","last_fullsized":"2023-11-27T17:48:17.199595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178588+0000","last_change":"2023-11-27T17:48:17.178158+0000","last_active":"2023-11-27T17:48:18.178588+0000","last_peered":"2023-11-27T17:48:18.178588+0000","last_clean":"2023-11-27T17:48:18.178588+0000","last_became_active":"2023-11-27T17:48:17.176996+0000","last_became_peered":"2023-11-27T17:48:17.176996+0000","last_unstale":"2023-11-27T17:48:18.178588+0000","last_undegraded":"2023-11-27T17:48:18.178588+0000","last_fullsized":"2023-11-27T17:48:18.178588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196524+0000","last_change":"2023-11-27T17:48:17.194747+0000","last_active":"2023-11-27T17:48:17.196524+0000","last_peered":"2023-11-27T17:48:17.196524+0000","last_clean":"2023-11-27T17:48:17.196524+0000","last_became_active":"2023-11-27T17:48:17.194564+0000","last_became_peered":"2023-11-27T17:48:17.194564+0000","last_unstale":"2023-11-27T17:48:17.196524+0000","last_undegraded":"2023-11-27T17:48:17.196524+0000","last_fullsized":"2023-11-27T17:48:17.196524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:35.744910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349197+0000","last_change":"2023-11-27T17:48:17.187682+0000","last_active":"2023-11-27T17:48:19.349197+0000","last_peered":"2023-11-27T17:48:19.349197+0000","last_clean":"2023-11-27T17:48:19.349197+0000","last_became_active":"2023-11-27T17:48:17.187461+0000","last_became_peered":"2023-11-27T17:48:17.187461+0000","last_unstale":"2023-11-27T17:48:19.349197+0000","last_undegraded":"2023-11-27T17:48:19.349197+0000","last_fullsized":"2023-11-27T17:48:19.349197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026758+0000","last_change":"2023-11-27T17:48:17.186202+0000","last_active":"2023-11-27T17:48:19.026758+0000","last_peered":"2023-11-27T17:48:19.026758+0000","last_clean":"2023-11-27T17:48:19.026758+0000","last_became_active":"2023-11-27T17:48:17.185863+0000","last_became_peered":"2023-11-27T17:48:17.185863+0000","last_unstale":"2023-11-27T17:48:19.026758+0000","last_undegraded":"2023-11-27T17:48:19.026758+0000","last_fullsized":"2023-11-27T17:48:19.026758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.194500+0000","last_change":"2023-11-27T17:48:17.190715+0000","last_active":"2023-11-27T17:48:17.194500+0000","last_peered":"2023-11-27T17:48:17.194500+0000","last_clean":"2023-11-27T17:48:17.194500+0000","last_became_active":"2023-11-27T17:48:17.190445+0000","last_became_peered":"2023-11-27T17:48:17.190445+0000","last_unstale":"2023-11-27T17:48:17.194500+0000","last_undegraded":"2023-11-27T17:48:17.194500+0000","last_fullsized":"2023-11-27T17:48:17.194500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:58.369189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199710+0000","last_change":"2023-11-27T17:48:17.194783+0000","last_active":"2023-11-27T17:48:17.199710+0000","last_peered":"2023-11-27T17:48:17.199710+0000","last_clean":"2023-11-27T17:48:17.199710+0000","last_became_active":"2023-11-27T17:48:17.194541+0000","last_became_peered":"2023-11-27T17:48:17.194541+0000","last_unstale":"2023-11-27T17:48:17.199710+0000","last_undegraded":"2023-11-27T17:48:17.199710+0000","last_fullsized":"2023-11-27T17:48:17.199710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:48.392176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026895+0000","last_change":"2023-11-27T17:48:17.185329+0000","last_active":"2023-11-27T17:48:19.026895+0000","last_peered":"2023-11-27T17:48:19.026895+0000","last_clean":"2023-11-27T17:48:19.026895+0000","last_became_active":"2023-11-27T17:48:17.185069+0000","last_became_peered":"2023-11-27T17:48:17.185069+0000","last_unstale":"2023-11-27T17:48:19.026895+0000","last_undegraded":"2023-11-27T17:48:19.026895+0000","last_fullsized":"2023-11-27T17:48:19.026895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196640+0000","last_change":"2023-11-27T17:48:17.195514+0000","last_active":"2023-11-27T17:48:17.196640+0000","last_peered":"2023-11-27T17:48:17.196640+0000","last_clean":"2023-11-27T17:48:17.196640+0000","last_became_active":"2023-11-27T17:48:17.195197+0000","last_became_peered":"2023-11-27T17:48:17.195197+0000","last_unstale":"2023-11-27T17:48:17.196640+0000","last_undegraded":"2023-11-27T17:48:17.196640+0000","last_fullsized":"2023-11-27T17:48:17.196640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:31:18.198472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026425+0000","last_change":"2023-11-27T17:48:17.190515+0000","last_active":"2023-11-27T17:48:19.026425+0000","last_peered":"2023-11-27T17:48:19.026425+0000","last_clean":"2023-11-27T17:48:19.026425+0000","last_became_active":"2023-11-27T17:48:17.190249+0000","last_became_peered":"2023-11-27T17:48:17.190249+0000","last_unstale":"2023-11-27T17:48:19.026425+0000","last_undegraded":"2023-11-27T17:48:19.026425+0000","last_fullsized":"2023-11-27T17:48:19.026425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.195406+0000","last_change":"2023-11-27T17:48:17.193170+0000","last_active":"2023-11-27T17:48:17.195406+0000","last_peered":"2023-11-27T17:48:17.195406+0000","last_clean":"2023-11-27T17:48:17.195406+0000","last_became_active":"2023-11-27T17:48:17.192869+0000","last_became_peered":"2023-11-27T17:48:17.192869+0000","last_unstale":"2023-11-27T17:48:17.195406+0000","last_undegraded":"2023-11-27T17:48:17.195406+0000","last_fullsized":"2023-11-27T17:48:17.195406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349111+0000","last_change":"2023-11-27T17:48:17.183735+0000","last_active":"2023-11-27T17:48:19.349111+0000","last_peered":"2023-11-27T17:48:19.349111+0000","last_clean":"2023-11-27T17:48:19.349111+0000","last_became_active":"2023-11-27T17:48:17.183424+0000","last_became_peered":"2023-11-27T17:48:17.183424+0000","last_unstale":"2023-11-27T17:48:19.349111+0000","last_undegraded":"2023-11-27T17:48:19.349111+0000","last_fullsized":"2023-11-27T17:48:19.349111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199390+0000","last_change":"2023-11-27T17:48:17.178805+0000","last_active":"2023-11-27T17:48:17.199390+0000","last_peered":"2023-11-27T17:48:17.199390+0000","last_clean":"2023-11-27T17:48:17.199390+0000","last_became_active":"2023-11-27T17:48:17.177473+0000","last_became_peered":"2023-11-27T17:48:17.177473+0000","last_unstale":"2023-11-27T17:48:17.199390+0000","last_undegraded":"2023-11-27T17:48:17.199390+0000","last_fullsized":"2023-11-27T17:48:17.199390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:48:21.284 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:48:21.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.437+0000 7f5911e99700 1 Processor -- start 2023-11-27T17:48:21.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.437+0000 7f5911e99700 1 -- start start 2023-11-27T17:48:21.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.438+0000 7f5911e99700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f590c15c660 0x7f590c160660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.438+0000 7f5911e99700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c156ab0 con 0x7f590c1566d0 2023-11-27T17:48:21.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.438+0000 7f5911e99700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c06df10 con 0x7f590c072e10 2023-11-27T17:48:21.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.438+0000 7f5911e99700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c160ba0 con 0x7f590c15c660 2023-11-27T17:48:21.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.438+0000 7f590bfff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f590c15c660 0x7f590c160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.438+0000 7f590b7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f590c1566d0 0x7f590c072700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45762/0 (socket says 172.21.15.177:45762) 2023-11-27T17:48:21.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.438+0000 7f590b7fe700 1 -- 172.21.15.177:0/3470660120 learned_addr learned my addr 172.21.15.177:0/3470660120 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f590bfff700 1 -- 172.21.15.177:0/3470660120 >> v1:172.21.15.178:6789/0 conn(0x7f590c072e10 legacy=0x7f590c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f590bfff700 1 -- 172.21.15.177:0/3470660120 >> v1:172.21.15.177:6789/0 conn(0x7f590c1566d0 legacy=0x7f590c072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f590bfff700 1 -- 172.21.15.177:0/3470660120 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c15cbb0 con 0x7f590c15c660 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f590a7fc700 1 -- 172.21.15.177:0/3470660120 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984066183 0 0) 0x7f590c156ab0 con 0x7f590c1566d0 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f590bfff700 1 --2- 172.21.15.177:0/3470660120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c160660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5904009d90 tx=0x7f590400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4056bec57cb33c89 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f590a7fc700 1 -- 172.21.15.177:0/3470660120 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590400e070 con 0x7f590c15c660 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f590a7fc700 1 -- 172.21.15.177:0/3470660120 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590400bb90 con 0x7f590c15c660 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f590a7fc700 1 -- 172.21.15.177:0/3470660120 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904003a20 con 0x7f590c15c660 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f5911e99700 1 -- 172.21.15.177:0/3470660120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 msgr2=0x7f590c160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f5911e99700 1 --2- 172.21.15.177:0/3470660120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c160660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5904009d90 tx=0x7f590400b330 comp rx=0 tx=0).stop 2023-11-27T17:48:21.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f5911e99700 1 -- 172.21.15.177:0/3470660120 shutdown_connections 2023-11-27T17:48:21.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f5911e99700 1 --2- 172.21.15.177:0/3470660120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c160660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f5911e99700 1 -- 172.21.15.177:0/3470660120 >> 172.21.15.177:0/3470660120 conn(0x7f590c0b1ff0 msgr2=0x7f590c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:21.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f5911e99700 1 -- 172.21.15.177:0/3470660120 shutdown_connections 2023-11-27T17:48:21.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.439+0000 7f5911e99700 1 -- 172.21.15.177:0/3470660120 wait complete. 2023-11-27T17:48:21.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.441+0000 7f5911e99700 1 Processor -- start 2023-11-27T17:48:21.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.441+0000 7f5911e99700 1 -- start start 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.441+0000 7f5911e99700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f590c072e10 0x7f590c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.441+0000 7f5911e99700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f590c1566d0 0x7f590c0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f5911e99700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f5911e99700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c157660 con 0x7f590c15c660 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f5911e99700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0720d0 con 0x7f590c072e10 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f5911e99700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c156d30 con 0x7f590c1566d0 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c0ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51452/0 (socket says 172.21.15.177:51452) 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 -- 172.21.15.177:0/1801377118 learned_addr learned my addr 172.21.15.177:0/1801377118 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590b7fe700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f590c072e10 0x7f590c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590affd700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f590c1566d0 0x7f590c0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 -- 172.21.15.177:0/1801377118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f590c1566d0 msgr2=0x7f590c0ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f590c1566d0 0x7f590c0ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 -- 172.21.15.177:0/1801377118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f590c072e10 msgr2=0x7f590c1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f590c072e10 0x7f590c1557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 -- 172.21.15.177:0/1801377118 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904009a70 con 0x7f590c15c660 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f590bfff700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c0ae6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f590c156c60 tx=0x7f5904004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f58f3fff700 1 -- 172.21.15.177:0/1801377118 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904012630 con 0x7f590c15c660 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f58f3fff700 1 -- 172.21.15.177:0/1801377118 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5904012790 con 0x7f590c15c660 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f58f3fff700 1 -- 172.21.15.177:0/1801377118 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904012b40 con 0x7f590c15c660 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c157010 con 0x7f590c15c660 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.442+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c155d20 con 0x7f590c15c660 2023-11-27T17:48:21.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.443+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c15fb90 con 0x7f590c15c660 2023-11-27T17:48:21.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.444+0000 7f58f3fff700 1 -- 172.21.15.177:0/1801377118 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5904012ca0 con 0x7f590c15c660 2023-11-27T17:48:21.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.444+0000 7f58f3fff700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f58f806b250 0x7f58f806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.444+0000 7f58f3fff700 1 -- 172.21.15.177:0/1801377118 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f590408bc30 con 0x7f590c15c660 2023-11-27T17:48:21.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.444+0000 7f590b7fe700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f58f806b250 0x7f58f806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.444+0000 7f590b7fe700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f58f806b250 0x7f58f806d710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5900000f60 tx=0x7f5900007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.448+0000 7f58f3fff700 1 -- 172.21.15.177:0/1801377118 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f59040569f0 con 0x7f590c15c660 2023-11-27T17:48:21.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.633+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f590c0b1120 con 0x7f58f806b250 2023-11-27T17:48:21.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.641+0000 7f58f3fff700 1 -- 172.21.15.177:0/1801377118 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264657 (secure 0 0 0) 0x7f590c0b1120 con 0x7f58f806b250 2023-11-27T17:48:21.646 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f58f806b250 msgr2=0x7f58f806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f58f806b250 0x7f58f806d710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5900000f60 tx=0x7f5900007be0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 msgr2=0x7f590c0ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c0ae6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f590c156c60 tx=0x7f5904004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 shutdown_connections 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f58f806b250 0x7f58f806d710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f590c15c660 0x7f590c0ae6b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f590c072e10 0x7f590c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 --2- 172.21.15.177:0/1801377118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f590c1566d0 0x7f590c0ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 >> 172.21.15.177:0/1801377118 conn(0x7f590c0b1ff0 msgr2=0x7f590c13df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:21.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 shutdown_connections 2023-11-27T17:48:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.644+0000 7f5911e99700 1 -- 172.21.15.177:0/1801377118 wait complete. 2023-11-27T17:48:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:48:21.658 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-27T17:48:20.620626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2953216,"data_stored":1771304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.460818"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180718+0000","last_change":"2023-11-27T17:48:17.200652+0000","last_active":"2023-11-27T17:48:18.180718+0000","last_peered":"2023-11-27T17:48:18.180718+0000","last_clean":"2023-11-27T17:48:18.180718+0000","last_became_active":"2023-11-27T17:48:17.200367+0000","last_became_peered":"2023-11-27T17:48:17.200367+0000","last_unstale":"2023-11-27T17:48:18.180718+0000","last_undegraded":"2023-11-27T17:48:18.180718+0000","last_fullsized":"2023-11-27T17:48:18.180718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:48.898798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.180041+0000","last_change":"2023-11-27T17:48:17.178900+0000","last_active":"2023-11-27T17:48:17.180041+0000","last_peered":"2023-11-27T17:48:17.180041+0000","last_clean":"2023-11-27T17:48:17.180041+0000","last_became_active":"2023-11-27T17:48:17.178688+0000","last_became_peered":"2023-11-27T17:48:17.178688+0000","last_unstale":"2023-11-27T17:48:17.180041+0000","last_undegraded":"2023-11-27T17:48:17.180041+0000","last_fullsized":"2023-11-27T17:48:17.180041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:40.893618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349059+0000","last_change":"2023-11-27T17:48:17.183900+0000","last_active":"2023-11-27T17:48:19.349059+0000","last_peered":"2023-11-27T17:48:19.349059+0000","last_clean":"2023-11-27T17:48:19.349059+0000","last_became_active":"2023-11-27T17:48:17.183057+0000","last_became_peered":"2023-11-27T17:48:17.183057+0000","last_unstale":"2023-11-27T17:48:19.349059+0000","last_undegraded":"2023-11-27T17:48:19.349059+0000","last_fullsized":"2023-11-27T17:48:19.349059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:35.744910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196471+0000","last_change":"2023-11-27T17:48:17.194895+0000","last_active":"2023-11-27T17:48:17.196471+0000","last_peered":"2023-11-27T17:48:17.196471+0000","last_clean":"2023-11-27T17:48:17.196471+0000","last_became_active":"2023-11-27T17:48:17.194569+0000","last_became_peered":"2023-11-27T17:48:17.194569+0000","last_unstale":"2023-11-27T17:48:17.196471+0000","last_undegraded":"2023-11-27T17:48:17.196471+0000","last_fullsized":"2023-11-27T17:48:17.196471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180037+0000","last_change":"2023-11-27T17:48:17.190418+0000","last_active":"2023-11-27T17:48:18.180037+0000","last_peered":"2023-11-27T17:48:18.180037+0000","last_clean":"2023-11-27T17:48:18.180037+0000","last_became_active":"2023-11-27T17:48:17.190089+0000","last_became_peered":"2023-11-27T17:48:17.190089+0000","last_unstale":"2023-11-27T17:48:18.180037+0000","last_undegraded":"2023-11-27T17:48:18.180037+0000","last_fullsized":"2023-11-27T17:48:18.180037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.184735+0000","last_change":"2023-11-27T17:48:17.183458+0000","last_active":"2023-11-27T17:48:17.184735+0000","last_peered":"2023-11-27T17:48:17.184735+0000","last_clean":"2023-11-27T17:48:17.184735+0000","last_became_active":"2023-11-27T17:48:17.183168+0000","last_became_peered":"2023-11-27T17:48:17.183168+0000","last_unstale":"2023-11-27T17:48:17.184735+0000","last_undegraded":"2023-11-27T17:48:17.184735+0000","last_fullsized":"2023-11-27T17:48:17.184735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180103+0000","last_change":"2023-11-27T17:48:17.185791+0000","last_active":"2023-11-27T17:48:18.180103+0000","last_peered":"2023-11-27T17:48:18.180103+0000","last_clean":"2023-11-27T17:48:18.180103+0000","last_became_active":"2023-11-27T17:48:17.185040+0000","last_became_peered":"2023-11-27T17:48:17.185040+0000","last_unstale":"2023-11-27T17:48:18.180103+0000","last_undegraded":"2023-11-27T17:48:18.180103+0000","last_fullsized":"2023-11-27T17:48:18.180103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026403+0000","last_change":"2023-11-27T17:48:17.189241+0000","last_active":"2023-11-27T17:48:19.026403+0000","last_peered":"2023-11-27T17:48:19.026403+0000","last_clean":"2023-11-27T17:48:19.026403+0000","last_became_active":"2023-11-27T17:48:17.188950+0000","last_became_peered":"2023-11-27T17:48:17.188950+0000","last_unstale":"2023-11-27T17:48:19.026403+0000","last_undegraded":"2023-11-27T17:48:19.026403+0000","last_fullsized":"2023-11-27T17:48:19.026403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180691+0000","last_change":"2023-11-27T17:48:17.196341+0000","last_active":"2023-11-27T17:48:18.180691+0000","last_peered":"2023-11-27T17:48:18.180691+0000","last_clean":"2023-11-27T17:48:18.180691+0000","last_became_active":"2023-11-27T17:48:17.195932+0000","last_became_peered":"2023-11-27T17:48:17.195932+0000","last_unstale":"2023-11-27T17:48:18.180691+0000","last_undegraded":"2023-11-27T17:48:18.180691+0000","last_fullsized":"2023-11-27T17:48:18.180691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:12:54.004348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199431+0000","last_change":"2023-11-27T17:48:17.182144+0000","last_active":"2023-11-27T17:48:17.199431+0000","last_peered":"2023-11-27T17:48:17.199431+0000","last_clean":"2023-11-27T17:48:17.199431+0000","last_became_active":"2023-11-27T17:48:17.181882+0000","last_became_peered":"2023-11-27T17:48:17.181882+0000","last_unstale":"2023-11-27T17:48:17.199431+0000","last_undegraded":"2023-11-27T17:48:17.199431+0000","last_fullsized":"2023-11-27T17:48:17.199431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:45.637872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199458+0000","last_change":"2023-11-27T17:48:17.182351+0000","last_active":"2023-11-27T17:48:17.199458+0000","last_peered":"2023-11-27T17:48:17.199458+0000","last_clean":"2023-11-27T17:48:17.199458+0000","last_became_active":"2023-11-27T17:48:17.182036+0000","last_became_peered":"2023-11-27T17:48:17.182036+0000","last_unstale":"2023-11-27T17:48:17.199458+0000","last_undegraded":"2023-11-27T17:48:17.199458+0000","last_fullsized":"2023-11-27T17:48:17.199458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:07:10.469711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181409+0000","last_change":"2023-11-27T17:48:17.179857+0000","last_active":"2023-11-27T17:48:18.181409+0000","last_peered":"2023-11-27T17:48:18.181409+0000","last_clean":"2023-11-27T17:48:18.181409+0000","last_became_active":"2023-11-27T17:48:17.179396+0000","last_became_peered":"2023-11-27T17:48:17.179396+0000","last_unstale":"2023-11-27T17:48:18.181409+0000","last_undegraded":"2023-11-27T17:48:18.181409+0000","last_fullsized":"2023-11-27T17:48:18.181409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026911+0000","last_change":"2023-11-27T17:48:17.201660+0000","last_active":"2023-11-27T17:48:19.026911+0000","last_peered":"2023-11-27T17:48:19.026911+0000","last_clean":"2023-11-27T17:48:19.026911+0000","last_became_active":"2023-11-27T17:48:17.201412+0000","last_became_peered":"2023-11-27T17:48:17.201412+0000","last_unstale":"2023-11-27T17:48:19.026911+0000","last_undegraded":"2023-11-27T17:48:19.026911+0000","last_fullsized":"2023-11-27T17:48:19.026911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349083+0000","last_change":"2023-11-27T17:48:17.179417+0000","last_active":"2023-11-27T17:48:19.349083+0000","last_peered":"2023-11-27T17:48:19.349083+0000","last_clean":"2023-11-27T17:48:19.349083+0000","last_became_active":"2023-11-27T17:48:17.178865+0000","last_became_peered":"2023-11-27T17:48:17.178865+0000","last_unstale":"2023-11-27T17:48:19.349083+0000","last_undegraded":"2023-11-27T17:48:19.349083+0000","last_fullsized":"2023-11-27T17:48:19.349083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.176511+0000","last_change":"2023-11-27T17:48:17.171870+0000","last_active":"2023-11-27T17:48:17.176511+0000","last_peered":"2023-11-27T17:48:17.176511+0000","last_clean":"2023-11-27T17:48:17.176511+0000","last_became_active":"2023-11-27T17:48:17.171444+0000","last_became_peered":"2023-11-27T17:48:17.171444+0000","last_unstale":"2023-11-27T17:48:17.176511+0000","last_undegraded":"2023-11-27T17:48:17.176511+0000","last_fullsized":"2023-11-27T17:48:17.176511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:45.637872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.185178+0000","last_change":"2023-11-27T17:48:17.183467+0000","last_active":"2023-11-27T17:48:17.185178+0000","last_peered":"2023-11-27T17:48:17.185178+0000","last_clean":"2023-11-27T17:48:17.185178+0000","last_became_active":"2023-11-27T17:48:17.183203+0000","last_became_peered":"2023-11-27T17:48:17.183203+0000","last_unstale":"2023-11-27T17:48:17.185178+0000","last_undegraded":"2023-11-27T17:48:17.185178+0000","last_fullsized":"2023-11-27T17:48:17.185178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.195691+0000","last_change":"2023-11-27T17:48:17.193109+0000","last_active":"2023-11-27T17:48:17.195691+0000","last_peered":"2023-11-27T17:48:17.195691+0000","last_clean":"2023-11-27T17:48:17.195691+0000","last_became_active":"2023-11-27T17:48:17.192836+0000","last_became_peered":"2023-11-27T17:48:17.192836+0000","last_unstale":"2023-11-27T17:48:17.195691+0000","last_undegraded":"2023-11-27T17:48:17.195691+0000","last_fullsized":"2023-11-27T17:48:17.195691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:58.369189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178610+0000","last_change":"2023-11-27T17:48:17.178927+0000","last_active":"2023-11-27T17:48:18.178610+0000","last_peered":"2023-11-27T17:48:18.178610+0000","last_clean":"2023-11-27T17:48:18.178610+0000","last_became_active":"2023-11-27T17:48:17.178668+0000","last_became_peered":"2023-11-27T17:48:17.178668+0000","last_unstale":"2023-11-27T17:48:18.178610+0000","last_undegraded":"2023-11-27T17:48:18.178610+0000","last_fullsized":"2023-11-27T17:48:18.178610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180294+0000","last_change":"2023-11-27T17:48:17.196844+0000","last_active":"2023-11-27T17:48:18.180294+0000","last_peered":"2023-11-27T17:48:18.180294+0000","last_clean":"2023-11-27T17:48:18.180294+0000","last_became_active":"2023-11-27T17:48:17.196588+0000","last_became_peered":"2023-11-27T17:48:17.196588+0000","last_unstale":"2023-11-27T17:48:18.180294+0000","last_undegraded":"2023-11-27T17:48:18.180294+0000","last_fullsized":"2023-11-27T17:48:18.180294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:03.113296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349135+0000","last_change":"2023-11-27T17:48:16.182157+0000","last_active":"2023-11-27T17:48:19.349135+0000","last_peered":"2023-11-27T17:48:19.349135+0000","last_clean":"2023-11-27T17:48:19.349135+0000","last_became_active":"2023-11-27T17:48:16.181789+0000","last_became_peered":"2023-11-27T17:48:16.181789+0000","last_unstale":"2023-11-27T17:48:19.349135+0000","last_undegraded":"2023-11-27T17:48:19.349135+0000","last_fullsized":"2023-11-27T17:48:19.349135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:55.133591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026801+0000","last_change":"2023-11-27T17:48:17.184258+0000","last_active":"2023-11-27T17:48:19.026801+0000","last_peered":"2023-11-27T17:48:19.026801+0000","last_clean":"2023-11-27T17:48:19.026801+0000","last_became_active":"2023-11-27T17:48:17.183985+0000","last_became_peered":"2023-11-27T17:48:17.183985+0000","last_unstale":"2023-11-27T17:48:19.026801+0000","last_undegraded":"2023-11-27T17:48:19.026801+0000","last_fullsized":"2023-11-27T17:48:19.026801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:51.585949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026822+0000","last_change":"2023-11-27T17:48:16.189592+0000","last_active":"2023-11-27T17:48:19.026822+0000","last_peered":"2023-11-27T17:48:19.026822+0000","last_clean":"2023-11-27T17:48:19.026822+0000","last_became_active":"2023-11-27T17:48:16.189296+0000","last_became_peered":"2023-11-27T17:48:16.189296+0000","last_unstale":"2023-11-27T17:48:19.026822+0000","last_undegraded":"2023-11-27T17:48:19.026822+0000","last_fullsized":"2023-11-27T17:48:19.026822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:44.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349044+0000","last_change":"2023-11-27T17:48:17.181599+0000","last_active":"2023-11-27T17:48:19.349044+0000","last_peered":"2023-11-27T17:48:19.349044+0000","last_clean":"2023-11-27T17:48:19.349044+0000","last_became_active":"2023-11-27T17:48:17.180736+0000","last_became_peered":"2023-11-27T17:48:17.180736+0000","last_unstale":"2023-11-27T17:48:19.349044+0000","last_undegraded":"2023-11-27T17:48:19.349044+0000","last_fullsized":"2023-11-27T17:48:19.349044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:48.392176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180482+0000","last_change":"2023-11-27T17:48:16.185981+0000","last_active":"2023-11-27T17:48:18.180482+0000","last_peered":"2023-11-27T17:48:18.180482+0000","last_clean":"2023-11-27T17:48:18.180482+0000","last_became_active":"2023-11-27T17:48:16.185648+0000","last_became_peered":"2023-11-27T17:48:16.185648+0000","last_unstale":"2023-11-27T17:48:18.180482+0000","last_undegraded":"2023-11-27T17:48:18.180482+0000","last_fullsized":"2023-11-27T17:48:18.180482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:27.226337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.195284+0000","last_change":"2023-11-27T17:48:17.192478+0000","last_active":"2023-11-27T17:48:17.195284+0000","last_peered":"2023-11-27T17:48:17.195284+0000","last_clean":"2023-11-27T17:48:17.195284+0000","last_became_active":"2023-11-27T17:48:17.191295+0000","last_became_peered":"2023-11-27T17:48:17.191295+0000","last_unstale":"2023-11-27T17:48:17.195284+0000","last_undegraded":"2023-11-27T17:48:17.195284+0000","last_fullsized":"2023-11-27T17:48:17.195284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:40.893618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179959+0000","last_change":"2023-11-27T17:48:16.182525+0000","last_active":"2023-11-27T17:48:18.179959+0000","last_peered":"2023-11-27T17:48:18.179959+0000","last_clean":"2023-11-27T17:48:18.179959+0000","last_became_active":"2023-11-27T17:48:16.182208+0000","last_became_peered":"2023-11-27T17:48:16.182208+0000","last_unstale":"2023-11-27T17:48:18.179959+0000","last_undegraded":"2023-11-27T17:48:18.179959+0000","last_fullsized":"2023-11-27T17:48:18.179959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.192657+0000","last_change":"2023-11-27T17:48:17.190913+0000","last_active":"2023-11-27T17:48:17.192657+0000","last_peered":"2023-11-27T17:48:17.192657+0000","last_clean":"2023-11-27T17:48:17.192657+0000","last_became_active":"2023-11-27T17:48:17.190591+0000","last_became_peered":"2023-11-27T17:48:17.190591+0000","last_unstale":"2023-11-27T17:48:17.192657+0000","last_undegraded":"2023-11-27T17:48:17.192657+0000","last_fullsized":"2023-11-27T17:48:17.192657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026931+0000","last_change":"2023-11-27T17:48:16.188491+0000","last_active":"2023-11-27T17:48:19.026931+0000","last_peered":"2023-11-27T17:48:19.026931+0000","last_clean":"2023-11-27T17:48:19.026931+0000","last_became_active":"2023-11-27T17:48:16.188301+0000","last_became_peered":"2023-11-27T17:48:16.188301+0000","last_unstale":"2023-11-27T17:48:19.026931+0000","last_undegraded":"2023-11-27T17:48:19.026931+0000","last_fullsized":"2023-11-27T17:48:19.026931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180319+0000","last_change":"2023-11-27T17:48:17.178657+0000","last_active":"2023-11-27T17:48:18.180319+0000","last_peered":"2023-11-27T17:48:18.180319+0000","last_clean":"2023-11-27T17:48:18.180319+0000","last_became_active":"2023-11-27T17:48:17.178374+0000","last_became_peered":"2023-11-27T17:48:17.178374+0000","last_unstale":"2023-11-27T17:48:18.180319+0000","last_undegraded":"2023-11-27T17:48:18.180319+0000","last_fullsized":"2023-11-27T17:48:18.180319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199782+0000","last_change":"2023-11-27T17:48:16.182101+0000","last_active":"2023-11-27T17:48:17.199782+0000","last_peered":"2023-11-27T17:48:17.199782+0000","last_clean":"2023-11-27T17:48:17.199782+0000","last_became_active":"2023-11-27T17:48:16.181767+0000","last_became_peered":"2023-11-27T17:48:16.181767+0000","last_unstale":"2023-11-27T17:48:17.199782+0000","last_undegraded":"2023-11-27T17:48:17.199782+0000","last_fullsized":"2023-11-27T17:48:17.199782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349273+0000","last_change":"2023-11-27T17:48:17.180782+0000","last_active":"2023-11-27T17:48:19.349273+0000","last_peered":"2023-11-27T17:48:19.349273+0000","last_clean":"2023-11-27T17:48:19.349273+0000","last_became_active":"2023-11-27T17:48:17.180463+0000","last_became_peered":"2023-11-27T17:48:17.180463+0000","last_unstale":"2023-11-27T17:48:19.349273+0000","last_undegraded":"2023-11-27T17:48:19.349273+0000","last_fullsized":"2023-11-27T17:48:19.349273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026513+0000","last_change":"2023-11-27T17:48:16.186582+0000","last_active":"2023-11-27T17:48:19.026513+0000","last_peered":"2023-11-27T17:48:19.026513+0000","last_clean":"2023-11-27T17:48:19.026513+0000","last_became_active":"2023-11-27T17:48:16.186290+0000","last_became_peered":"2023-11-27T17:48:16.186290+0000","last_unstale":"2023-11-27T17:48:19.026513+0000","last_undegraded":"2023-11-27T17:48:19.026513+0000","last_fullsized":"2023-11-27T17:48:19.026513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026554+0000","last_change":"2023-11-27T17:48:17.189577+0000","last_active":"2023-11-27T17:48:19.026554+0000","last_peered":"2023-11-27T17:48:19.026554+0000","last_clean":"2023-11-27T17:48:19.026554+0000","last_became_active":"2023-11-27T17:48:17.188679+0000","last_became_peered":"2023-11-27T17:48:17.188679+0000","last_unstale":"2023-11-27T17:48:19.026554+0000","last_undegraded":"2023-11-27T17:48:19.026554+0000","last_fullsized":"2023-11-27T17:48:19.026554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.172634+0000","last_change":"2023-11-27T17:48:16.180119+0000","last_active":"2023-11-27T17:48:17.172634+0000","last_peered":"2023-11-27T17:48:17.172634+0000","last_clean":"2023-11-27T17:48:17.172634+0000","last_became_active":"2023-11-27T17:48:16.179826+0000","last_became_peered":"2023-11-27T17:48:16.179826+0000","last_unstale":"2023-11-27T17:48:17.172634+0000","last_undegraded":"2023-11-27T17:48:17.172634+0000","last_fullsized":"2023-11-27T17:48:17.172634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:47.385160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.188085+0000","last_change":"2023-11-27T17:48:17.186966+0000","last_active":"2023-11-27T17:48:17.188085+0000","last_peered":"2023-11-27T17:48:17.188085+0000","last_clean":"2023-11-27T17:48:17.188085+0000","last_became_active":"2023-11-27T17:48:17.186650+0000","last_became_peered":"2023-11-27T17:48:17.186650+0000","last_unstale":"2023-11-27T17:48:17.188085+0000","last_undegraded":"2023-11-27T17:48:17.188085+0000","last_fullsized":"2023-11-27T17:48:17.188085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.172103+0000","last_change":"2023-11-27T17:48:16.180021+0000","last_active":"2023-11-27T17:48:17.172103+0000","last_peered":"2023-11-27T17:48:17.172103+0000","last_clean":"2023-11-27T17:48:17.172103+0000","last_became_active":"2023-11-27T17:48:16.179702+0000","last_became_peered":"2023-11-27T17:48:16.179702+0000","last_unstale":"2023-11-27T17:48:17.172103+0000","last_undegraded":"2023-11-27T17:48:17.172103+0000","last_fullsized":"2023-11-27T17:48:17.172103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:55.133591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.189243+0000","last_change":"2023-11-27T17:48:17.186938+0000","last_active":"2023-11-27T17:48:17.189243+0000","last_peered":"2023-11-27T17:48:17.189243+0000","last_clean":"2023-11-27T17:48:17.189243+0000","last_became_active":"2023-11-27T17:48:17.186711+0000","last_became_peered":"2023-11-27T17:48:17.186711+0000","last_unstale":"2023-11-27T17:48:17.189243+0000","last_undegraded":"2023-11-27T17:48:17.189243+0000","last_fullsized":"2023-11-27T17:48:17.189243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.172293+0000","last_change":"2023-11-27T17:48:16.182253+0000","last_active":"2023-11-27T17:48:17.172293+0000","last_peered":"2023-11-27T17:48:17.172293+0000","last_clean":"2023-11-27T17:48:17.172293+0000","last_became_active":"2023-11-27T17:48:16.181399+0000","last_became_peered":"2023-11-27T17:48:16.181399+0000","last_unstale":"2023-11-27T17:48:17.172293+0000","last_undegraded":"2023-11-27T17:48:17.172293+0000","last_fullsized":"2023-11-27T17:48:17.172293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:44.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349254+0000","last_change":"2023-11-27T17:48:17.181837+0000","last_active":"2023-11-27T17:48:19.349254+0000","last_peered":"2023-11-27T17:48:19.349254+0000","last_clean":"2023-11-27T17:48:19.349254+0000","last_became_active":"2023-11-27T17:48:17.181271+0000","last_became_peered":"2023-11-27T17:48:17.181271+0000","last_unstale":"2023-11-27T17:48:19.349254+0000","last_undegraded":"2023-11-27T17:48:19.349254+0000","last_fullsized":"2023-11-27T17:48:19.349254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.192067+0000","last_change":"2023-11-27T17:48:16.177994+0000","last_active":"2023-11-27T17:48:17.192067+0000","last_peered":"2023-11-27T17:48:17.192067+0000","last_clean":"2023-11-27T17:48:17.192067+0000","last_became_active":"2023-11-27T17:48:16.177727+0000","last_became_peered":"2023-11-27T17:48:16.177727+0000","last_unstale":"2023-11-27T17:48:17.192067+0000","last_undegraded":"2023-11-27T17:48:17.192067+0000","last_fullsized":"2023-11-27T17:48:17.192067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181325+0000","last_change":"2023-11-27T17:48:17.198710+0000","last_active":"2023-11-27T17:48:18.181325+0000","last_peered":"2023-11-27T17:48:18.181325+0000","last_clean":"2023-11-27T17:48:18.181325+0000","last_became_active":"2023-11-27T17:48:17.198406+0000","last_became_peered":"2023-11-27T17:48:17.198406+0000","last_unstale":"2023-11-27T17:48:18.181325+0000","last_undegraded":"2023-11-27T17:48:18.181325+0000","last_fullsized":"2023-11-27T17:48:18.181325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.203511+0000","last_change":"2023-11-27T17:48:16.191881+0000","last_active":"2023-11-27T17:48:17.203511+0000","last_peered":"2023-11-27T17:48:17.203511+0000","last_clean":"2023-11-27T17:48:17.203511+0000","last_became_active":"2023-11-27T17:48:16.191647+0000","last_became_peered":"2023-11-27T17:48:16.191647+0000","last_unstale":"2023-11-27T17:48:17.203511+0000","last_undegraded":"2023-11-27T17:48:17.203511+0000","last_fullsized":"2023-11-27T17:48:17.203511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180322+0000","last_change":"2023-11-27T17:48:17.196086+0000","last_active":"2023-11-27T17:48:18.180322+0000","last_peered":"2023-11-27T17:48:18.180322+0000","last_clean":"2023-11-27T17:48:18.180322+0000","last_became_active":"2023-11-27T17:48:17.195707+0000","last_became_peered":"2023-11-27T17:48:17.195707+0000","last_unstale":"2023-11-27T17:48:18.180322+0000","last_undegraded":"2023-11-27T17:48:18.180322+0000","last_fullsized":"2023-11-27T17:48:18.180322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:36.527615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349199+0000","last_change":"2023-11-27T17:48:16.178114+0000","last_active":"2023-11-27T17:48:19.349199+0000","last_peered":"2023-11-27T17:48:19.349199+0000","last_clean":"2023-11-27T17:48:19.349199+0000","last_became_active":"2023-11-27T17:48:16.177834+0000","last_became_peered":"2023-11-27T17:48:16.177834+0000","last_unstale":"2023-11-27T17:48:19.349199+0000","last_undegraded":"2023-11-27T17:48:19.349199+0000","last_fullsized":"2023-11-27T17:48:19.349199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349059+0000","last_change":"2023-11-27T17:48:17.187918+0000","last_active":"2023-11-27T17:48:19.349059+0000","last_peered":"2023-11-27T17:48:19.349059+0000","last_clean":"2023-11-27T17:48:19.349059+0000","last_became_active":"2023-11-27T17:48:17.187649+0000","last_became_peered":"2023-11-27T17:48:17.187649+0000","last_unstale":"2023-11-27T17:48:19.349059+0000","last_undegraded":"2023-11-27T17:48:19.349059+0000","last_fullsized":"2023-11-27T17:48:19.349059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:40.893618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.174191+0000","last_change":"2023-11-27T17:48:16.188695+0000","last_active":"2023-11-27T17:48:17.174191+0000","last_peered":"2023-11-27T17:48:17.174191+0000","last_clean":"2023-11-27T17:48:17.174191+0000","last_became_active":"2023-11-27T17:48:16.188414+0000","last_became_peered":"2023-11-27T17:48:16.188414+0000","last_unstale":"2023-11-27T17:48:17.174191+0000","last_undegraded":"2023-11-27T17:48:17.174191+0000","last_fullsized":"2023-11-27T17:48:17.174191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:17.074762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180262+0000","last_change":"2023-11-27T17:48:17.192145+0000","last_active":"2023-11-27T17:48:18.180262+0000","last_peered":"2023-11-27T17:48:18.180262+0000","last_clean":"2023-11-27T17:48:18.180262+0000","last_became_active":"2023-11-27T17:48:17.191826+0000","last_became_peered":"2023-11-27T17:48:17.191826+0000","last_unstale":"2023-11-27T17:48:18.180262+0000","last_undegraded":"2023-11-27T17:48:18.180262+0000","last_fullsized":"2023-11-27T17:48:18.180262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.171426+0000","last_change":"2023-11-27T17:48:16.181257+0000","last_active":"2023-11-27T17:48:17.171426+0000","last_peered":"2023-11-27T17:48:17.171426+0000","last_clean":"2023-11-27T17:48:17.171426+0000","last_became_active":"2023-11-27T17:48:16.180955+0000","last_became_peered":"2023-11-27T17:48:16.180955+0000","last_unstale":"2023-11-27T17:48:17.171426+0000","last_undegraded":"2023-11-27T17:48:17.171426+0000","last_fullsized":"2023-11-27T17:48:17.171426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:57.362173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199563+0000","last_change":"2023-11-27T17:48:17.184780+0000","last_active":"2023-11-27T17:48:17.199563+0000","last_peered":"2023-11-27T17:48:17.199563+0000","last_clean":"2023-11-27T17:48:17.199563+0000","last_became_active":"2023-11-27T17:48:17.184496+0000","last_became_peered":"2023-11-27T17:48:17.184496+0000","last_unstale":"2023-11-27T17:48:17.199563+0000","last_undegraded":"2023-11-27T17:48:17.199563+0000","last_fullsized":"2023-11-27T17:48:17.199563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:31:18.198472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178470+0000","last_change":"2023-11-27T17:48:16.176239+0000","last_active":"2023-11-27T17:48:18.178470+0000","last_peered":"2023-11-27T17:48:18.178470+0000","last_clean":"2023-11-27T17:48:18.178470+0000","last_became_active":"2023-11-27T17:48:16.175935+0000","last_became_peered":"2023-11-27T17:48:16.175935+0000","last_unstale":"2023-11-27T17:48:18.178470+0000","last_undegraded":"2023-11-27T17:48:18.178470+0000","last_fullsized":"2023-11-27T17:48:18.178470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:31:17.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180890+0000","last_change":"2023-11-27T17:48:17.192173+0000","last_active":"2023-11-27T17:48:18.180890+0000","last_peered":"2023-11-27T17:48:18.180890+0000","last_clean":"2023-11-27T17:48:18.180890+0000","last_became_active":"2023-11-27T17:48:17.191886+0000","last_became_peered":"2023-11-27T17:48:17.191886+0000","last_unstale":"2023-11-27T17:48:18.180890+0000","last_undegraded":"2023-11-27T17:48:18.180890+0000","last_fullsized":"2023-11-27T17:48:18.180890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:59.251403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181348+0000","last_change":"2023-11-27T17:48:16.178737+0000","last_active":"2023-11-27T17:48:18.181348+0000","last_peered":"2023-11-27T17:48:18.181348+0000","last_clean":"2023-11-27T17:48:18.181348+0000","last_became_active":"2023-11-27T17:48:16.178440+0000","last_became_peered":"2023-11-27T17:48:16.178440+0000","last_unstale":"2023-11-27T17:48:18.181348+0000","last_undegraded":"2023-11-27T17:48:18.181348+0000","last_fullsized":"2023-11-27T17:48:18.181348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:46:28.658758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180221+0000","last_change":"2023-11-27T17:48:17.199254+0000","last_active":"2023-11-27T17:48:18.180221+0000","last_peered":"2023-11-27T17:48:18.180221+0000","last_clean":"2023-11-27T17:48:18.180221+0000","last_became_active":"2023-11-27T17:48:17.198787+0000","last_became_peered":"2023-11-27T17:48:17.198787+0000","last_unstale":"2023-11-27T17:48:18.180221+0000","last_undegraded":"2023-11-27T17:48:18.180221+0000","last_fullsized":"2023-11-27T17:48:18.180221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.170301+0000","last_change":"2023-11-27T17:48:16.178655+0000","last_active":"2023-11-27T17:48:17.170301+0000","last_peered":"2023-11-27T17:48:17.170301+0000","last_clean":"2023-11-27T17:48:17.170301+0000","last_became_active":"2023-11-27T17:48:16.178370+0000","last_became_peered":"2023-11-27T17:48:16.178370+0000","last_unstale":"2023-11-27T17:48:17.170301+0000","last_undegraded":"2023-11-27T17:48:17.170301+0000","last_fullsized":"2023-11-27T17:48:17.170301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:34.737894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196644+0000","last_change":"2023-11-27T17:48:17.194445+0000","last_active":"2023-11-27T17:48:17.196644+0000","last_peered":"2023-11-27T17:48:17.196644+0000","last_clean":"2023-11-27T17:48:17.196644+0000","last_became_active":"2023-11-27T17:48:17.194134+0000","last_became_peered":"2023-11-27T17:48:17.194134+0000","last_unstale":"2023-11-27T17:48:17.196644+0000","last_undegraded":"2023-11-27T17:48:17.196644+0000","last_fullsized":"2023-11-27T17:48:17.196644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:07:10.469711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.174049+0000","last_change":"2023-11-27T17:48:16.182152+0000","last_active":"2023-11-27T17:48:17.174049+0000","last_peered":"2023-11-27T17:48:17.174049+0000","last_clean":"2023-11-27T17:48:17.174049+0000","last_became_active":"2023-11-27T17:48:16.181769+0000","last_became_peered":"2023-11-27T17:48:16.181769+0000","last_unstale":"2023-11-27T17:48:17.174049+0000","last_undegraded":"2023-11-27T17:48:17.174049+0000","last_fullsized":"2023-11-27T17:48:17.174049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:48.481068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181152+0000","last_change":"2023-11-27T17:48:17.189104+0000","last_active":"2023-11-27T17:48:18.181152+0000","last_peered":"2023-11-27T17:48:18.181152+0000","last_clean":"2023-11-27T17:48:18.181152+0000","last_became_active":"2023-11-27T17:48:17.188416+0000","last_became_peered":"2023-11-27T17:48:17.188416+0000","last_unstale":"2023-11-27T17:48:18.181152+0000","last_undegraded":"2023-11-27T17:48:18.181152+0000","last_fullsized":"2023-11-27T17:48:18.181152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.180115+0000","last_change":"2023-11-27T17:48:17.177845+0000","last_active":"2023-11-27T17:48:17.180115+0000","last_peered":"2023-11-27T17:48:17.180115+0000","last_clean":"2023-11-27T17:48:17.180115+0000","last_became_active":"2023-11-27T17:48:17.177556+0000","last_became_peered":"2023-11-27T17:48:17.177556+0000","last_unstale":"2023-11-27T17:48:17.180115+0000","last_undegraded":"2023-11-27T17:48:17.180115+0000","last_fullsized":"2023-11-27T17:48:17.180115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178490+0000","last_change":"2023-11-27T17:48:16.189008+0000","last_active":"2023-11-27T17:48:18.178490+0000","last_peered":"2023-11-27T17:48:18.178490+0000","last_clean":"2023-11-27T17:48:18.178490+0000","last_became_active":"2023-11-27T17:48:16.188800+0000","last_became_peered":"2023-11-27T17:48:16.188800+0000","last_unstale":"2023-11-27T17:48:18.178490+0000","last_undegraded":"2023-11-27T17:48:18.178490+0000","last_fullsized":"2023-11-27T17:48:18.178490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:00.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026519+0000","last_change":"2023-11-27T17:48:17.186845+0000","last_active":"2023-11-27T17:48:19.026519+0000","last_peered":"2023-11-27T17:48:19.026519+0000","last_clean":"2023-11-27T17:48:19.026519+0000","last_became_active":"2023-11-27T17:48:17.186071+0000","last_became_peered":"2023-11-27T17:48:17.186071+0000","last_unstale":"2023-11-27T17:48:19.026519+0000","last_undegraded":"2023-11-27T17:48:19.026519+0000","last_fullsized":"2023-11-27T17:48:19.026519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.172525+0000","last_change":"2023-11-27T17:48:16.183104+0000","last_active":"2023-11-27T17:48:17.172525+0000","last_peered":"2023-11-27T17:48:17.172525+0000","last_clean":"2023-11-27T17:48:17.172525+0000","last_became_active":"2023-11-27T17:48:16.182831+0000","last_became_peered":"2023-11-27T17:48:16.182831+0000","last_unstale":"2023-11-27T17:48:17.172525+0000","last_undegraded":"2023-11-27T17:48:17.172525+0000","last_fullsized":"2023-11-27T17:48:17.172525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.177763+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:48:17.177763+0000","last_peered":"2023-11-27T17:48:17.177763+0000","last_clean":"2023-11-27T17:48:17.177763+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:48:17.177763+0000","last_undegraded":"2023-11-27T17:48:17.177763+0000","last_fullsized":"2023-11-27T17:48:17.177763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.348882+0000","last_change":"2023-11-27T17:48:17.179815+0000","last_active":"2023-11-27T17:48:19.348882+0000","last_peered":"2023-11-27T17:48:19.348882+0000","last_clean":"2023-11-27T17:48:19.348882+0000","last_became_active":"2023-11-27T17:48:17.179567+0000","last_became_peered":"2023-11-27T17:48:17.179567+0000","last_unstale":"2023-11-27T17:48:19.348882+0000","last_undegraded":"2023-11-27T17:48:19.348882+0000","last_fullsized":"2023-11-27T17:48:19.348882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:49.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179912+0000","last_change":"2023-11-27T17:48:16.178695+0000","last_active":"2023-11-27T17:48:18.179912+0000","last_peered":"2023-11-27T17:48:18.179912+0000","last_clean":"2023-11-27T17:48:18.179912+0000","last_became_active":"2023-11-27T17:48:16.178387+0000","last_became_peered":"2023-11-27T17:48:16.178387+0000","last_unstale":"2023-11-27T17:48:18.179912+0000","last_undegraded":"2023-11-27T17:48:18.179912+0000","last_fullsized":"2023-11-27T17:48:18.179912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180387+0000","last_change":"2023-11-27T17:48:16.187600+0000","last_active":"2023-11-27T17:48:18.180387+0000","last_peered":"2023-11-27T17:48:18.180387+0000","last_clean":"2023-11-27T17:48:18.180387+0000","last_became_active":"2023-11-27T17:48:16.187268+0000","last_became_peered":"2023-11-27T17:48:16.187268+0000","last_unstale":"2023-11-27T17:48:18.180387+0000","last_undegraded":"2023-11-27T17:48:18.180387+0000","last_fullsized":"2023-11-27T17:48:18.180387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:17.074762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.179505+0000","last_change":"2023-11-27T17:48:17.175788+0000","last_active":"2023-11-27T17:48:17.179505+0000","last_peered":"2023-11-27T17:48:17.179505+0000","last_clean":"2023-11-27T17:48:17.179505+0000","last_became_active":"2023-11-27T17:48:17.175498+0000","last_became_peered":"2023-11-27T17:48:17.175498+0000","last_unstale":"2023-11-27T17:48:17.179505+0000","last_undegraded":"2023-11-27T17:48:17.179505+0000","last_fullsized":"2023-11-27T17:48:17.179505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.169731+0000","last_change":"2023-11-27T17:48:16.182683+0000","last_active":"2023-11-27T17:48:17.169731+0000","last_peered":"2023-11-27T17:48:17.169731+0000","last_clean":"2023-11-27T17:48:17.169731+0000","last_became_active":"2023-11-27T17:48:16.182410+0000","last_became_peered":"2023-11-27T17:48:16.182410+0000","last_unstale":"2023-11-27T17:48:17.169731+0000","last_undegraded":"2023-11-27T17:48:17.169731+0000","last_fullsized":"2023-11-27T17:48:17.169731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026903+0000","last_change":"2023-11-27T17:48:17.193285+0000","last_active":"2023-11-27T17:48:19.026903+0000","last_peered":"2023-11-27T17:48:19.026903+0000","last_clean":"2023-11-27T17:48:19.026903+0000","last_became_active":"2023-11-27T17:48:17.192965+0000","last_became_peered":"2023-11-27T17:48:17.192965+0000","last_unstale":"2023-11-27T17:48:19.026903+0000","last_undegraded":"2023-11-27T17:48:19.026903+0000","last_fullsized":"2023-11-27T17:48:19.026903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199876+0000","last_change":"2023-11-27T17:48:16.182590+0000","last_active":"2023-11-27T17:48:17.199876+0000","last_peered":"2023-11-27T17:48:17.199876+0000","last_clean":"2023-11-27T17:48:17.199876+0000","last_became_active":"2023-11-27T17:48:16.182327+0000","last_became_peered":"2023-11-27T17:48:16.182327+0000","last_unstale":"2023-11-27T17:48:17.199876+0000","last_undegraded":"2023-11-27T17:48:17.199876+0000","last_fullsized":"2023-11-27T17:48:17.199876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349130+0000","last_change":"2023-11-27T17:48:17.182568+0000","last_active":"2023-11-27T17:48:19.349130+0000","last_peered":"2023-11-27T17:48:19.349130+0000","last_clean":"2023-11-27T17:48:19.349130+0000","last_became_active":"2023-11-27T17:48:17.182245+0000","last_became_peered":"2023-11-27T17:48:17.182245+0000","last_unstale":"2023-11-27T17:48:19.349130+0000","last_undegraded":"2023-11-27T17:48:19.349130+0000","last_fullsized":"2023-11-27T17:48:19.349130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179561+0000","last_change":"2023-11-27T17:48:16.188084+0000","last_active":"2023-11-27T17:48:18.179561+0000","last_peered":"2023-11-27T17:48:18.179561+0000","last_clean":"2023-11-27T17:48:18.179561+0000","last_became_active":"2023-11-27T17:48:16.187806+0000","last_became_peered":"2023-11-27T17:48:16.187806+0000","last_unstale":"2023-11-27T17:48:18.179561+0000","last_undegraded":"2023-11-27T17:48:18.179561+0000","last_fullsized":"2023-11-27T17:48:18.179561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:57.362173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180842+0000","last_change":"2023-11-27T17:48:17.175327+0000","last_active":"2023-11-27T17:48:18.180842+0000","last_peered":"2023-11-27T17:48:18.180842+0000","last_clean":"2023-11-27T17:48:18.180842+0000","last_became_active":"2023-11-27T17:48:17.173427+0000","last_became_peered":"2023-11-27T17:48:17.173427+0000","last_unstale":"2023-11-27T17:48:18.180842+0000","last_undegraded":"2023-11-27T17:48:18.180842+0000","last_fullsized":"2023-11-27T17:48:18.180842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:58.369189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.170129+0000","last_change":"2023-11-27T17:48:16.181314+0000","last_active":"2023-11-27T17:48:17.170129+0000","last_peered":"2023-11-27T17:48:17.170129+0000","last_clean":"2023-11-27T17:48:17.170129+0000","last_became_active":"2023-11-27T17:48:16.181069+0000","last_became_peered":"2023-11-27T17:48:16.181069+0000","last_unstale":"2023-11-27T17:48:17.170129+0000","last_undegraded":"2023-11-27T17:48:17.170129+0000","last_fullsized":"2023-11-27T17:48:17.170129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:47.385160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026499+0000","last_change":"2023-11-27T17:48:17.189442+0000","last_active":"2023-11-27T17:48:19.026499+0000","last_peered":"2023-11-27T17:48:19.026499+0000","last_clean":"2023-11-27T17:48:19.026499+0000","last_became_active":"2023-11-27T17:48:17.188944+0000","last_became_peered":"2023-11-27T17:48:17.188944+0000","last_unstale":"2023-11-27T17:48:19.026499+0000","last_undegraded":"2023-11-27T17:48:19.026499+0000","last_fullsized":"2023-11-27T17:48:19.026499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.168724+0000","last_change":"2023-11-27T17:48:16.188610+0000","last_active":"2023-11-27T17:48:17.168724+0000","last_peered":"2023-11-27T17:48:17.168724+0000","last_clean":"2023-11-27T17:48:17.168724+0000","last_became_active":"2023-11-27T17:48:16.188323+0000","last_became_peered":"2023-11-27T17:48:16.188323+0000","last_unstale":"2023-11-27T17:48:17.168724+0000","last_undegraded":"2023-11-27T17:48:17.168724+0000","last_fullsized":"2023-11-27T17:48:17.168724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:07:09.462696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.027010+0000","last_change":"2023-11-27T17:48:17.191974+0000","last_active":"2023-11-27T17:48:19.027010+0000","last_peered":"2023-11-27T17:48:19.027010+0000","last_clean":"2023-11-27T17:48:19.027010+0000","last_became_active":"2023-11-27T17:48:17.191681+0000","last_became_peered":"2023-11-27T17:48:17.191681+0000","last_unstale":"2023-11-27T17:48:19.027010+0000","last_undegraded":"2023-11-27T17:48:19.027010+0000","last_fullsized":"2023-11-27T17:48:19.027010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180165+0000","last_change":"2023-11-27T17:48:16.186595+0000","last_active":"2023-11-27T17:48:18.180165+0000","last_peered":"2023-11-27T17:48:18.180165+0000","last_clean":"2023-11-27T17:48:18.180165+0000","last_became_active":"2023-11-27T17:48:16.186241+0000","last_became_peered":"2023-11-27T17:48:16.186241+0000","last_unstale":"2023-11-27T17:48:18.180165+0000","last_undegraded":"2023-11-27T17:48:18.180165+0000","last_fullsized":"2023-11-27T17:48:18.180165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199470+0000","last_change":"2023-11-27T17:48:17.183997+0000","last_active":"2023-11-27T17:48:17.199470+0000","last_peered":"2023-11-27T17:48:17.199470+0000","last_clean":"2023-11-27T17:48:17.199470+0000","last_became_active":"2023-11-27T17:48:17.183811+0000","last_became_peered":"2023-11-27T17:48:17.183811+0000","last_unstale":"2023-11-27T17:48:17.199470+0000","last_undegraded":"2023-11-27T17:48:17.199470+0000","last_fullsized":"2023-11-27T17:48:17.199470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:49.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178737+0000","last_change":"2023-11-27T17:48:16.181997+0000","last_active":"2023-11-27T17:48:18.178737+0000","last_peered":"2023-11-27T17:48:18.178737+0000","last_clean":"2023-11-27T17:48:18.178737+0000","last_became_active":"2023-11-27T17:48:16.181707+0000","last_became_peered":"2023-11-27T17:48:16.181707+0000","last_unstale":"2023-11-27T17:48:18.178737+0000","last_undegraded":"2023-11-27T17:48:18.178737+0000","last_fullsized":"2023-11-27T17:48:18.178737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:40:57.780308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180474+0000","last_change":"2023-11-27T17:48:17.193351+0000","last_active":"2023-11-27T17:48:18.180474+0000","last_peered":"2023-11-27T17:48:18.180474+0000","last_clean":"2023-11-27T17:48:18.180474+0000","last_became_active":"2023-11-27T17:48:17.193076+0000","last_became_peered":"2023-11-27T17:48:17.193076+0000","last_unstale":"2023-11-27T17:48:18.180474+0000","last_undegraded":"2023-11-27T17:48:18.180474+0000","last_fullsized":"2023-11-27T17:48:18.180474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:30:58.565092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.198596+0000","last_change":"2023-11-27T17:48:16.178672+0000","last_active":"2023-11-27T17:48:17.198596+0000","last_peered":"2023-11-27T17:48:17.198596+0000","last_clean":"2023-11-27T17:48:17.198596+0000","last_became_active":"2023-11-27T17:48:16.178391+0000","last_became_peered":"2023-11-27T17:48:16.178391+0000","last_unstale":"2023-11-27T17:48:17.198596+0000","last_undegraded":"2023-11-27T17:48:17.198596+0000","last_fullsized":"2023-11-27T17:48:17.198596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196432+0000","last_change":"2023-11-27T17:48:17.194730+0000","last_active":"2023-11-27T17:48:17.196432+0000","last_peered":"2023-11-27T17:48:17.196432+0000","last_clean":"2023-11-27T17:48:17.196432+0000","last_became_active":"2023-11-27T17:48:17.194183+0000","last_became_peered":"2023-11-27T17:48:17.194183+0000","last_unstale":"2023-11-27T17:48:17.196432+0000","last_undegraded":"2023-11-27T17:48:17.196432+0000","last_fullsized":"2023-11-27T17:48:17.196432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:16.361646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178784+0000","last_change":"2023-11-27T17:48:16.188442+0000","last_active":"2023-11-27T17:48:18.178784+0000","last_peered":"2023-11-27T17:48:18.178784+0000","last_clean":"2023-11-27T17:48:18.178784+0000","last_became_active":"2023-11-27T17:48:16.188146+0000","last_became_peered":"2023-11-27T17:48:16.188146+0000","last_unstale":"2023-11-27T17:48:18.178784+0000","last_undegraded":"2023-11-27T17:48:18.178784+0000","last_fullsized":"2023-11-27T17:48:18.178784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:08.552823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180553+0000","last_change":"2023-11-27T17:48:17.199070+0000","last_active":"2023-11-27T17:48:18.180553+0000","last_peered":"2023-11-27T17:48:18.180553+0000","last_clean":"2023-11-27T17:48:18.180553+0000","last_became_active":"2023-11-27T17:48:17.198789+0000","last_became_peered":"2023-11-27T17:48:17.198789+0000","last_unstale":"2023-11-27T17:48:18.180553+0000","last_undegraded":"2023-11-27T17:48:18.180553+0000","last_fullsized":"2023-11-27T17:48:18.180553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:16.621575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199595+0000","last_change":"2023-11-27T17:48:17.184790+0000","last_active":"2023-11-27T17:48:17.199595+0000","last_peered":"2023-11-27T17:48:17.199595+0000","last_clean":"2023-11-27T17:48:17.199595+0000","last_became_active":"2023-11-27T17:48:17.184506+0000","last_became_peered":"2023-11-27T17:48:17.184506+0000","last_unstale":"2023-11-27T17:48:17.199595+0000","last_undegraded":"2023-11-27T17:48:17.199595+0000","last_fullsized":"2023-11-27T17:48:17.199595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178588+0000","last_change":"2023-11-27T17:48:17.178158+0000","last_active":"2023-11-27T17:48:18.178588+0000","last_peered":"2023-11-27T17:48:18.178588+0000","last_clean":"2023-11-27T17:48:18.178588+0000","last_became_active":"2023-11-27T17:48:17.176996+0000","last_became_peered":"2023-11-27T17:48:17.176996+0000","last_unstale":"2023-11-27T17:48:18.178588+0000","last_undegraded":"2023-11-27T17:48:18.178588+0000","last_fullsized":"2023-11-27T17:48:18.178588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196524+0000","last_change":"2023-11-27T17:48:17.194747+0000","last_active":"2023-11-27T17:48:17.196524+0000","last_peered":"2023-11-27T17:48:17.196524+0000","last_clean":"2023-11-27T17:48:17.196524+0000","last_became_active":"2023-11-27T17:48:17.194564+0000","last_became_peered":"2023-11-27T17:48:17.194564+0000","last_unstale":"2023-11-27T17:48:17.196524+0000","last_undegraded":"2023-11-27T17:48:17.196524+0000","last_fullsized":"2023-11-27T17:48:17.196524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:35.744910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349197+0000","last_change":"2023-11-27T17:48:17.187682+0000","last_active":"2023-11-27T17:48:19.349197+0000","last_peered":"2023-11-27T17:48:19.349197+0000","last_clean":"2023-11-27T17:48:19.349197+0000","last_became_active":"2023-11-27T17:48:17.187461+0000","last_became_peered":"2023-11-27T17:48:17.187461+0000","last_unstale":"2023-11-27T17:48:19.349197+0000","last_undegraded":"2023-11-27T17:48:19.349197+0000","last_fullsized":"2023-11-27T17:48:19.349197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026758+0000","last_change":"2023-11-27T17:48:17.186202+0000","last_active":"2023-11-27T17:48:19.026758+0000","last_peered":"2023-11-27T17:48:19.026758+0000","last_clean":"2023-11-27T17:48:19.026758+0000","last_became_active":"2023-11-27T17:48:17.185863+0000","last_became_peered":"2023-11-27T17:48:17.185863+0000","last_unstale":"2023-11-27T17:48:19.026758+0000","last_undegraded":"2023-11-27T17:48:19.026758+0000","last_fullsized":"2023-11-27T17:48:19.026758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.194500+0000","last_change":"2023-11-27T17:48:17.190715+0000","last_active":"2023-11-27T17:48:17.194500+0000","last_peered":"2023-11-27T17:48:17.194500+0000","last_clean":"2023-11-27T17:48:17.194500+0000","last_became_active":"2023-11-27T17:48:17.190445+0000","last_became_peered":"2023-11-27T17:48:17.190445+0000","last_unstale":"2023-11-27T17:48:17.194500+0000","last_undegraded":"2023-11-27T17:48:17.194500+0000","last_fullsized":"2023-11-27T17:48:17.194500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:58.369189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199710+0000","last_change":"2023-11-27T17:48:17.194783+0000","last_active":"2023-11-27T17:48:17.199710+0000","last_peered":"2023-11-27T17:48:17.199710+0000","last_clean":"2023-11-27T17:48:17.199710+0000","last_became_active":"2023-11-27T17:48:17.194541+0000","last_became_peered":"2023-11-27T17:48:17.194541+0000","last_unstale":"2023-11-27T17:48:17.199710+0000","last_undegraded":"2023-11-27T17:48:17.199710+0000","last_fullsized":"2023-11-27T17:48:17.199710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:48.392176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026895+0000","last_change":"2023-11-27T17:48:17.185329+0000","last_active":"2023-11-27T17:48:19.026895+0000","last_peered":"2023-11-27T17:48:19.026895+0000","last_clean":"2023-11-27T17:48:19.026895+0000","last_became_active":"2023-11-27T17:48:17.185069+0000","last_became_peered":"2023-11-27T17:48:17.185069+0000","last_unstale":"2023-11-27T17:48:19.026895+0000","last_undegraded":"2023-11-27T17:48:19.026895+0000","last_fullsized":"2023-11-27T17:48:19.026895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.196640+0000","last_change":"2023-11-27T17:48:17.195514+0000","last_active":"2023-11-27T17:48:17.196640+0000","last_peered":"2023-11-27T17:48:17.196640+0000","last_clean":"2023-11-27T17:48:17.196640+0000","last_became_active":"2023-11-27T17:48:17.195197+0000","last_became_peered":"2023-11-27T17:48:17.195197+0000","last_unstale":"2023-11-27T17:48:17.196640+0000","last_undegraded":"2023-11-27T17:48:17.196640+0000","last_fullsized":"2023-11-27T17:48:17.196640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:31:18.198472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026425+0000","last_change":"2023-11-27T17:48:17.190515+0000","last_active":"2023-11-27T17:48:19.026425+0000","last_peered":"2023-11-27T17:48:19.026425+0000","last_clean":"2023-11-27T17:48:19.026425+0000","last_became_active":"2023-11-27T17:48:17.190249+0000","last_became_peered":"2023-11-27T17:48:17.190249+0000","last_unstale":"2023-11-27T17:48:19.026425+0000","last_undegraded":"2023-11-27T17:48:19.026425+0000","last_fullsized":"2023-11-27T17:48:19.026425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.195406+0000","last_change":"2023-11-27T17:48:17.193170+0000","last_active":"2023-11-27T17:48:17.195406+0000","last_peered":"2023-11-27T17:48:17.195406+0000","last_clean":"2023-11-27T17:48:17.195406+0000","last_became_active":"2023-11-27T17:48:17.192869+0000","last_became_peered":"2023-11-27T17:48:17.192869+0000","last_unstale":"2023-11-27T17:48:17.195406+0000","last_undegraded":"2023-11-27T17:48:17.195406+0000","last_fullsized":"2023-11-27T17:48:17.195406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349111+0000","last_change":"2023-11-27T17:48:17.183735+0000","last_active":"2023-11-27T17:48:19.349111+0000","last_peered":"2023-11-27T17:48:19.349111+0000","last_clean":"2023-11-27T17:48:19.349111+0000","last_became_active":"2023-11-27T17:48:17.183424+0000","last_became_peered":"2023-11-27T17:48:17.183424+0000","last_unstale":"2023-11-27T17:48:19.349111+0000","last_undegraded":"2023-11-27T17:48:19.349111+0000","last_fullsized":"2023-11-27T17:48:19.349111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.199390+0000","last_change":"2023-11-27T17:48:17.178805+0000","last_active":"2023-11-27T17:48:17.199390+0000","last_peered":"2023-11-27T17:48:17.199390+0000","last_clean":"2023-11-27T17:48:17.199390+0000","last_became_active":"2023-11-27T17:48:17.177473+0000","last_became_peered":"2023-11-27T17:48:17.177473+0000","last_unstale":"2023-11-27T17:48:17.199390+0000","last_undegraded":"2023-11-27T17:48:17.199390+0000","last_fullsized":"2023-11-27T17:48:17.199390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:48:21.662 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T17:48:21.663 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-27T17:48:21.663 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-27T17:48:21.663 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-27T17:48:21.663 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-27T17:48:21.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.816+0000 7fd054053700 1 Processor -- start 2023-11-27T17:48:21.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.816+0000 7fd054053700 1 -- start start 2023-11-27T17:48:21.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd054053700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd04c06d910 0x7fd04c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd054053700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c0b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd054053700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd04c06dcf0 0x7fd04c0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd054053700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c06e520 con 0x7fd04c06dcf0 2023-11-27T17:48:21.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd054053700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c06efc0 con 0x7fd04c06d910 2023-11-27T17:48:21.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd054053700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c06f2a0 con 0x7fd04c15e880 2023-11-27T17:48:21.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd0525f0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd04c06dcf0 0x7fd04c0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd0525f0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd04c06dcf0 0x7fd04c0b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51460/0 (socket says 172.21.15.177:51460) 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd0525f0700 1 -- 172.21.15.177:0/1666522886 learned_addr learned my addr 172.21.15.177:0/1666522886 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd0515ee700 1 --2- 172.21.15.177:0/1666522886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c0b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd0525f0700 1 -- 172.21.15.177:0/1666522886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 msgr2=0x7fd04c0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd0525f0700 1 --2- 172.21.15.177:0/1666522886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c0b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd0525f0700 1 -- 172.21.15.177:0/1666522886 >> v2:172.21.15.178:3300/0 conn(0x7fd04c06d910 msgr2=0x7fd04c06e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd051def700 1 --2- 172.21.15.177:0/1666522886 >> v2:172.21.15.178:3300/0 conn(0x7fd04c06d910 0x7fd04c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.817+0000 7fd0525f0700 1 --2- 172.21.15.177:0/1666522886 >> v2:172.21.15.178:3300/0 conn(0x7fd04c06d910 0x7fd04c06e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd0525f0700 1 -- 172.21.15.177:0/1666522886 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c06f580 con 0x7fd04c06dcf0 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd0515ee700 1 --2- 172.21.15.177:0/1666522886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c0b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd051def700 1 --2- 172.21.15.177:0/1666522886 >> v2:172.21.15.178:3300/0 conn(0x7fd04c06d910 0x7fd04c06e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd0525f0700 1 --2- 172.21.15.177:0/1666522886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06dcf0 0x7fd04c0b0b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0b57d0 tx=0x7fd04400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8becd424a6a6ab server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd050ded700 1 -- 172.21.15.177:0/1666522886 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400e070 con 0x7fd04c06dcf0 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd050ded700 1 -- 172.21.15.177:0/1666522886 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04400b9c0 con 0x7fd04c06dcf0 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd050ded700 1 -- 172.21.15.177:0/1666522886 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400bd70 con 0x7fd04c06dcf0 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd054053700 1 -- 172.21.15.177:0/1666522886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06dcf0 msgr2=0x7fd04c0b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd054053700 1 --2- 172.21.15.177:0/1666522886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06dcf0 0x7fd04c0b0b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0b57d0 tx=0x7fd04400b330 comp rx=0 tx=0).stop 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd054053700 1 -- 172.21.15.177:0/1666522886 shutdown_connections 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd054053700 1 --2- 172.21.15.177:0/1666522886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06dcf0 0x7fd04c0b0b30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd054053700 1 --2- 172.21.15.177:0/1666522886 >> v2:172.21.15.178:3300/0 conn(0x7fd04c06d910 0x7fd04c06e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd054053700 1 --2- 172.21.15.177:0/1666522886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c0b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.818+0000 7fd054053700 1 -- 172.21.15.177:0/1666522886 >> 172.21.15.177:0/1666522886 conn(0x7fd04c0b2130 msgr2=0x7fd04c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:21.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.819+0000 7fd054053700 1 -- 172.21.15.177:0/1666522886 shutdown_connections 2023-11-27T17:48:21.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.819+0000 7fd054053700 1 -- 172.21.15.177:0/1666522886 wait complete. 2023-11-27T17:48:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd054053700 1 Processor -- start 2023-11-27T17:48:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd054053700 1 -- start start 2023-11-27T17:48:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd054053700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06d910 0x7fd04c0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd054053700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd04c06dcf0 0x7fd04c145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd054053700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd054053700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c146820 con 0x7fd04c06d910 2023-11-27T17:48:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd054053700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c146ac0 con 0x7fd04c06dcf0 2023-11-27T17:48:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd054053700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0a9ca0 con 0x7fd04c15e880 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd051def700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06d910 0x7fd04c0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd051def700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06d910 0x7fd04c0a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51462/0 (socket says 172.21.15.177:51462) 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.820+0000 7fd051def700 1 -- 172.21.15.177:0/4053046396 learned_addr learned my addr 172.21.15.177:0/4053046396 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd0525f0700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd0515ee700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd04c06dcf0 0x7fd04c145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd051def700 1 -- 172.21.15.177:0/4053046396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 msgr2=0x7fd04c15cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd051def700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c15cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd051def700 1 -- 172.21.15.177:0/4053046396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd04c06dcf0 msgr2=0x7fd04c145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd051def700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd04c06dcf0 0x7fd04c145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd051def700 1 -- 172.21.15.177:0/4053046396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009b30 con 0x7fd04c06d910 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd051def700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06d910 0x7fd04c0a9450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00ed40 tx=0x7fd03c007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd0427fc700 1 -- 172.21.15.177:0/4053046396 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c007ac0 con 0x7fd04c06d910 2023-11-27T17:48:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd0427fc700 1 -- 172.21.15.177:0/4053046396 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c007c20 con 0x7fd04c06d910 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c0a9f80 con 0x7fd04c06d910 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd0427fc700 1 -- 172.21.15.177:0/4053046396 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c010440 con 0x7fd04c06d910 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.821+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c0a9990 con 0x7fd04c06d910 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.822+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c073aa0 con 0x7fd04c06d910 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.823+0000 7fd0427fc700 1 -- 172.21.15.177:0/4053046396 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd03c0105a0 con 0x7fd04c06d910 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.823+0000 7fd0427fc700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd03006b250 0x7fd03006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.823+0000 7fd0427fc700 1 -- 172.21.15.177:0/4053046396 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd03c014070 con 0x7fd04c06d910 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.823+0000 7fd0515ee700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd03006b250 0x7fd03006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.823+0000 7fd0515ee700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd03006b250 0x7fd03006d710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd04c15e470 tx=0x7fd048008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:21.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:21.827+0000 7fd0427fc700 1 -- 172.21.15.177:0/4053046396 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd03c056e30 con 0x7fd04c06d910 2023-11-27T17:48:22.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.078+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd04c069400 con 0x7fd04c06d910 2023-11-27T17:48:22.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.081+0000 7fd0427fc700 1 -- 172.21.15.177:0/4053046396 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171170 (secure 0 0 0) 0x7fd03c05a450 con 0x7fd04c06d910 2023-11-27T17:48:22.085 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:22.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd03006b250 msgr2=0x7fd03006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd03006b250 0x7fd03006d710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd04c15e470 tx=0x7fd048008040 comp rx=0 tx=0).stop 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06d910 msgr2=0x7fd04c0a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06d910 0x7fd04c0a9450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00ed40 tx=0x7fd03c007320 comp rx=0 tx=0).stop 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 shutdown_connections 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd03006b250 0x7fd03006d710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd04c15e880 0x7fd04c15cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c06d910 0x7fd04c0a9450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 --2- 172.21.15.177:0/4053046396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd04c06dcf0 0x7fd04c145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 >> 172.21.15.177:0/4053046396 conn(0x7fd04c0b2130 msgr2=0x7fd04c0cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:22.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 shutdown_connections 2023-11-27T17:48:22.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.084+0000 7fd054053700 1 -- 172.21.15.177:0/4053046396 wait complete. 2023-11-27T17:48:22.098 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":5,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2467053977},{"type":"v1","addr":"172.21.15.177:6833","nonce":2467053977}]},"active_addr":"172.21.15.177:6833/2467053977","active_change":"2023-11-27T17:48:04.612799+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3692497790}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2402530413}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3670523781}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3049935915}]}]} 2023-11-27T17:48:22.101 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-27T17:48:22.101 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-27T17:48:22.102 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:22.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.222+0000 7fe67b22e700 1 Processor -- start 2023-11-27T17:48:22.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.222+0000 7fe67b22e700 1 -- start start 2023-11-27T17:48:22.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe67b22e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe674156010 0x7fe6741563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe67b22e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe67b22e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6740cdbd0 con 0x7fe6740d0900 2023-11-27T17:48:22.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe67b22e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67415d370 con 0x7fe674156010 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe67b22e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740d04e0 con 0x7fe674070c00 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe678fca700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe674156010 0x7fe6741563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe678fca700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe674156010 0x7fe6741563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51470/0 (socket says 172.21.15.177:51470) 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe678fca700 1 -- 172.21.15.177:0/1997702533 learned_addr learned my addr 172.21.15.177:0/1997702533 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.223+0000 7fe673fff700 1 --1- 172.21.15.177:0/1997702533 >> v1:172.21.15.177:6789/0 conn(0x7fe6740d0900 0x7fe6740704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45788/0 (socket says 172.21.15.177:45788) 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe6797cb700 1 --2- 172.21.15.177:0/1997702533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe678fca700 1 -- 172.21.15.177:0/1997702533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 msgr2=0x7fe67415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe678fca700 1 --2- 172.21.15.177:0/1997702533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe678fca700 1 -- 172.21.15.177:0/1997702533 >> v1:172.21.15.177:6789/0 conn(0x7fe6740d0900 legacy=0x7fe6740704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe678fca700 1 -- 172.21.15.177:0/1997702533 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740cfba0 con 0x7fe674156010 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe6737fe700 1 -- 172.21.15.177:0/1997702533 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279495530 0 0) 0x7fe6740cdbd0 con 0x7fe6740d0900 2023-11-27T17:48:22.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe6797cb700 1 --2- 172.21.15.177:0/1997702533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe678fca700 1 --2- 172.21.15.177:0/1997702533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe674156010 0x7fe6741563f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098f0 tx=0x7fe668009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8faf23b4296fe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe6737fe700 1 -- 172.21.15.177:0/1997702533 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800b8a0 con 0x7fe674156010 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe6737fe700 1 -- 172.21.15.177:0/1997702533 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800ba00 con 0x7fe674156010 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe6737fe700 1 -- 172.21.15.177:0/1997702533 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800bd90 con 0x7fe674156010 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe67b22e700 1 -- 172.21.15.177:0/1997702533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe674156010 msgr2=0x7fe6741563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe67b22e700 1 --2- 172.21.15.177:0/1997702533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe674156010 0x7fe6741563f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098f0 tx=0x7fe668009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe67b22e700 1 -- 172.21.15.177:0/1997702533 shutdown_connections 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe67b22e700 1 --2- 172.21.15.177:0/1997702533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.224+0000 7fe67b22e700 1 --2- 172.21.15.177:0/1997702533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe674156010 0x7fe6741563f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.225+0000 7fe67b22e700 1 -- 172.21.15.177:0/1997702533 >> 172.21.15.177:0/1997702533 conn(0x7fe6740b2130 msgr2=0x7fe6740b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.225+0000 7fe67b22e700 1 -- 172.21.15.177:0/1997702533 shutdown_connections 2023-11-27T17:48:22.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.225+0000 7fe67b22e700 1 -- 172.21.15.177:0/1997702533 wait complete. 2023-11-27T17:48:22.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.226+0000 7fe67b22e700 1 Processor -- start 2023-11-27T17:48:22.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.226+0000 7fe67b22e700 1 -- start start 2023-11-27T17:48:22.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe67b22e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67414b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe67b22e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6740d0900 0x7fe674152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe67b22e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe674156010 0x7fe674149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe67b22e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67414aa80 con 0x7fe6740d0900 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe67b22e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741f19c0 con 0x7fe674156010 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe67b22e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67414ac90 con 0x7fe674070c00 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe673fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6740d0900 0x7fe674152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe673fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6740d0900 0x7fe674152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51478/0 (socket says 172.21.15.177:51478) 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe673fff700 1 -- 172.21.15.177:0/3930932384 learned_addr learned my addr 172.21.15.177:0/3930932384 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.227+0000 7fe678fca700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67414b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe673fff700 1 -- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 msgr2=0x7fe67414b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe673fff700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67414b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe6797cb700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe674156010 0x7fe674149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe673fff700 1 -- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe674156010 msgr2=0x7fe674149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe673fff700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe674156010 0x7fe674149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe673fff700 1 -- 172.21.15.177:0/3930932384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009550 con 0x7fe6740d0900 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe678fca700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe673fff700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6740d0900 0x7fe674152840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6600011e0 tx=0x7fe66000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe6717fa700 1 -- 172.21.15.177:0/3930932384 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660004c80 con 0x7fe6740d0900 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe6717fa700 1 -- 172.21.15.177:0/3930932384 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660004e00 con 0x7fe6740d0900 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67414af70 con 0x7fe6740d0900 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe6717fa700 1 -- 172.21.15.177:0/3930932384 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660007310 con 0x7fe6740d0900 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.228+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6741f1f70 con 0x7fe6740d0900 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.229+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe674073aa0 con 0x7fe6740d0900 2023-11-27T17:48:22.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.229+0000 7fe6717fa700 1 -- 172.21.15.177:0/3930932384 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe660007470 con 0x7fe6740d0900 2023-11-27T17:48:22.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.230+0000 7fe6717fa700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65806b250 0x7fe65806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.230+0000 7fe6717fa700 1 -- 172.21.15.177:0/3930932384 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe660089700 con 0x7fe6740d0900 2023-11-27T17:48:22.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.230+0000 7fe678fca700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65806b250 0x7fe65806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.230+0000 7fe678fca700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65806b250 0x7fe65806d710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe674153930 tx=0x7fe668008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:22.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.234+0000 7fe6717fa700 1 -- 172.21.15.177:0/3930932384 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe6600544c0 con 0x7fe6740d0900 2023-11-27T17:48:22.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.424+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe674069400 con 0x7fe6740d0900 2023-11-27T17:48:22.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.425+0000 7fe6717fa700 1 -- 172.21.15.177:0/3930932384 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fe660057ae0 con 0x7fe6740d0900 2023-11-27T17:48:22.428 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:22.428 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65806b250 msgr2=0x7fe65806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65806b250 0x7fe65806d710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe674153930 tx=0x7fe668008030 comp rx=0 tx=0).stop 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6740d0900 msgr2=0x7fe674152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6740d0900 0x7fe674152840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6600011e0 tx=0x7fe66000cae0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 shutdown_connections 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65806b250 0x7fe65806d710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe674156010 0x7fe674149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe674070c00 0x7fe67414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 --2- 172.21.15.177:0/3930932384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6740d0900 0x7fe674152840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 >> 172.21.15.177:0/3930932384 conn(0x7fe6740b2130 msgr2=0x7fe6740b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:22.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 shutdown_connections 2023-11-27T17:48:22.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.427+0000 7fe67b22e700 1 -- 172.21.15.177:0/3930932384 wait complete. 2023-11-27T17:48:22.442 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-27T17:48:22.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.559+0000 7fafd3ad9700 1 Processor -- start 2023-11-27T17:48:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.559+0000 7fafd3ad9700 1 -- start start 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.560+0000 7fafd3ad9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fafcc070c00 0x7fafcc168d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.560+0000 7fafd3ad9700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc06e200 con 0x7fafcc147810 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.560+0000 7fafd3ad9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc06e4e0 con 0x7fafcc0b64f0 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.560+0000 7fafd3ad9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc15e970 con 0x7fafcc070c00 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.560+0000 7fafd1875700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fafcc147810 0x7fafcc06d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45802/0 (socket says 172.21.15.177:45802) 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.560+0000 7fafd1875700 1 -- 172.21.15.177:0/4133057747 learned_addr learned my addr 172.21.15.177:0/4133057747 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd2076700 1 --2- 172.21.15.177:0/4133057747 >> v2:172.21.15.178:3300/0 conn(0x7fafcc070c00 0x7fafcc168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862420768 0 0) 0x7fafcc06e200 con 0x7fafcc147810 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb80035b0 con 0x7fafcc147810 2023-11-27T17:48:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243157641 0 0) 0x7fafcc06e4e0 con 0x7fafcc0b64f0 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafcc06e200 con 0x7fafcc0b64f0 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226973799 0 0) 0x7fafb80035b0 con 0x7fafcc147810 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 >> v2:172.21.15.178:3300/0 conn(0x7fafcc070c00 msgr2=0x7fafcc168d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 --2- 172.21.15.177:0/4133057747 >> v2:172.21.15.178:3300/0 conn(0x7fafcc070c00 0x7fafcc168d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 >> v1:172.21.15.178:6789/0 conn(0x7fafcc0b64f0 legacy=0x7fafcc0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc15ec50 con 0x7fafcc147810 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fafbc001670 con 0x7fafcc147810 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 >> v1:172.21.15.177:6789/0 conn(0x7fafcc147810 legacy=0x7fafcc06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafb8003b90 0x7fafb8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8004850 0x7fafb8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb8005280 0x7fafb800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc15e970 con 0x7fafb8005280 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb800c1e0 con 0x7fafb8004850 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb800c3a0 con 0x7fafb8003b90 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd2076700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb8005280 0x7fafb800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd1074700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8004850 0x7fafb8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd1875700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafb8003b90 0x7fafb8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd2076700 1 -- 172.21.15.177:0/4133057747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafb8003b90 msgr2=0x7fafb8003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd2076700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafb8003b90 0x7fafb8003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd2076700 1 -- 172.21.15.177:0/4133057747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8004850 msgr2=0x7fafb8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd2076700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8004850 0x7fafb8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd2076700 1 -- 172.21.15.177:0/4133057747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80035b0 con 0x7fafb8005280 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.561+0000 7fafd2076700 1 -- 172.21.15.177:0/4133057747 reap_dead start 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd2076700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb8005280 0x7fafb800ba10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fafcc06d650 tx=0x7fafb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767a3624490a15d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4003c20 con 0x7fafb8005280 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc400f040 con 0x7fafb8005280 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd0873700 1 -- 172.21.15.177:0/4133057747 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400e9d0 con 0x7fafb8005280 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd3ad9700 1 -- 172.21.15.177:0/4133057747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb8005280 msgr2=0x7fafb800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd3ad9700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb8005280 0x7fafb800ba10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fafcc06d650 tx=0x7fafb8005880 comp rx=0 tx=0).stop 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd3ad9700 1 -- 172.21.15.177:0/4133057747 shutdown_connections 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd3ad9700 1 --2- 172.21.15.177:0/4133057747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb8005280 0x7fafb800ba10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd3ad9700 1 -- 172.21.15.177:0/4133057747 >> 172.21.15.177:0/4133057747 conn(0x7fafcc0b2130 msgr2=0x7fafcc0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd3ad9700 1 -- 172.21.15.177:0/4133057747 shutdown_connections 2023-11-27T17:48:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.562+0000 7fafd3ad9700 1 -- 172.21.15.177:0/4133057747 wait complete. 2023-11-27T17:48:22.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.563+0000 7fafd3ad9700 1 Processor -- start 2023-11-27T17:48:22.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd3ad9700 1 -- start start 2023-11-27T17:48:22.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd3ad9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8005280 0x7fafcc0ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd3ad9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafcc1f6dc0 0x7fafcc1f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd3ad9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafcc1f7780 0x7fafcc1f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd3ad9700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1f7c30 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd3ad9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1f4360 con 0x7fafb8005280 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd3ad9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1f4640 con 0x7fafcc1f7780 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd1074700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafcc1f6dc0 0x7fafcc1f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd1074700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafcc1f6dc0 0x7fafcc1f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51498/0 (socket says 172.21.15.177:51498) 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd1074700 1 -- 172.21.15.177:0/3872096155 learned_addr learned my addr 172.21.15.177:0/3872096155 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd2076700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafcc1f7780 0x7fafcc1f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.564+0000 7fafd1875700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8005280 0x7fafcc0ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafd1074700 1 -- 172.21.15.177:0/3872096155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafcc1f7780 msgr2=0x7fafcc1f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafd1074700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafcc1f7780 0x7fafcc1f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafd1074700 1 -- 172.21.15.177:0/3872096155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8005280 msgr2=0x7fafcc0ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafd1074700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8005280 0x7fafcc0ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafd1074700 1 -- 172.21.15.177:0/3872096155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc1f4920 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafd1074700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafcc1f6dc0 0x7fafcc1f7240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fafc800f7a0 tx=0x7fafc800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafc27fc700 1 -- 172.21.15.177:0/3872096155 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8005320 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafc27fc700 1 -- 172.21.15.177:0/3872096155 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc80054a0 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc1f4c00 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafc27fc700 1 -- 172.21.15.177:0/3872096155 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8006aa0 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.565+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc072cc0 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.566+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc073aa0 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.566+0000 7fafc27fc700 1 -- 172.21.15.177:0/3872096155 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fafc8006c00 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.567+0000 7fafc27fc700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafb006b280 0x7fafb006d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.567+0000 7fafc27fc700 1 -- 172.21.15.177:0/3872096155 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafc8089000 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.567+0000 7fafd1875700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafb006b280 0x7fafb006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.567+0000 7fafd1875700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafb006b280 0x7fafb006d740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafbc001eb0 tx=0x7fafbc001e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:22.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.571+0000 7fafc27fc700 1 -- 172.21.15.177:0/3872096155 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fafc8053d30 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.764+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafcc069400 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.765+0000 7fafc27fc700 1 -- 172.21.15.177:0/3872096155 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fafc8057350 con 0x7fafcc1f6dc0 2023-11-27T17:48:22.768 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:22.768 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:22.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafb006b280 msgr2=0x7fafb006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafb006b280 0x7fafb006d740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafbc001eb0 tx=0x7fafbc001e00 comp rx=0 tx=0).stop 2023-11-27T17:48:22.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafcc1f6dc0 msgr2=0x7fafcc1f7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafcc1f6dc0 0x7fafcc1f7240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fafc800f7a0 tx=0x7fafc800fab0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 shutdown_connections 2023-11-27T17:48:22.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fafb006b280 0x7fafb006d740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafcc1f7780 0x7fafcc1f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafb8005280 0x7fafcc0ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 --2- 172.21.15.177:0/3872096155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafcc1f6dc0 0x7fafcc1f7240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 >> 172.21.15.177:0/3872096155 conn(0x7fafcc0b2130 msgr2=0x7fafcc1468b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 shutdown_connections 2023-11-27T17:48:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.768+0000 7fafd3ad9700 1 -- 172.21.15.177:0/3872096155 wait complete. 2023-11-27T17:48:22.783 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-27T17:48:22.783 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-27T17:48:22.783 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-27T17:48:22.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-27T17:48:22.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-27T17:48:22.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-27T17:48:22.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-27T17:48:22.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-27T17:48:22.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.992+0000 7f951e088700 1 Processor -- start 2023-11-27T17:48:22.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.992+0000 7f951e088700 1 -- start start 2023-11-27T17:48:22.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.992+0000 7f951e088700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f951806d8d0 0x7f9518166980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.992+0000 7f951e088700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f95180cdf60 0x7f9518162020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:22.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.992+0000 7f951e088700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95180cfae0 con 0x7f95180cdb80 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.992+0000 7f951e088700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9518166580 con 0x7f95180cdf60 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.992+0000 7f951e088700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95180cfdc0 con 0x7f951806d8d0 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f9516ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f951806d8d0 0x7f9518166980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f9516ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f951806d8d0 0x7f9518166980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59528/0 (socket says 172.21.15.177:59528) 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f9516ffd700 1 -- 172.21.15.177:0/3957462632 learned_addr learned my addr 172.21.15.177:0/3957462632 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f9516ffd700 1 -- 172.21.15.177:0/3957462632 >> v2:172.21.15.177:3300/0 conn(0x7f95180cdf60 msgr2=0x7f9518162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f9516ffd700 1 --2- 172.21.15.177:0/3957462632 >> v2:172.21.15.177:3300/0 conn(0x7f95180cdf60 0x7f9518162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f9516ffd700 1 -- 172.21.15.177:0/3957462632 >> v1:172.21.15.177:6789/0 conn(0x7f95180cdb80 legacy=0x7f95180cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f9516ffd700 1 -- 172.21.15.177:0/3957462632 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180d00a0 con 0x7f951806d8d0 2023-11-27T17:48:22.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f9516ffd700 1 --2- 172.21.15.177:0/3957462632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f951806d8d0 0x7f9518166980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95180b3190 tx=0x7f9508009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c42f980e9094b96b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:22.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f95167fc700 1 -- 172.21.15.177:0/3957462632 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508004230 con 0x7f951806d8d0 2023-11-27T17:48:22.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f95167fc700 1 -- 172.21.15.177:0/3957462632 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508004390 con 0x7f951806d8d0 2023-11-27T17:48:22.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.993+0000 7f95167fc700 1 -- 172.21.15.177:0/3957462632 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95080036a0 con 0x7f951806d8d0 2023-11-27T17:48:22.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.994+0000 7f951e088700 1 -- 172.21.15.177:0/3957462632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f951806d8d0 msgr2=0x7f9518166980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:22.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.994+0000 7f951e088700 1 --2- 172.21.15.177:0/3957462632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f951806d8d0 0x7f9518166980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95180b3190 tx=0x7f9508009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.994+0000 7f951e088700 1 -- 172.21.15.177:0/3957462632 shutdown_connections 2023-11-27T17:48:22.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.994+0000 7f951e088700 1 --2- 172.21.15.177:0/3957462632 >> v2:172.21.15.177:3300/0 conn(0x7f95180cdf60 0x7f9518162020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.994+0000 7f951e088700 1 --2- 172.21.15.177:0/3957462632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f951806d8d0 0x7f9518166980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:22.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.994+0000 7f951e088700 1 -- 172.21.15.177:0/3957462632 >> 172.21.15.177:0/3957462632 conn(0x7f9518067000 msgr2=0x7f95180b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:22.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.994+0000 7f951e088700 1 -- 172.21.15.177:0/3957462632 shutdown_connections 2023-11-27T17:48:22.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.994+0000 7f951e088700 1 -- 172.21.15.177:0/3957462632 wait complete. 2023-11-27T17:48:22.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.996+0000 7f951e088700 1 Processor -- start 2023-11-27T17:48:22.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.995+0000 7fd47eb41700 1 Processor -- start 2023-11-27T17:48:22.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.995+0000 7fd47eb41700 1 -- start start 2023-11-27T17:48:22.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.996+0000 7f951e088700 1 -- start start 2023-11-27T17:48:23.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.996+0000 7fd47eb41700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd478071930 0x7fd4781685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47eb41700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd478070b70 con 0x7fd4780ca990 2023-11-27T17:48:23.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47eb41700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd478070e50 con 0x7fd4780cae10 2023-11-27T17:48:23.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47eb41700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd478071130 con 0x7fd478071930 2023-11-27T17:48:23.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47c8dd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd478071930 0x7fd4781685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f31d857c700 1 Processor -- start 2023-11-27T17:48:23.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47c8dd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd478071930 0x7fd4781685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:38976/0 (socket says 172.21.15.177:38976) 2023-11-27T17:48:23.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47c8dd700 1 -- 172.21.15.177:0/3144505636 learned_addr learned my addr 172.21.15.177:0/3144505636 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47c8dd700 1 -- 172.21.15.177:0/3144505636 >> v1:172.21.15.178:6789/0 conn(0x7fd4780cae10 legacy=0x7fd478175930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47c8dd700 1 -- 172.21.15.177:0/3144505636 >> v1:172.21.15.177:6789/0 conn(0x7fd4780ca990 legacy=0x7fd4780b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7fd47c8dd700 1 -- 172.21.15.177:0/3144505636 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd478071410 con 0x7fd478071930 2023-11-27T17:48:23.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f951e088700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f951806d8d0 0x7f951813f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f951e088700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95180cdb80 0x7f9518162920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f951e088700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95180cdf60 0x7f95181406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f951e088700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9518163170 con 0x7f951806d8d0 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f951e088700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951813ccb0 con 0x7f95180cdf60 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f951e088700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951813dc80 con 0x7f95180cdb80 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f9516ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95180cdb80 0x7f9518162920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f9517fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95180cdf60 0x7f95181406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f9516ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95180cdb80 0x7f9518162920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:38984/0 (socket says 172.21.15.177:38984) 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f9516ffd700 1 -- 172.21.15.177:0/3470233872 learned_addr learned my addr 172.21.15.177:0/3470233872 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f9516ffd700 1 -- 172.21.15.177:0/3470233872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95180cdf60 msgr2=0x7f95181406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f9516ffd700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95180cdf60 0x7f95181406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f9516ffd700 1 -- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f951806d8d0 msgr2=0x7f951813f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f9516ffd700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f951806d8d0 0x7f951813f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f9516ffd700 1 -- 172.21.15.177:0/3470233872 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9508009550 con 0x7f95180cdb80 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f9516ffd700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95180cdb80 0x7f9518162920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9508009130 tx=0x7f9508004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508011630 con 0x7f95180cdb80 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508011790 con 0x7f95180cdb80 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508011b20 con 0x7f95180cdb80 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f951e088700 1 -- 172.21.15.177:0/3470233872 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951813cec0 con 0x7f95180cdb80 2023-11-27T17:48:23.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.997+0000 7f31d857c700 1 -- start start 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f31d857c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f31d0162540 0x7f31d0071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f31d857c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00720d0 0x7f31d00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f31d857c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d00713a0 con 0x7f31d00cd210 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f31d857c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d00cd6c0 con 0x7f31d0162540 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f31d857c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00cfca0 con 0x7f31d00720d0 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f31d5b17700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00720d0 0x7f31d00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f31d5b17700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00720d0 0x7f31d00cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:38990/0 (socket says 172.21.15.177:38990) 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f31d5b17700 1 -- 172.21.15.177:0/3606044177 learned_addr learned my addr 172.21.15.177:0/3606044177 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f474ddab700 1 Processor -- start 2023-11-27T17:48:23.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.998+0000 7f474ddab700 1 -- start start 2023-11-27T17:48:23.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7fd47c8dd700 1 --2- 172.21.15.177:0/3144505636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd478071930 0x7fd4781685f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd468009310 tx=0x7fd468009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92821c9e6e43c324 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f31d5b17700 1 -- 172.21.15.177:0/3606044177 >> v2:172.21.15.177:3300/0 conn(0x7f31d0162540 msgr2=0x7f31d0071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f31d5b17700 1 --2- 172.21.15.177:0/3606044177 >> v2:172.21.15.177:3300/0 conn(0x7f31d0162540 0x7f31d0071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f31d5b17700 1 -- 172.21.15.177:0/3606044177 >> v1:172.21.15.178:6789/0 conn(0x7f31d00cd210 legacy=0x7f31d00ce3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:23.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f31d5b17700 1 -- 172.21.15.177:0/3606044177 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d0162920 con 0x7f31d00720d0 2023-11-27T17:48:23.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f474ddab700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4748071110 0x7f47480cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f474ddab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47480cb250 0x7f47480ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f474ddab700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47480cba40 con 0x7f474815adb0 2023-11-27T17:48:23.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f474ddab700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4748070cf0 con 0x7f4748071110 2023-11-27T17:48:23.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f474ddab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47480cb760 con 0x7f47480cb250 2023-11-27T17:48:23.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f4746ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4748071110 0x7f47480cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f4747fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47480cb250 0x7f47480ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f4746ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4748071110 0x7f47480cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59548/0 (socket says 172.21.15.177:59548) 2023-11-27T17:48:23.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f4747fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47480cb250 0x7f47480ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:38994/0 (socket says 172.21.15.177:38994) 2023-11-27T17:48:23.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f4746ffd700 1 -- 172.21.15.177:0/1287643770 learned_addr learned my addr 172.21.15.177:0/1287643770 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f951e088700 1 -- 172.21.15.177:0/3470233872 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951813d480 con 0x7f95180cdb80 2023-11-27T17:48:23.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7fd4777fe700 1 -- 172.21.15.177:0/3144505636 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468004230 con 0x7fd478071930 2023-11-27T17:48:23.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7fd4777fe700 1 -- 172.21.15.177:0/3144505636 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd468004390 con 0x7fd478071930 2023-11-27T17:48:23.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7fd4777fe700 1 -- 172.21.15.177:0/3144505636 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468009860 con 0x7fd478071930 2023-11-27T17:48:23.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:22.999+0000 7f31d5b17700 1 --2- 172.21.15.177:0/3606044177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00720d0 0x7f31d00cccd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0098f0 tx=0x7f31cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72e1f689567b5e55 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9518162560 con 0x7f95180cdb80 2023-11-27T17:48:23.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f4747fff700 1 -- 172.21.15.177:0/1287643770 >> v2:172.21.15.178:3300/0 conn(0x7f4748071110 msgr2=0x7f47480cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f4747fff700 1 --2- 172.21.15.177:0/1287643770 >> v2:172.21.15.178:3300/0 conn(0x7f4748071110 0x7f47480cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f4747fff700 1 -- 172.21.15.177:0/1287643770 >> v1:172.21.15.177:6789/0 conn(0x7f474815adb0 legacy=0x7f474815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f4747fff700 1 -- 172.21.15.177:0/1287643770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4748070630 con 0x7f47480cb250 2023-11-27T17:48:23.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f4747fff700 1 --2- 172.21.15.177:0/1287643770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47480cb250 0x7f47480ccdc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f474000c2e0 tx=0x7f474000c5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0f57b0f04f1a62a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f31d5316700 1 -- 172.21.15.177:0/3606044177 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc004230 con 0x7f31d00720d0 2023-11-27T17:48:23.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f31d5316700 1 -- 172.21.15.177:0/3606044177 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc004390 con 0x7f31d00720d0 2023-11-27T17:48:23.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f31d5316700 1 -- 172.21.15.177:0/3606044177 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0036a0 con 0x7f31d00720d0 2023-11-27T17:48:23.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7fd47eb41700 1 -- 172.21.15.177:0/3144505636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd478071930 msgr2=0x7fd4781685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7fd47eb41700 1 --2- 172.21.15.177:0/3144505636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd478071930 0x7fd4781685f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd468009310 tx=0x7fd468009620 comp rx=0 tx=0).stop 2023-11-27T17:48:23.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.001+0000 7fd47eb41700 1 -- 172.21.15.177:0/3144505636 shutdown_connections 2023-11-27T17:48:23.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.001+0000 7fd47eb41700 1 --2- 172.21.15.177:0/3144505636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd478071930 0x7fd4781685f0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd468009310 tx=0x7fd468009620 comp rx=0 tx=0).stop 2023-11-27T17:48:23.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.001+0000 7fd47eb41700 1 -- 172.21.15.177:0/3144505636 >> 172.21.15.177:0/3144505636 conn(0x7fd4780b51d0 msgr2=0x7fd4780b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.001+0000 7f31d857c700 1 -- 172.21.15.177:0/3606044177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00720d0 msgr2=0x7f31d00cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.001+0000 7f31d857c700 1 --2- 172.21.15.177:0/3606044177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00720d0 0x7f31d00cccd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0098f0 tx=0x7f31cc009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:23.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f47467fc700 1 -- 172.21.15.177:0/1287643770 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740007ce0 con 0x7f47480cb250 2023-11-27T17:48:23.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f47467fc700 1 -- 172.21.15.177:0/1287643770 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740007e40 con 0x7f47480cb250 2023-11-27T17:48:23.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.000+0000 7f47467fc700 1 -- 172.21.15.177:0/1287643770 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740003c40 con 0x7f47480cb250 2023-11-27T17:48:23.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f69eada0700 1 Processor -- start 2023-11-27T17:48:23.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9508021070 con 0x7f95180cdb80 2023-11-27T17:48:23.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f94fffff700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f950406b250 0x7f950406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f950808b5e0 con 0x7f95180cdb80 2023-11-27T17:48:23.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f94fffff700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6824/1967175209,v1:172.21.15.177:6825/1967175209] conn(0x7f9504073470 0x7f9504075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 --> [v2:172.21.15.177:6824/1967175209,v1:172.21.15.177:6825/1967175209] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9504075f40 con 0x7f9504073470 2023-11-27T17:48:23.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f950808b990 con 0x7f95180cdb80 2023-11-27T17:48:23.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f95177fe700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f950406b250 0x7f950406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f69eada0700 1 -- start start 2023-11-27T17:48:23.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69eada0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 0x7f69e40b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69eada0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f69e40b7940 0x7f69e4162bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69eada0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f69e41630f0 0x7f69e40704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69eada0700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e40b7dc0 con 0x7f69e40b7940 2023-11-27T17:48:23.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69eada0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e40b9450 con 0x7f69e41630f0 2023-11-27T17:48:23.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69eada0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40b9730 con 0x7f69e40d3ae0 2023-11-27T17:48:23.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69e3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f69e40b7940 0x7f69e4162bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69e3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f69e40b7940 0x7f69e4162bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51538/0 (socket says 172.21.15.177:51538) 2023-11-27T17:48:23.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69e3fff700 1 -- 172.21.15.177:0/583233246 learned_addr learned my addr 172.21.15.177:0/583233246 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f69e8b3c700 1 --2- 172.21.15.177:0/583233246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 0x7f69e40b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f474ddab700 1 -- 172.21.15.177:0/1287643770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47480cb250 msgr2=0x7f47480ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f474ddab700 1 --2- 172.21.15.177:0/1287643770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47480cb250 0x7f47480ccdc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f474000c2e0 tx=0x7f474000c5f0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.001+0000 7f261f384700 1 Processor -- start 2023-11-27T17:48:23.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.001+0000 7f261f384700 1 -- start start 2023-11-27T17:48:23.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f261f384700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2618168860 0x7f261816b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f261f384700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2618070890 con 0x7f2618071930 2023-11-27T17:48:23.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f261f384700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2618070b70 con 0x7f26180cb0a0 2023-11-27T17:48:23.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7f261f384700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2618168c40 con 0x7f2618168860 2023-11-27T17:48:23.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f261d120700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2618168860 0x7f261816b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f261d120700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2618168860 0x7f261816b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51532/0 (socket says 172.21.15.177:51532) 2023-11-27T17:48:23.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f31d857c700 1 -- 172.21.15.177:0/3606044177 shutdown_connections 2023-11-27T17:48:23.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f31d857c700 1 --2- 172.21.15.177:0/3606044177 >> v2:172.21.15.177:3300/0 conn(0x7f31d0162540 0x7f31d0071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f31d857c700 1 --2- 172.21.15.177:0/3606044177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00720d0 0x7f31d00cccd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f31d857c700 1 -- 172.21.15.177:0/3606044177 >> 172.21.15.177:0/3606044177 conn(0x7f31d00b15d0 msgr2=0x7f31d00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.003+0000 7f261d120700 1 -- 172.21.15.177:0/1396591741 learned_addr learned my addr 172.21.15.177:0/1396591741 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f69e8b3c700 1 -- 172.21.15.177:0/583233246 >> v2:172.21.15.178:3300/0 conn(0x7f69e41630f0 msgr2=0x7f69e40704b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T17:48:23.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f69e8b3c700 1 --2- 172.21.15.177:0/583233246 >> v2:172.21.15.178:3300/0 conn(0x7f69e41630f0 0x7f69e40704b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f69e8b3c700 1 -- 172.21.15.177:0/583233246 >> v2:172.21.15.177:3300/0 conn(0x7f69e40b7940 msgr2=0x7f69e4162bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f69e8b3c700 1 --2- 172.21.15.177:0/583233246 >> v2:172.21.15.177:3300/0 conn(0x7f69e40b7940 0x7f69e4162bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f69e8b3c700 1 -- 172.21.15.177:0/583233246 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40b9a10 con 0x7f69e40d3ae0 2023-11-27T17:48:23.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f31d857c700 1 -- 172.21.15.177:0/3606044177 shutdown_connections 2023-11-27T17:48:23.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f31d857c700 1 -- 172.21.15.177:0/3606044177 wait complete. 2023-11-27T17:48:23.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f95177fe700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f950406b250 0x7f950406d710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f950c001600 tx=0x7f950c007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f261d120700 1 -- 172.21.15.177:0/1396591741 >> v1:172.21.15.178:6789/0 conn(0x7f26180cb0a0 legacy=0x7f26180b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f261d120700 1 -- 172.21.15.177:0/1396591741 >> v1:172.21.15.177:6789/0 conn(0x7f2618071930 legacy=0x7f26180ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f261d120700 1 -- 172.21.15.177:0/1396591741 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618070e50 con 0x7f2618168860 2023-11-27T17:48:23.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7fd47eb41700 1 -- 172.21.15.177:0/3144505636 shutdown_connections 2023-11-27T17:48:23.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.002+0000 7fd47eb41700 1 -- 172.21.15.177:0/3144505636 wait complete. 2023-11-27T17:48:23.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7fd47eb41700 1 Processor -- start 2023-11-27T17:48:23.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7fd47eb41700 1 -- start start 2023-11-27T17:48:23.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f474ddab700 1 -- 172.21.15.177:0/1287643770 shutdown_connections 2023-11-27T17:48:23.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f474ddab700 1 --2- 172.21.15.177:0/1287643770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47480cb250 0x7f47480ccdc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f474ddab700 1 --2- 172.21.15.177:0/1287643770 >> v2:172.21.15.178:3300/0 conn(0x7f4748071110 0x7f47480cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f474ddab700 1 -- 172.21.15.177:0/1287643770 >> 172.21.15.177:0/1287643770 conn(0x7f47480b15d0 msgr2=0x7f47480b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.004+0000 7f69e8b3c700 1 --2- 172.21.15.177:0/583233246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 0x7f69e40b7400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f69e40b30a0 tx=0x7f69d0009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7f1fa191ef073cf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7f261d120700 1 --2- 172.21.15.177:0/1396591741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2618168860 0x7f261816b200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2614009d50 tx=0x7f261400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fac18405828b858 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7f9517fff700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6824/1967175209,v1:172.21.15.177:6825/1967175209] conn(0x7f9504073470 0x7f9504075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7f69e37fe700 1 -- 172.21.15.177:0/583233246 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0011830 con 0x7f69e40d3ae0 2023-11-27T17:48:23.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7f69e37fe700 1 -- 172.21.15.177:0/583233246 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d0011990 con 0x7f69e40d3ae0 2023-11-27T17:48:23.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7f69e37fe700 1 -- 172.21.15.177:0/583233246 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0011d20 con 0x7f69e40d3ae0 2023-11-27T17:48:23.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7f260ffff700 1 -- 172.21.15.177:0/1396591741 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400e070 con 0x7f2618168860 2023-11-27T17:48:23.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7fd47eb41700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4780ca990 0x7fd478163930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7fd47eb41700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4780cae10 0x7fd47816c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7fd47eb41700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd47816c870 0x7fd4781690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7fd47eb41700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47816aa90 con 0x7fd4780cae10 2023-11-27T17:48:23.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7fd47eb41700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47816cd20 con 0x7fd47816c870 2023-11-27T17:48:23.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7fd47eb41700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd478163e70 con 0x7fd4780ca990 2023-11-27T17:48:23.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f474ddab700 1 -- 172.21.15.177:0/1287643770 shutdown_connections 2023-11-27T17:48:23.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd47d0de700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd47816c870 0x7fd4781690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd47d0de700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd47816c870 0x7fd4781690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59574/0 (socket says 172.21.15.177:59574) 2023-11-27T17:48:23.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd47d0de700 1 -- 172.21.15.177:0/4127934592 learned_addr learned my addr 172.21.15.177:0/4127934592 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f31d857c700 1 Processor -- start 2023-11-27T17:48:23.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd47c8dd700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4780ca990 0x7fd478163930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd477fff700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4780cae10 0x7fd47816c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7f260ffff700 1 -- 172.21.15.177:0/1396591741 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26140092e0 con 0x7f2618168860 2023-11-27T17:48:23.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.005+0000 7f260ffff700 1 -- 172.21.15.177:0/1396591741 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614009ea0 con 0x7f2618168860 2023-11-27T17:48:23.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 -- 172.21.15.177:0/583233246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 msgr2=0x7f69e40b7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 --2- 172.21.15.177:0/583233246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 0x7f69e40b7400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f69e40b30a0 tx=0x7f69d0009b20 comp rx=0 tx=0).stop 2023-11-27T17:48:23.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f474ddab700 1 -- 172.21.15.177:0/1287643770 wait complete. 2023-11-27T17:48:23.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f261f384700 1 -- 172.21.15.177:0/1396591741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2618168860 msgr2=0x7f261816b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f261f384700 1 --2- 172.21.15.177:0/1396591741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2618168860 0x7f261816b200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2614009d50 tx=0x7f261400b330 comp rx=0 tx=0).stop 2023-11-27T17:48:23.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 -- 172.21.15.177:0/583233246 shutdown_connections 2023-11-27T17:48:23.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 --2- 172.21.15.177:0/583233246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 0x7f69e40b7400 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 --2- 172.21.15.177:0/583233246 >> v2:172.21.15.178:3300/0 conn(0x7f69e41630f0 0x7f69e40704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 --2- 172.21.15.177:0/583233246 >> v2:172.21.15.177:3300/0 conn(0x7f69e40b7940 0x7f69e4162bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 -- 172.21.15.177:0/583233246 >> 172.21.15.177:0/583233246 conn(0x7f69e4072720 msgr2=0x7f69e4072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd477fff700 1 -- 172.21.15.177:0/4127934592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4780ca990 msgr2=0x7fd478163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd477fff700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4780ca990 0x7fd478163930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd477fff700 1 -- 172.21.15.177:0/4127934592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd47816c870 msgr2=0x7fd4781690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd477fff700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd47816c870 0x7fd4781690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7fd477fff700 1 -- 172.21.15.177:0/4127934592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468009de0 con 0x7fd4780cae10 2023-11-27T17:48:23.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f261f384700 1 -- 172.21.15.177:0/1396591741 shutdown_connections 2023-11-27T17:48:23.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f261f384700 1 --2- 172.21.15.177:0/1396591741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2618168860 0x7f261816b200 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f261f384700 1 -- 172.21.15.177:0/1396591741 >> 172.21.15.177:0/1396591741 conn(0x7f26180b51d0 msgr2=0x7f26180b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 -- 172.21.15.177:0/583233246 shutdown_connections 2023-11-27T17:48:23.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f31d857c700 1 -- start start 2023-11-27T17:48:23.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7fd477fff700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4780cae10 0x7fd47816c330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00c440 tx=0x7fd46c00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7f9517fff700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6824/1967175209,v1:172.21.15.177:6825/1967175209] conn(0x7f9504073470 0x7f9504075890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7f261f384700 1 -- 172.21.15.177:0/1396591741 shutdown_connections 2023-11-27T17:48:23.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7f31d857c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31d00720d0 0x7f31d006f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0052d0 con 0x7fd4780cae10 2023-11-27T17:48:23.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd478169e10 con 0x7fd4780cae10 2023-11-27T17:48:23.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47816a3d0 con 0x7fd4780cae10 2023-11-27T17:48:23.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7f31d857c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d00cd210 0x7f31d014dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7f31d857c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d0162540 0x7f31d00afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7f31d857c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d006f560 con 0x7f31d00720d0 2023-11-27T17:48:23.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7f31d857c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d014ca10 con 0x7f31d00cd210 2023-11-27T17:48:23.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7f31d857c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d014ccf0 con 0x7f31d0162540 2023-11-27T17:48:23.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c005430 con 0x7fd4780cae10 2023-11-27T17:48:23.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.007+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0038a0 con 0x7fd4780cae10 2023-11-27T17:48:23.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f474ddab700 1 Processor -- start 2023-11-27T17:48:23.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f474ddab700 1 -- start start 2023-11-27T17:48:23.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7febf8ef5700 1 Processor -- start 2023-11-27T17:48:23.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.006+0000 7f69eada0700 1 -- 172.21.15.177:0/583233246 wait complete. 2023-11-27T17:48:23.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f69eada0700 1 Processor -- start 2023-11-27T17:48:23.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d5b17700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d00cd210 0x7f31d014dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d6b19700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d0162540 0x7f31d00afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d5b17700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d00cd210 0x7f31d014dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59576/0 (socket says 172.21.15.177:59576) 2023-11-27T17:48:23.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d5b17700 1 -- 172.21.15.177:0/3603427097 learned_addr learned my addr 172.21.15.177:0/3603427097 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d5b17700 1 -- 172.21.15.177:0/3603427097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d0162540 msgr2=0x7f31d00afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d5b17700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d0162540 0x7f31d00afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d5b17700 1 -- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31d00720d0 msgr2=0x7f31d006f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d5b17700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31d00720d0 0x7f31d006f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f31d5b17700 1 -- 172.21.15.177:0/3603427097 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc009550 con 0x7f31d00cd210 2023-11-27T17:48:23.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd458000fb0 con 0x7fd4780cae10 2023-11-27T17:48:23.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.008+0000 7f261f384700 1 -- 172.21.15.177:0/1396591741 wait complete. 2023-11-27T17:48:23.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 <== osd.3 v2:172.21.15.177:6824/1967175209 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9504075f40 con 0x7f9504073470 2023-11-27T17:48:23.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7f474ddab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4748071110 0x7f4748156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7f474ddab700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47480cb250 0x7f4748155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7f474ddab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f474815adb0 0x7f4748143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7f474ddab700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4748155780 con 0x7f47480cb250 2023-11-27T17:48:23.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7f474ddab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4748156c00 con 0x7f474815adb0 2023-11-27T17:48:23.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7f474ddab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4748156ee0 con 0x7f4748071110 2023-11-27T17:48:23.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f261f384700 1 Processor -- start 2023-11-27T17:48:23.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f47477fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4748071110 0x7f4748156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f47477fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4748071110 0x7f4748156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39026/0 (socket says 172.21.15.177:39026) 2023-11-27T17:48:23.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f47477fe700 1 -- 172.21.15.177:0/2415495520 learned_addr learned my addr 172.21.15.177:0/2415495520 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f4747fff700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f474815adb0 0x7f4748143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f31d5b17700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d00cd210 0x7f31d014dab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009130 tx=0x7f31cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00b660 con 0x7f31d00cd210 2023-11-27T17:48:23.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc00b7c0 con 0x7f31d00cd210 2023-11-27T17:48:23.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00bb50 con 0x7f31d00cd210 2023-11-27T17:48:23.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f31d857c700 1 -- 172.21.15.177:0/3603427097 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d014cfd0 con 0x7f31d00cd210 2023-11-27T17:48:23.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.009+0000 7f69eada0700 1 -- start start 2023-11-27T17:48:23.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69eada0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e40b7940 0x7f69e40c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69eada0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 0x7f69e4200150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69eada0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e41630f0 0x7f69e40cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69eada0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e415f910 con 0x7f69e41630f0 2023-11-27T17:48:23.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69eada0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40ced30 con 0x7f69e40b7940 2023-11-27T17:48:23.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69eada0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40cf010 con 0x7f69e40d3ae0 2023-11-27T17:48:23.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7febf8ef5700 1 -- start start 2023-11-27T17:48:23.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69e933d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e41630f0 0x7f69e40cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69e933d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e41630f0 0x7f69e40cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51570/0 (socket says 172.21.15.177:51570) 2023-11-27T17:48:23.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f69e933d700 1 -- 172.21.15.177:0/4253431672 learned_addr learned my addr 172.21.15.177:0/4253431672 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f69e933d700 1 -- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 msgr2=0x7f69e4200150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:23.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f69e933d700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e40d3ae0 0x7f69e4200150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f69e933d700 1 -- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e40b7940 msgr2=0x7f69e40c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f69e933d700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e40b7940 0x7f69e40c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f69e933d700 1 -- 172.21.15.177:0/4253431672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d00094a0 con 0x7f69e41630f0 2023-11-27T17:48:23.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f31d857c700 1 -- 172.21.15.177:0/3603427097 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d014d590 con 0x7f31d00cd210 2023-11-27T17:48:23.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f69e933d700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e41630f0 0x7f69e40cc020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00b780 tx=0x7f69dc00bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7febf8ef5700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febec0e1070 0x7febec0e2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7febf8ef5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7febec033ec0 0x7febec037db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7febf8ef5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec034340 0x7febec0382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7febf8ef5700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec03aab0 con 0x7febec0e1070 2023-11-27T17:48:23.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7febf8ef5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec03af40 con 0x7febec033ec0 2023-11-27T17:48:23.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7febf8ef5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec03a180 con 0x7febec034340 2023-11-27T17:48:23.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f4747fff700 1 -- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4748071110 msgr2=0x7f4748156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f4747fff700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4748071110 0x7f4748156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f4747fff700 1 -- 172.21.15.177:0/2415495520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47480cb250 msgr2=0x7f4748155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f4747fff700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47480cb250 0x7f4748155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7f4747fff700 1 -- 172.21.15.177:0/2415495520 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474000c050 con 0x7f474815adb0 2023-11-27T17:48:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f4747fff700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f474815adb0 0x7f4748143a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4740016000 tx=0x7f4740004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f472ffff700 1 -- 172.21.15.177:0/2415495520 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47400048a0 con 0x7f474815adb0 2023-11-27T17:48:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f472ffff700 1 -- 172.21.15.177:0/2415495520 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474000a140 con 0x7f474815adb0 2023-11-27T17:48:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47481571c0 con 0x7f474815adb0 2023-11-27T17:48:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4748157780 con 0x7f474815adb0 2023-11-27T17:48:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f472ffff700 1 -- 172.21.15.177:0/2415495520 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474000a4b0 con 0x7f474815adb0 2023-11-27T17:48:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec034340 0x7febec0382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec034340 0x7febec0382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39040/0 (socket says 172.21.15.177:39040) 2023-11-27T17:48:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf3fff700 1 -- 172.21.15.177:0/1184590187 learned_addr learned my addr 172.21.15.177:0/1184590187 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf37fe700 1 --2- 172.21.15.177:0/1184590187 >> v2:172.21.15.177:3300/0 conn(0x7febec0e1070 0x7febec0e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.011+0000 7f261f384700 1 -- start start 2023-11-27T17:48:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261f384700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2618071930 0x7f2618209220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261f384700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26180cb0a0 0x7f26181771d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261f384700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618168860 0x7f2618177710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f69e17fa700 1 -- 172.21.15.177:0/4253431672 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00f840 con 0x7f69e41630f0 2023-11-27T17:48:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261f384700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261806c750 con 0x7f26180cb0a0 2023-11-27T17:48:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261f384700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261806ca30 con 0x7f2618168860 2023-11-27T17:48:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261f384700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261806cd10 con 0x7f2618071930 2023-11-27T17:48:23.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd46c003a00 con 0x7fd4780cae10 2023-11-27T17:48:23.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.010+0000 7fd4757fa700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd46406b250 0x7fd46406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261d921700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618168860 0x7f2618177710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261d921700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618168860 0x7f2618177710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59602/0 (socket says 172.21.15.177:59602) 2023-11-27T17:48:23.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261d921700 1 -- 172.21.15.177:0/4079350197 learned_addr learned my addr 172.21.15.177:0/4079350197 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf37fe700 1 -- 172.21.15.177:0/1184590187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec034340 msgr2=0x7febec0382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf37fe700 1 --2- 172.21.15.177:0/1184590187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec034340 0x7febec0382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf37fe700 1 -- 172.21.15.177:0/1184590187 >> v2:172.21.15.178:3300/0 conn(0x7febec033ec0 msgr2=0x7febec037db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf37fe700 1 --2- 172.21.15.177:0/1184590187 >> v2:172.21.15.178:3300/0 conn(0x7febec033ec0 0x7febec037db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7febf37fe700 1 -- 172.21.15.177:0/1184590187 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec03a460 con 0x7febec0e1070 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7fd47c8dd700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd46406b250 0x7fd46406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd46c057da0 con 0x7fd4780cae10 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7fd4757fa700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6800/3442982886,v1:172.21.15.177:6801/3442982886] conn(0x7fd4640733f0 0x7fd464075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 --> [v2:172.21.15.177:6800/3442982886,v1:172.21.15.177:6801/3442982886] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd464075ec0 con 0x7fd4640733f0 2023-11-27T17:48:23.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7fd47d0de700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6800/3442982886,v1:172.21.15.177:6801/3442982886] conn(0x7fd4640733f0 0x7fd464075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7fd47d0de700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6800/3442982886,v1:172.21.15.177:6801/3442982886] conn(0x7fd4640733f0 0x7fd464075810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31d0070a70 con 0x7f31d00cd210 2023-11-27T17:48:23.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f31cc021070 con 0x7f31d00cd210 2023-11-27T17:48:23.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f31c6ffd700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f31b406b320 0x7f31b406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31cc08b2b0 con 0x7f31d00cd210 2023-11-27T17:48:23.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7febf37fe700 1 --2- 172.21.15.177:0/1184590187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec0e1070 0x7febec0e2120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febec037b50 tx=0x7febe8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16db3cd74b8235e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f261c91f700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26180cb0a0 0x7f26181771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f261d120700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2618071930 0x7f2618209220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f261d921700 1 -- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2618071930 msgr2=0x7f2618209220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f261d921700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2618071930 0x7f2618209220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f261d921700 1 -- 172.21.15.177:0/4079350197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26180cb0a0 msgr2=0x7f26181771d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f261d921700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26180cb0a0 0x7f26181771d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f261d921700 1 -- 172.21.15.177:0/4079350197 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614009a30 con 0x7f2618168860 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e40cf2f0 con 0x7f69e41630f0 2023-11-27T17:48:23.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.012+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e40cf8b0 con 0x7f69e41630f0 2023-11-27T17:48:23.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f69e17fa700 1 -- 172.21.15.177:0/4253431672 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc00f9a0 con 0x7f69e41630f0 2023-11-27T17:48:23.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f69e17fa700 1 -- 172.21.15.177:0/4253431672 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00fd30 con 0x7f69e41630f0 2023-11-27T17:48:23.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f472ffff700 1 -- 172.21.15.177:0/2415495520 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f474000a610 con 0x7f474815adb0 2023-11-27T17:48:23.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f31c6ffd700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6808/2628156561,v1:172.21.15.177:6809/2628156561] conn(0x7f31b4073540 0x7f31b4075960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 --> [v2:172.21.15.177:6808/2628156561,v1:172.21.15.177:6809/2628156561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31b4076010 con 0x7f31b4073540 2023-11-27T17:48:23.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31cc08d8d0 con 0x7f31d00cd210 2023-11-27T17:48:23.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f472ffff700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473406b2a0 0x7f473406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f472ffff700 1 -- 172.21.15.177:0/2415495520 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f474008b3e0 con 0x7f474815adb0 2023-11-27T17:48:23.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f31d6b19700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6808/2628156561,v1:172.21.15.177:6809/2628156561] conn(0x7f31b4073540 0x7f31b4075960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.013+0000 7f411c131700 1 Processor -- start 2023-11-27T17:48:23.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.014+0000 7f411c131700 1 -- start start 2023-11-27T17:48:23.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7febf27fc700 1 -- 172.21.15.177:0/1184590187 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8011830 con 0x7febec0e1070 2023-11-27T17:48:23.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7febf27fc700 1 -- 172.21.15.177:0/1184590187 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe8011990 con 0x7febec0e1070 2023-11-27T17:48:23.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7febf27fc700 1 -- 172.21.15.177:0/1184590187 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8011d20 con 0x7febec0e1070 2023-11-27T17:48:23.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f31d6b19700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6808/2628156561,v1:172.21.15.177:6809/2628156561] conn(0x7f31b4073540 0x7f31b4075960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f69e17fa700 1 -- 172.21.15.177:0/4253431672 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f69dc017400 con 0x7f69e41630f0 2023-11-27T17:48:23.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 <== osd.0 v2:172.21.15.177:6800/3442982886 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd464075ec0 con 0x7fd4640733f0 2023-11-27T17:48:23.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd46c0539e0 con 0x7fd4780cae10 2023-11-27T17:48:23.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f261d921700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618168860 0x7f2618177710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f261000cba0 tx=0x7f261000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7febf8ef5700 1 -- 172.21.15.177:0/1184590187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec0e1070 msgr2=0x7febec0e2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7febf8ef5700 1 --2- 172.21.15.177:0/1184590187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec0e1070 0x7febec0e2120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febec037b50 tx=0x7febe8009b20 comp rx=0 tx=0).stop 2023-11-27T17:48:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f69e17fa700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f69c806b280 0x7f69c806d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f69e17fa700 1 -- 172.21.15.177:0/4253431672 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69dc089db0 con 0x7f69e41630f0 2023-11-27T17:48:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f31d6318700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f31b406b320 0x7f31b406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f47477fe700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473406b2a0 0x7f473406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f47477fe700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473406b2a0 0x7f473406d760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f473c006fd0 tx=0x7f473c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f69e8b3c700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f69c806b280 0x7f69c806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7fd47c8dd700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd46406b250 0x7fd46406d710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd4780b4790 tx=0x7fd468008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 <== osd.2 v2:172.21.15.177:6808/2628156561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f31b4076010 con 0x7f31b4073540 2023-11-27T17:48:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f31d6318700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f31b406b320 0x7f31b406d7e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31d0165440 tx=0x7f31c8009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000ab80 con 0x7f2618168860 2023-11-27T17:48:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000ace0 con 0x7f2618168860 2023-11-27T17:48:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610012660 con 0x7f2618168860 2023-11-27T17:48:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f69e8b3c700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f69c806b280 0x7f69c806d740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f69d00090b0 tx=0x7f69d0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261806cff0 con 0x7f2618168860 2023-11-27T17:48:23.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2618162210 con 0x7f2618168860 2023-11-27T17:48:23.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7f69eada0700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:6800/1957875668,v1:172.21.15.178:6801/1957875668] conn(0x7f69c40015d0 0x7f69c4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 --> [v2:172.21.15.178:6800/1957875668,v1:172.21.15.178:6801/1957875668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69c4006bc0 con 0x7f69c40015d0 2023-11-27T17:48:23.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7f474ddab700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:6824/3510383557,v1:172.21.15.178:6825/3510383557] conn(0x7f474815b900 0x7f4748157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 --> [v2:172.21.15.178:6824/3510383557,v1:172.21.15.178:6825/3510383557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47480cd300 con 0x7f474815b900 2023-11-27T17:48:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7febf8ef5700 1 -- 172.21.15.177:0/1184590187 shutdown_connections 2023-11-27T17:48:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7febf8ef5700 1 --2- 172.21.15.177:0/1184590187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec034340 0x7febec0382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7febf8ef5700 1 --2- 172.21.15.177:0/1184590187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec0e1070 0x7febec0e2120 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7febf8ef5700 1 --2- 172.21.15.177:0/1184590187 >> v2:172.21.15.178:3300/0 conn(0x7febec033ec0 0x7febec037db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7febf8ef5700 1 -- 172.21.15.177:0/1184590187 >> 172.21.15.177:0/1184590187 conn(0x7febec00a450 msgr2=0x7febec00a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7febf8ef5700 1 -- 172.21.15.177:0/1184590187 shutdown_connections 2023-11-27T17:48:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7f4746ffd700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:6824/3510383557,v1:172.21.15.178:6825/3510383557] conn(0x7f474815b900 0x7f4748157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7febf8ef5700 1 -- 172.21.15.177:0/1184590187 wait complete. 2023-11-27T17:48:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.018+0000 7f69e3fff700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:6800/1957875668,v1:172.21.15.178:6801/1957875668] conn(0x7f69c40015d0 0x7f69c4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.018+0000 7f69e3fff700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:6800/1957875668,v1:172.21.15.178:6801/1957875668] conn(0x7f69c40015d0 0x7f69c4003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7febf8ef5700 1 Processor -- start 2023-11-27T17:48:23.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f69e17fa700 1 -- 172.21.15.177:0/4253431672 <== osd.6 v2:172.21.15.178:6800/1957875668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f69c4006bc0 con 0x7f69c40015d0 2023-11-27T17:48:23.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.018+0000 7f4746ffd700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:6824/3510383557,v1:172.21.15.178:6825/3510383557] conn(0x7f474815b900 0x7f4748157ca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f26100127c0 con 0x7f2618168860 2023-11-27T17:48:23.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f260dffb700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f25fc06b2a0 0x7f25fc06d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f261d120700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f25fc06b2a0 0x7f25fc06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f411c131700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41141626c0 0x7f41140713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f411c131700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41140aeee0 con 0x7f41141622e0 2023-11-27T17:48:23.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f411c131700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41140719b0 con 0x7f41140cb0a0 2023-11-27T17:48:23.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2610058500 con 0x7f2618168860 2023-11-27T17:48:23.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.015+0000 7f411c131700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41140b2df0 con 0x7f41141626c0 2023-11-27T17:48:23.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f4119ecd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f41141622e0 0x7f41140ca990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45914/0 (socket says 172.21.15.177:45914) 2023-11-27T17:48:23.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.016+0000 7f4119ecd700 1 -- 172.21.15.177:0/3155200807 learned_addr learned my addr 172.21.15.177:0/3155200807 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026053767 0 0) 0x7f41140aeee0 con 0x7f41141622e0 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.017+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41000035b0 con 0x7f41141622e0 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667439239 0 0) 0x7f41000035b0 con 0x7f41141622e0 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41141626c0 msgr2=0x7f41140713d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41141626c0 0x7f41140713d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 >> v1:172.21.15.178:6789/0 conn(0x7f41140cb0a0 legacy=0x7f41140b3210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114071c90 con 0x7f41141622e0 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f4110001670 con 0x7f41141622e0 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 >> v1:172.21.15.177:6789/0 conn(0x7f41141622e0 legacy=0x7f41140ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4100003a30 0x7f4100003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4100004850 0x7f4100004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4100005260 0x7f410001ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140b2df0 con 0x7f4100004850 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410001d180 con 0x7f4100005260 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410001d340 con 0x7f4100003a30 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4119ecd700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4100003a30 0x7f4100003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4119ecd700 1 -- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4100005260 msgr2=0x7f410001ca20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4119ecd700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4100005260 0x7f410001ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4119ecd700 1 -- 172.21.15.177:0/3155200807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4100004850 msgr2=0x7f4100004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4119ecd700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4100004850 0x7f4100004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7f4119ecd700 1 -- 172.21.15.177:0/3155200807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114071c90 con 0x7f4100003a30 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f4119ecd700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4100003a30 0x7f4100003e30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f411000c2f0 tx=0x7f4100005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1610b35bec9c44e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000cc50 con 0x7f4100003a30 2023-11-27T17:48:23.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000cdb0 con 0x7f4100003a30 2023-11-27T17:48:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f4118ecb700 1 -- 172.21.15.177:0/3155200807 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110005ba0 con 0x7f4100003a30 2023-11-27T17:48:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25f8000fb0 con 0x7f2618168860 2023-11-27T17:48:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f260dffb700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:6808/990180260,v1:172.21.15.178:6809/990180260] conn(0x7f25fc073440 0x7f25fc075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 --> [v2:172.21.15.178:6808/990180260,v1:172.21.15.178:6809/990180260] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25fc075f10 con 0x7f25fc073440 2023-11-27T17:48:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f261005e080 con 0x7f2618168860 2023-11-27T17:48:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f261d120700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f25fc06b2a0 0x7f25fc06d760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2614015040 tx=0x7f2614009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.019+0000 7febf8ef5700 1 -- start start 2023-11-27T17:48:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7febf8ef5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec033ec0 0x7febec0d6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7febf8ef5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec034340 0x7febec0d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7febf8ef5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec0e1070 0x7febec0d85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7febf8ef5700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0d6b10 con 0x7febec034340 2023-11-27T17:48:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7febf8ef5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec036e70 con 0x7febec0e1070 2023-11-27T17:48:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7febf8ef5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0d6d60 con 0x7febec033ec0 2023-11-27T17:48:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7febf3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec0e1070 0x7febec0d85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f261c91f700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:6808/990180260,v1:172.21.15.178:6809/990180260] conn(0x7f25fc073440 0x7f25fc075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7f472ffff700 1 -- 172.21.15.177:0/2415495520 <== osd.7 v2:172.21.15.178:6824/3510383557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4738009750 con 0x7f474815b900 2023-11-27T17:48:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.020+0000 7febf2ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec034340 0x7febec0d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec0e1070 0x7febec0d85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59634/0 (socket says 172.21.15.177:59634) 2023-11-27T17:48:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf3fff700 1 -- 172.21.15.177:0/2874911858 learned_addr learned my addr 172.21.15.177:0/2874911858 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf37fe700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec033ec0 0x7febec0d6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf2ffd700 1 -- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec033ec0 msgr2=0x7febec0d6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf2ffd700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec033ec0 0x7febec0d6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf2ffd700 1 -- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec0e1070 msgr2=0x7febec0d85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf2ffd700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec0e1070 0x7febec0d85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf2ffd700 1 -- 172.21.15.177:0/2874911858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80094a0 con 0x7febec034340 2023-11-27T17:48:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7f411c131700 1 -- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4100003a30 msgr2=0x7f4100003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7f411c131700 1 --2- 172.21.15.177:0/3155200807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4100003a30 0x7f4100003e30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f411000c2f0 tx=0x7f4100005880 comp rx=0 tx=0).stop 2023-11-27T17:48:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.021+0000 7febf2ffd700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec034340 0x7febec0d49d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febe0006fd0 tx=0x7febe000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.022+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0011830 con 0x7febec034340 2023-11-27T17:48:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.026+0000 7f411a6ce700 1 -- 172.21.15.177:0/3155200807 reap_dead start 2023-11-27T17:48:23.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.022+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0011990 con 0x7febec034340 2023-11-27T17:48:23.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.022+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0011d40 con 0x7febec034340 2023-11-27T17:48:23.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.026+0000 7f411c131700 1 -- 172.21.15.177:0/3155200807 shutdown_connections 2023-11-27T17:48:23.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.026+0000 7f411c131700 1 -- 172.21.15.177:0/3155200807 >> 172.21.15.177:0/3155200807 conn(0x7f41140b51d0 msgr2=0x7f41140b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.029+0000 7f411c131700 1 -- 172.21.15.177:0/3155200807 shutdown_connections 2023-11-27T17:48:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.029+0000 7f261c91f700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:6808/990180260,v1:172.21.15.178:6809/990180260] conn(0x7f25fc073440 0x7f25fc075860 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.029+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec037110 con 0x7febec034340 2023-11-27T17:48:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.029+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec0d4f10 con 0x7febec034340 2023-11-27T17:48:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.029+0000 7f411c131700 1 -- 172.21.15.177:0/3155200807 wait complete. 2023-11-27T17:48:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.030+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 <== osd.5 v2:172.21.15.178:6808/990180260 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f25fc075f10 con 0x7f25fc073440 2023-11-27T17:48:23.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.030+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febec039e30 con 0x7febec034340 2023-11-27T17:48:23.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.031+0000 7f411c131700 1 Processor -- start 2023-11-27T17:48:23.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.032+0000 7f411c131700 1 -- start start 2023-11-27T17:48:23.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f411c131700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4114150320 0x7f411406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f411c131700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4114150700 0x7f411406c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f411c131700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f411406cb60 0x7f411406d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f411c131700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411414e8b0 con 0x7f4114150700 2023-11-27T17:48:23.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f411c131700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411414eb00 con 0x7f4114150320 2023-11-27T17:48:23.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f411c131700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411414ede0 con 0x7f411406cb60 2023-11-27T17:48:23.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f4119ecd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4114150320 0x7f411406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.032+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7febe001a400 con 0x7febec034340 2023-11-27T17:48:23.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.032+0000 7febdffff700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7febd806f730 0x7febd8071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.032+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febe0089a60 con 0x7febec034340 2023-11-27T17:48:23.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.032+0000 7febdffff700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:6816/836610101,v1:172.21.15.178:6817/836610101] conn(0x7febd8077950 0x7febd8079d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 --> [v2:172.21.15.178:6816/836610101,v1:172.21.15.178:6817/836610101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febd807a420 con 0x7febd8077950 2023-11-27T17:48:23.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7febe008e2a0 con 0x7febec034340 2023-11-27T17:48:23.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7febf3fff700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:6816/836610101,v1:172.21.15.178:6817/836610101] conn(0x7febd8077950 0x7febd8079d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f41196cc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4114150700 0x7f411406c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f41196cc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4114150700 0x7f411406c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51622/0 (socket says 172.21.15.177:51622) 2023-11-27T17:48:23.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.033+0000 7f41196cc700 1 -- 172.21.15.177:0/2734989435 learned_addr learned my addr 172.21.15.177:0/2734989435 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.034+0000 7febf37fe700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7febd806f730 0x7febd8071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.034+0000 7f41196cc700 1 -- 172.21.15.177:0/2734989435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f411406cb60 msgr2=0x7f411406d010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:23.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.034+0000 7f41196cc700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f411406cb60 0x7f411406d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.034+0000 7f41196cc700 1 -- 172.21.15.177:0/2734989435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4114150320 msgr2=0x7f411406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.034+0000 7f41196cc700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4114150320 0x7f411406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.034+0000 7f41196cc700 1 -- 172.21.15.177:0/2734989435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411414f0c0 con 0x7f4114150700 2023-11-27T17:48:23.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.034+0000 7f41196cc700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4114150700 0x7f411406c620 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f410400b4a0 tx=0x7f410400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.034+0000 7febf37fe700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7febd806f730 0x7febd8071bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febe80090b0 tx=0x7febe801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.035+0000 7f410a7fc700 1 -- 172.21.15.177:0/2734989435 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104011830 con 0x7f4114150700 2023-11-27T17:48:23.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.035+0000 7f410a7fc700 1 -- 172.21.15.177:0/2734989435 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4104011990 con 0x7f4114150700 2023-11-27T17:48:23.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.035+0000 7f410a7fc700 1 -- 172.21.15.177:0/2734989435 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104011d20 con 0x7f4114150700 2023-11-27T17:48:23.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.035+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411414f3a0 con 0x7f4114150700 2023-11-27T17:48:23.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.035+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411414d050 con 0x7f4114150700 2023-11-27T17:48:23.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.036+0000 7febf3fff700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:6816/836610101,v1:172.21.15.178:6817/836610101] conn(0x7febd8077950 0x7febd8079d70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.037+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 <== osd.4 v2:172.21.15.178:6816/836610101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7febd807a420 con 0x7febd8077950 2023-11-27T17:48:23.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.038+0000 7f410a7fc700 1 -- 172.21.15.177:0/2734989435 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f410401a400 con 0x7f4114150700 2023-11-27T17:48:23.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.038+0000 7f410a7fc700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f40f806b2a0 0x7f40f806d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.039+0000 7f410a7fc700 1 -- 172.21.15.177:0/2734989435 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4104089880 con 0x7f4114150700 2023-11-27T17:48:23.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.039+0000 7f4119ecd700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f40f806b2a0 0x7f40f806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.039+0000 7f4119ecd700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f40f806b2a0 0x7f40f806d760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4114071ff0 tx=0x7f4110007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.040+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 --> [v2:172.21.15.177:6800/3442982886,v1:172.21.15.177:6801/3442982886] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd458002d30 con 0x7fd4640733f0 2023-11-27T17:48:23.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.040+0000 7fd4757fa700 1 -- 172.21.15.177:0/4127934592 <== osd.0 v2:172.21.15.177:6800/3442982886 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd458002d30 con 0x7fd4640733f0 2023-11-27T17:48:23.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6800/3442982886,v1:172.21.15.177:6801/3442982886] conn(0x7fd4640733f0 msgr2=0x7fd464075810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6800/3442982886,v1:172.21.15.177:6801/3442982886] conn(0x7fd4640733f0 0x7fd464075810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.040+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 --> [v2:172.21.15.177:6808/2628156561,v1:172.21.15.177:6809/2628156561] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31d0070790 con 0x7f31b4073540 2023-11-27T17:48:23.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.040+0000 7f31c6ffd700 1 -- 172.21.15.177:0/3603427097 <== osd.2 v2:172.21.15.177:6808/2628156561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f31c00095d0 con 0x7f31b4073540 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6808/2628156561,v1:172.21.15.177:6809/2628156561] conn(0x7f31b4073540 msgr2=0x7f31b4075960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6808/2628156561,v1:172.21.15.177:6809/2628156561] conn(0x7f31b4073540 0x7f31b4075960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f31b406b320 msgr2=0x7f31b406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f31b406b320 0x7f31b406d7e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31d0165440 tx=0x7f31c8009250 comp rx=0 tx=0).stop 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d00cd210 msgr2=0x7f31d014dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 --2- 172.21.15.177:0/3603427097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d00cd210 0x7f31d014dab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009130 tx=0x7f31cc004750 comp rx=0 tx=0).stop 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31d6b19700 1 -- 172.21.15.177:0/3603427097 reap_dead start 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 shutdown_connections 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 >> 172.21.15.177:0/3603427097 conn(0x7f31d00b15d0 msgr2=0x7f31d01522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 shutdown_connections 2023-11-27T17:48:23.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.041+0000 7f31c4ff9700 1 -- 172.21.15.177:0/3603427097 wait complete. 2023-11-27T17:48:23.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd46406b250 msgr2=0x7fd46406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd46406b250 0x7fd46406d710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd4780b4790 tx=0x7fd468008030 comp rx=0 tx=0).stop 2023-11-27T17:48:23.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4780cae10 msgr2=0x7fd47816c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 --2- 172.21.15.177:0/4127934592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4780cae10 0x7fd47816c330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00c440 tx=0x7fd46c00c750 comp rx=0 tx=0).stop 2023-11-27T17:48:23.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7f411c131700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6816/2217323012,v1:172.21.15.177:6817/2217323012] conn(0x7f40fc0015d0 0x7f40fc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 --> [v2:172.21.15.177:6816/2217323012,v1:172.21.15.177:6817/2217323012] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40fc006bc0 con 0x7f40fc0015d0 2023-11-27T17:48:23.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47d0de700 1 -- 172.21.15.177:0/4127934592 reap_dead start 2023-11-27T17:48:23.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 shutdown_connections 2023-11-27T17:48:23.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 >> 172.21.15.177:0/4127934592 conn(0x7fd4780b51d0 msgr2=0x7fd47816b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7f411a6ce700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6816/2217323012,v1:172.21.15.177:6817/2217323012] conn(0x7f40fc0015d0 0x7f40fc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 shutdown_connections 2023-11-27T17:48:23.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.042+0000 7fd47eb41700 1 -- 172.21.15.177:0/4127934592 wait complete. 2023-11-27T17:48:23.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.043+0000 7f411a6ce700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6816/2217323012,v1:172.21.15.177:6817/2217323012] conn(0x7f40fc0015d0 0x7f40fc003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.044+0000 7f410a7fc700 1 -- 172.21.15.177:0/2734989435 <== osd.1 v2:172.21.15.177:6816/2217323012 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f40fc006bc0 con 0x7f40fc0015d0 2023-11-27T17:48:23.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.048+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 --> [v2:172.21.15.177:6824/1967175209,v1:172.21.15.177:6825/1967175209] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9518069400 con 0x7f9504073470 2023-11-27T17:48:23.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.053+0000 7f94fffff700 1 -- 172.21.15.177:0/3470233872 <== osd.3 v2:172.21.15.177:6824/1967175209 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9518069400 con 0x7f9504073470 2023-11-27T17:48:23.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.054+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 --> [v2:172.21.15.178:6824/3510383557,v1:172.21.15.178:6825/3510383557] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47481579a0 con 0x7f474815b900 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6824/1967175209,v1:172.21.15.177:6825/1967175209] conn(0x7f9504073470 msgr2=0x7f9504075890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6824/1967175209,v1:172.21.15.177:6825/1967175209] conn(0x7f9504073470 0x7f9504075890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f950406b250 msgr2=0x7f950406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f950406b250 0x7f950406d710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f950c001600 tx=0x7f950c007a20 comp rx=0 tx=0).stop 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95180cdb80 msgr2=0x7f9518162920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 --2- 172.21.15.177:0/3470233872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95180cdb80 0x7f9518162920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9508009130 tx=0x7f9508004750 comp rx=0 tx=0).stop 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f9517fff700 1 -- 172.21.15.177:0/3470233872 reap_dead start 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 shutdown_connections 2023-11-27T17:48:23.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 >> 172.21.15.177:0/3470233872 conn(0x7f9518067000 msgr2=0x7f95181503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f472ffff700 1 -- 172.21.15.177:0/2415495520 <== osd.7 v2:172.21.15.178:6824/3510383557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47481579a0 con 0x7f474815b900 2023-11-27T17:48:23.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 shutdown_connections 2023-11-27T17:48:23.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.055+0000 7f94fdffb700 1 -- 172.21.15.177:0/3470233872 wait complete. 2023-11-27T17:48:23.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.056+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 --> [v2:172.21.15.178:6800/1957875668,v1:172.21.15.178:6801/1957875668] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69c4005ca0 con 0x7f69c40015d0 2023-11-27T17:48:23.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.057+0000 7f69e17fa700 1 -- 172.21.15.177:0/4253431672 <== osd.6 v2:172.21.15.178:6800/1957875668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69c4005ca0 con 0x7f69c40015d0 2023-11-27T17:48:23.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.059+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 --> [v2:172.21.15.178:6816/836610101,v1:172.21.15.178:6817/836610101] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febec037630 con 0x7febd8077950 2023-11-27T17:48:23.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.059+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:6800/1957875668,v1:172.21.15.178:6801/1957875668] conn(0x7f69c40015d0 msgr2=0x7f69c4003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.059+0000 7f69eada0700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.178:6800/1957875668,v1:172.21.15.178:6801/1957875668] conn(0x7f69c40015d0 0x7f69c4003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.059+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f69c806b280 msgr2=0x7f69c806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.059+0000 7f69eada0700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f69c806b280 0x7f69c806d740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f69d00090b0 tx=0x7f69d0010000 comp rx=0 tx=0).stop 2023-11-27T17:48:23.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.059+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e41630f0 msgr2=0x7f69e40cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.059+0000 7f69eada0700 1 --2- 172.21.15.177:0/4253431672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e41630f0 0x7f69e40cc020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00b780 tx=0x7f69dc00bb40 comp rx=0 tx=0).stop 2023-11-27T17:48:23.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7febdffff700 1 -- 172.21.15.177:0/2874911858 <== osd.4 v2:172.21.15.178:6816/836610101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7febec037630 con 0x7febd8077950 2023-11-27T17:48:23.087 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:23.088 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T17:48:23.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 --> [v2:172.21.15.178:6808/990180260,v1:172.21.15.178:6809/990180260] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25f8002d30 con 0x7f25fc073440 2023-11-27T17:48:23.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:6816/836610101,v1:172.21.15.178:6817/836610101] conn(0x7febd8077950 msgr2=0x7febd8079d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7febf8ef5700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.178:6816/836610101,v1:172.21.15.178:6817/836610101] conn(0x7febd8077950 0x7febd8079d70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7febd806f730 msgr2=0x7febd8071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7febf8ef5700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7febd806f730 0x7febd8071bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febe80090b0 tx=0x7febe801c040 comp rx=0 tx=0).stop 2023-11-27T17:48:23.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec034340 msgr2=0x7febec0d49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7febf8ef5700 1 --2- 172.21.15.177:0/2874911858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec034340 0x7febec0d49d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febe0006fd0 tx=0x7febe000b7e0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.061+0000 7febf3fff700 1 -- 172.21.15.177:0/2874911858 reap_dead start 2023-11-27T17:48:23.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.062+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:6824/3510383557,v1:172.21.15.178:6825/3510383557] conn(0x7f474815b900 msgr2=0x7f4748157ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.062+0000 7f474ddab700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:6824/3510383557,v1:172.21.15.178:6825/3510383557] conn(0x7f474815b900 0x7f4748157ca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.062+0000 7f260dffb700 1 -- 172.21.15.177:0/4079350197 <== osd.5 v2:172.21.15.178:6808/990180260 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f25f8002d30 con 0x7f25fc073440 2023-11-27T17:48:23.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.062+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473406b2a0 msgr2=0x7f473406d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.062+0000 7f474ddab700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473406b2a0 0x7f473406d760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f473c006fd0 tx=0x7f473c009190 comp rx=0 tx=0).stop 2023-11-27T17:48:23.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.062+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f474815adb0 msgr2=0x7f4748143a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.062+0000 7f474ddab700 1 --2- 172.21.15.177:0/2415495520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f474815adb0 0x7f4748143a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4740016000 tx=0x7f4740004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.062+0000 7f4747fff700 1 -- 172.21.15.177:0/2415495520 reap_dead start 2023-11-27T17:48:23.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 shutdown_connections 2023-11-27T17:48:23.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 >> 172.21.15.177:0/2874911858 conn(0x7febec00a450 msgr2=0x7febec0e3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 shutdown_connections 2023-11-27T17:48:23.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 >> 172.21.15.177:0/2415495520 conn(0x7f47480b15d0 msgr2=0x7f474815b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 shutdown_connections 2023-11-27T17:48:23.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7febf8ef5700 1 -- 172.21.15.177:0/2874911858 wait complete. 2023-11-27T17:48:23.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:6808/990180260,v1:172.21.15.178:6809/990180260] conn(0x7f25fc073440 msgr2=0x7f25fc075860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:6808/990180260,v1:172.21.15.178:6809/990180260] conn(0x7f25fc073440 0x7f25fc075860 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f25fc06b2a0 msgr2=0x7f25fc06d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f25fc06b2a0 0x7f25fc06d760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2614015040 tx=0x7f2614009000 comp rx=0 tx=0).stop 2023-11-27T17:48:23.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618168860 msgr2=0x7f2618177710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 --2- 172.21.15.177:0/4079350197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618168860 0x7f2618177710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f261000cba0 tx=0x7f261000cf60 comp rx=0 tx=0).stop 2023-11-27T17:48:23.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261d921700 1 -- 172.21.15.177:0/4079350197 reap_dead start 2023-11-27T17:48:23.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 shutdown_connections 2023-11-27T17:48:23.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 >> 172.21.15.177:0/4079350197 conn(0x7f26180b51d0 msgr2=0x7f2618167870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 shutdown_connections 2023-11-27T17:48:23.094 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-27T17:48:23.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f261f384700 1 -- 172.21.15.177:0/4079350197 wait complete. 2023-11-27T17:48:23.095 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T17:48:23.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 shutdown_connections 2023-11-27T17:48:23.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.063+0000 7f474ddab700 1 -- 172.21.15.177:0/2415495520 wait complete. 2023-11-27T17:48:23.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.068+0000 7f69e933d700 1 -- 172.21.15.177:0/4253431672 reap_dead start 2023-11-27T17:48:23.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.068+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 shutdown_connections 2023-11-27T17:48:23.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.068+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 >> 172.21.15.177:0/4253431672 conn(0x7f69e4072720 msgr2=0x7f69e4161f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.070+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 --> [v2:172.21.15.177:6816/2217323012,v1:172.21.15.177:6817/2217323012] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f40fc005c40 con 0x7f40fc0015d0 2023-11-27T17:48:23.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.070+0000 7f410a7fc700 1 -- 172.21.15.177:0/2734989435 <== osd.1 v2:172.21.15.177:6816/2217323012 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f40fc005c40 con 0x7f40fc0015d0 2023-11-27T17:48:23.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.071+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6816/2217323012,v1:172.21.15.177:6817/2217323012] conn(0x7f40fc0015d0 msgr2=0x7f40fc003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.071+0000 7f411c131700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6816/2217323012,v1:172.21.15.177:6817/2217323012] conn(0x7f40fc0015d0 0x7f40fc003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.071+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f40f806b2a0 msgr2=0x7f40f806d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.071+0000 7f411c131700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f40f806b2a0 0x7f40f806d760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4114071ff0 tx=0x7f4110007000 comp rx=0 tx=0).stop 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.071+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4114150700 msgr2=0x7f411406c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.071+0000 7f411c131700 1 --2- 172.21.15.177:0/2734989435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4114150700 0x7f411406c620 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f410400b4a0 tx=0x7f410400b7b0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.071+0000 7f411a6ce700 1 -- 172.21.15.177:0/2734989435 reap_dead start 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.072+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 shutdown_connections 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.072+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 >> 172.21.15.177:0/2734989435 conn(0x7f41140b51d0 msgr2=0x7f41140b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.072+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 shutdown_connections 2023-11-27T17:48:23.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.072+0000 7f411c131700 1 -- 172.21.15.177:0/2734989435 wait complete. 2023-11-27T17:48:23.099 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:23.099 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T17:48:23.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.075+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 shutdown_connections 2023-11-27T17:48:23.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.075+0000 7f69eada0700 1 -- 172.21.15.177:0/4253431672 wait complete. 2023-11-27T17:48:23.100 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:23.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T17:48:23.101 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-27T17:48:23.102 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T17:48:23.102 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:23.103 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T17:48:23.103 INFO:teuthology.orchestra.run.smithi177.stdout:55834574855 2023-11-27T17:48:23.104 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T17:48:23.104 INFO:teuthology.orchestra.run.smithi177.stdout:55834574855 2023-11-27T17:48:23.105 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T17:48:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.339+0000 7f926eb14700 1 Processor -- start 2023-11-27T17:48:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.339+0000 7f926eb14700 1 -- start start 2023-11-27T17:48:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.341+0000 7f926eb14700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9268072610 0x7f92680729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.341+0000 7f926eb14700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9268072f30 con 0x7f9268165f40 2023-11-27T17:48:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.341+0000 7f926eb14700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92680d0ba0 con 0x7f9268145980 2023-11-27T17:48:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.341+0000 7f926eb14700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9268145720 con 0x7f9268072610 2023-11-27T17:48:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7f926c8b0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9268072610 0x7f92680729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7f926c8b0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9268072610 0x7f92680729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51630/0 (socket says 172.21.15.177:51630) 2023-11-27T17:48:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7f926c8b0700 1 -- 172.21.15.177:0/2212584595 learned_addr learned my addr 172.21.15.177:0/2212584595 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7f926c8b0700 1 -- 172.21.15.177:0/2212584595 >> v1:172.21.15.178:6789/0 conn(0x7f9268145980 legacy=0x7f926806dd50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.343+0000 7f926c8b0700 1 -- 172.21.15.177:0/2212584595 >> v1:172.21.15.177:6789/0 conn(0x7f9268165f40 legacy=0x7f9268166370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.343+0000 7f926c8b0700 1 -- 172.21.15.177:0/2212584595 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268162a60 con 0x7f9268072610 2023-11-27T17:48:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.343+0000 7f926c8b0700 1 --2- 172.21.15.177:0/2212584595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268072610 0x7f92680729f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f92540098f0 tx=0x7f9254009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89933a4c1ba2dd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.343+0000 7f92677fe700 1 -- 172.21.15.177:0/2212584595 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9254004230 con 0x7f9268072610 2023-11-27T17:48:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.343+0000 7f92677fe700 1 -- 172.21.15.177:0/2212584595 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9254004390 con 0x7f9268072610 2023-11-27T17:48:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.343+0000 7f92677fe700 1 -- 172.21.15.177:0/2212584595 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540036a0 con 0x7f9268072610 2023-11-27T17:48:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.341+0000 7fbf19830700 1 Processor -- start 2023-11-27T17:48:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.341+0000 7fbf19830700 1 -- start start 2023-11-27T17:48:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7fbf19830700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf14168860 0x7fbf1416b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7fbf19830700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf14070890 con 0x7fbf140cb0a0 2023-11-27T17:48:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7fbf19830700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf14070b70 con 0x7fbf14071930 2023-11-27T17:48:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7fbf19830700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14168c40 con 0x7fbf14168860 2023-11-27T17:48:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7fbf137fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fbf140cb0a0 0x7fbf140b2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:45954/0 (socket says 172.21.15.177:45954) 2023-11-27T17:48:23.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7fbf137fe700 1 -- 172.21.15.177:0/2592908845 learned_addr learned my addr 172.21.15.177:0/2592908845 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:23.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.342+0000 7fbf12ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf14168860 0x7fbf1416b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.343+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720869386 0 0) 0x7fbf14070890 con 0x7fbf140cb0a0 2023-11-27T17:48:23.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.344+0000 7f926eb14700 1 -- 172.21.15.177:0/2212584595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268072610 msgr2=0x7f92680729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.344+0000 7f926eb14700 1 --2- 172.21.15.177:0/2212584595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268072610 0x7f92680729f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f92540098f0 tx=0x7f9254009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:23.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.344+0000 7f926eb14700 1 -- 172.21.15.177:0/2212584595 shutdown_connections 2023-11-27T17:48:23.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.344+0000 7f926eb14700 1 --2- 172.21.15.177:0/2212584595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268072610 0x7f92680729f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.344+0000 7f926eb14700 1 -- 172.21.15.177:0/2212584595 >> 172.21.15.177:0/2212584595 conn(0x7f926806aff0 msgr2=0x7f926806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.344+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbefc003590 con 0x7fbf140cb0a0 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.344+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87963772 0 0) 0x7fbf14070b70 con 0x7fbf14071930 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf14070890 con 0x7fbf14071930 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1912364032 0 0) 0x7fbefc003590 con 0x7fbf140cb0a0 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf14168860 msgr2=0x7fbf1416b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf14168860 0x7fbf1416b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 >> v1:172.21.15.178:6789/0 conn(0x7fbf14071930 legacy=0x7fbf140ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14070e50 con 0x7fbf140cb0a0 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fbf0c0019f0 con 0x7fbf140cb0a0 2023-11-27T17:48:23.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 >> v1:172.21.15.177:6789/0 conn(0x7fbf140cb0a0 legacy=0x7fbf140b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc003d70 0x7fbefc0084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf14168860 0x7fbefc00aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbefc00afc0 0x7fbefc00d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc00dc00 con 0x7fbefc00afc0 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc00dd70 con 0x7fbefc003d70 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc00df30 con 0x7fbf14168860 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf137fe700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbefc00afc0 0x7fbefc00d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf12ffd700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc003d70 0x7fbefc0084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf127fc700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf14168860 0x7fbefc00aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7f18f13d9700 1 Processor -- start 2023-11-27T17:48:23.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf137fe700 1 -- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf14168860 msgr2=0x7fbefc00aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf137fe700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf14168860 0x7fbefc00aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.345+0000 7fbf137fe700 1 -- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc003d70 msgr2=0x7fbefc0084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.346+0000 7fbf137fe700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc003d70 0x7fbefc0084e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.346+0000 7fbf137fe700 1 -- 172.21.15.177:0/2592908845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14070e50 con 0x7fbefc00afc0 2023-11-27T17:48:23.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.346+0000 7f926eb14700 1 -- 172.21.15.177:0/2212584595 shutdown_connections 2023-11-27T17:48:23.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.346+0000 7fbf137fe700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbefc00afc0 0x7fbefc00d450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf140cdd60 tx=0x7fbefc003840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aab0368f831cc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.346+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c011880 con 0x7fbefc00afc0 2023-11-27T17:48:23.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.346+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0119e0 con 0x7fbefc00afc0 2023-11-27T17:48:23.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.346+0000 7fbf11ffb700 1 -- 172.21.15.177:0/2592908845 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c011d90 con 0x7fbefc00afc0 2023-11-27T17:48:23.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.346+0000 7f18f13d9700 1 -- start start 2023-11-27T17:48:23.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7f926eb14700 1 -- 172.21.15.177:0/2212584595 wait complete. 2023-11-27T17:48:23.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7f18f13d9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec06d910 0x7f18ec06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7f18f13d9700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec06e520 con 0x7f18ec15e880 2023-11-27T17:48:23.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7f18f13d9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec06efc0 con 0x7f18ec0b1600 2023-11-27T17:48:23.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7f18f13d9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec06f2a0 con 0x7f18ec06d910 2023-11-27T17:48:23.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7fbf19830700 1 -- 172.21.15.177:0/2592908845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbefc00afc0 msgr2=0x7fbefc00d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7fbf19830700 1 --2- 172.21.15.177:0/2592908845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbefc00afc0 0x7fbefc00d450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf140cdd60 tx=0x7fbefc003840 comp rx=0 tx=0).stop 2023-11-27T17:48:23.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7fbf137fe700 1 -- 172.21.15.177:0/2592908845 reap_dead start 2023-11-27T17:48:23.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7fbf19830700 1 -- 172.21.15.177:0/2592908845 shutdown_connections 2023-11-27T17:48:23.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7fbf19830700 1 -- 172.21.15.177:0/2592908845 >> 172.21.15.177:0/2592908845 conn(0x7fbf140b51d0 msgr2=0x7fbf140b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7f18eaffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec06d910 0x7f18ec06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7f18eaffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec06d910 0x7f18ec06e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39112/0 (socket says 172.21.15.177:39112) 2023-11-27T17:48:23.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.347+0000 7f18eaffd700 1 -- 172.21.15.177:0/2696284356 learned_addr learned my addr 172.21.15.177:0/2696284356 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f18eaffd700 1 -- 172.21.15.177:0/2696284356 >> v1:172.21.15.178:6789/0 conn(0x7f18ec0b1600 legacy=0x7f18ec070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f18eaffd700 1 -- 172.21.15.177:0/2696284356 >> v1:172.21.15.177:6789/0 conn(0x7f18ec15e880 legacy=0x7f18ec0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f18eaffd700 1 -- 172.21.15.177:0/2696284356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec06f580 con 0x7f18ec06d910 2023-11-27T17:48:23.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7fa38ce5f700 1 Processor -- start 2023-11-27T17:48:23.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7fa38ce5f700 1 -- start start 2023-11-27T17:48:23.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f18eaffd700 1 --2- 172.21.15.177:0/2696284356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec06d910 0x7f18ec06e8c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009e80 tx=0x7f18e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=277032765041a3dc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f18e9ffb700 1 -- 172.21.15.177:0/2696284356 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400e070 con 0x7f18ec06d910 2023-11-27T17:48:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f18e9ffb700 1 -- 172.21.15.177:0/2696284356 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e4003a20 con 0x7f18ec06d910 2023-11-27T17:48:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f18e9ffb700 1 -- 172.21.15.177:0/2696284356 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4003db0 con 0x7f18ec06d910 2023-11-27T17:48:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f926eb14700 1 Processor -- start 2023-11-27T17:48:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa38ce5f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa388161590 0x7fa3881628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa38ce5f700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3880c93c0 0x7fa3880b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa38ce5f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3880b33b0 0x7fa3880b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa38ce5f700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3880c9bd0 con 0x7fa3880c93c0 2023-11-27T17:48:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa38ce5f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3880c9eb0 con 0x7fa3880b33b0 2023-11-27T17:48:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa38ce5f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3880b2670 con 0x7fa388161590 2023-11-27T17:48:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.348+0000 7f926eb14700 1 -- start start 2023-11-27T17:48:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7f18f13d9700 1 -- 172.21.15.177:0/2696284356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec06d910 msgr2=0x7f18ec06e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7f18f13d9700 1 --2- 172.21.15.177:0/2696284356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec06d910 0x7f18ec06e8c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009e80 tx=0x7f18e400b330 comp rx=0 tx=0).stop 2023-11-27T17:48:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fd0a8c06700 1 Processor -- start 2023-11-27T17:48:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa385d9b700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3880c93c0 0x7fa3880b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa386d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3880b33b0 0x7fa3880b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa386d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3880b33b0 0x7fa3880b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59676/0 (socket says 172.21.15.177:59676) 2023-11-27T17:48:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa385d9b700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3880c93c0 0x7fa3880b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51652/0 (socket says 172.21.15.177:51652) 2023-11-27T17:48:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa386d9d700 1 -- 172.21.15.177:0/364969218 learned_addr learned my addr 172.21.15.177:0/364969218 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.349+0000 7fa38659c700 1 --2- 172.21.15.177:0/364969218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa388161590 0x7fa3881628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7fd0a8c06700 1 -- start start 2023-11-27T17:48:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926eb14700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9268072610 0x7f9268144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926eb14700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268165f40 0x7f92680b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926eb14700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9268144bd0 0x7f92680b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926eb14700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680b5b80 con 0x7f9268165f40 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926eb14700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680b5e60 con 0x7f9268144bd0 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926eb14700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680b6140 con 0x7f9268072610 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926c8b0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9268072610 0x7f9268144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7fa38659c700 1 -- 172.21.15.177:0/364969218 >> v2:172.21.15.178:3300/0 conn(0x7fa3880b33b0 msgr2=0x7fa3880b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7fa38659c700 1 --2- 172.21.15.177:0/364969218 >> v2:172.21.15.178:3300/0 conn(0x7fa3880b33b0 0x7fa3880b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7fa38659c700 1 -- 172.21.15.177:0/364969218 >> v2:172.21.15.177:3300/0 conn(0x7fa3880c93c0 msgr2=0x7fa3880b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7fa38659c700 1 --2- 172.21.15.177:0/364969218 >> v2:172.21.15.177:3300/0 conn(0x7fa3880c93c0 0x7fa3880b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7fa38659c700 1 -- 172.21.15.177:0/364969218 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880b2950 con 0x7fa388161590 2023-11-27T17:48:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f9267fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268165f40 0x7f92680b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926c8b0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9268072610 0x7f9268144690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39124/0 (socket says 172.21.15.177:39124) 2023-11-27T17:48:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f926c8b0700 1 -- 172.21.15.177:0/3172012798 learned_addr learned my addr 172.21.15.177:0/3172012798 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7fa38659c700 1 --2- 172.21.15.177:0/364969218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa388161590 0x7fa3881628d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa3880af0f0 tx=0x7fa378009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7a3a2c311b0d42 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f9267fff700 1 -- 172.21.15.177:0/3172012798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9268072610 msgr2=0x7f9268144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f9267fff700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9268072610 0x7f9268144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f9267fff700 1 -- 172.21.15.177:0/3172012798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9268144bd0 msgr2=0x7f92680b5550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f9267fff700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9268144bd0 0x7f92680b5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.350+0000 7f9267fff700 1 -- 172.21.15.177:0/3172012798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254009550 con 0x7f9268165f40 2023-11-27T17:48:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fa38559a700 1 -- 172.21.15.177:0/364969218 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378011830 con 0x7fa388161590 2023-11-27T17:48:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fbf19830700 1 -- 172.21.15.177:0/2592908845 shutdown_connections 2023-11-27T17:48:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fbf19830700 1 -- 172.21.15.177:0/2592908845 wait complete. 2023-11-27T17:48:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7f18f13d9700 1 -- 172.21.15.177:0/2696284356 shutdown_connections 2023-11-27T17:48:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7f18f13d9700 1 --2- 172.21.15.177:0/2696284356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec06d910 0x7f18ec06e8c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7f18f13d9700 1 -- 172.21.15.177:0/2696284356 >> 172.21.15.177:0/2696284356 conn(0x7f18ec0b2130 msgr2=0x7f18ec0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7f18f13d9700 1 -- 172.21.15.177:0/2696284356 shutdown_connections 2023-11-27T17:48:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7f18f13d9700 1 -- 172.21.15.177:0/2696284356 wait complete. 2023-11-27T17:48:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a8c06700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd0a4162540 0x7fd0a4071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a8c06700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 0x7fd0a40cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a8c06700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40713a0 con 0x7fd0a40cd210 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a8c06700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a40cd6c0 con 0x7fd0a4162540 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a8c06700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40cfca0 con 0x7fd0a40720d0 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a259c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd0a4162540 0x7fd0a4071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a259c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd0a4162540 0x7fd0a4071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51664/0 (socket says 172.21.15.177:51664) 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a259c700 1 -- 172.21.15.177:0/2501230764 learned_addr learned my addr 172.21.15.177:0/2501230764 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fd0a1d9b700 1 --2- 172.21.15.177:0/2501230764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 0x7fd0a40cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fd0a259c700 1 -- 172.21.15.177:0/2501230764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 msgr2=0x7fd0a40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fd0a259c700 1 --2- 172.21.15.177:0/2501230764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 0x7fd0a40cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fd0a259c700 1 -- 172.21.15.177:0/2501230764 >> v1:172.21.15.178:6789/0 conn(0x7fd0a40cd210 legacy=0x7fd0a40ce3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fd0a259c700 1 -- 172.21.15.177:0/2501230764 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4162920 con 0x7fd0a4162540 2023-11-27T17:48:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fd0a259c700 1 --2- 172.21.15.177:0/2501230764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a4162540 0x7fd0a4071b90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd0980098f0 tx=0x7fd098009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f1aeff8e6a1003 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fd0a159a700 1 -- 172.21.15.177:0/2501230764 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098004230 con 0x7fd0a4162540 2023-11-27T17:48:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fd0a159a700 1 -- 172.21.15.177:0/2501230764 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd098004390 con 0x7fd0a4162540 2023-11-27T17:48:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fd0a159a700 1 -- 172.21.15.177:0/2501230764 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980036a0 con 0x7fd0a4162540 2023-11-27T17:48:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fbf19830700 1 Processor -- start 2023-11-27T17:48:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2501230764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a4162540 msgr2=0x7fd0a4071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2501230764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a4162540 0x7fd0a4071b90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd0980098f0 tx=0x7fd098009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:23.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fa38559a700 1 -- 172.21.15.177:0/364969218 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa378011990 con 0x7fa388161590 2023-11-27T17:48:23.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.351+0000 7fa38559a700 1 -- 172.21.15.177:0/364969218 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378011d20 con 0x7fa388161590 2023-11-27T17:48:23.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fa38ce5f700 1 -- 172.21.15.177:0/364969218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa388161590 msgr2=0x7fa3881628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/364969218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa388161590 0x7fa3881628d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa3880af0f0 tx=0x7fa378009b20 comp rx=0 tx=0).stop 2023-11-27T17:48:23.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fa38ce5f700 1 -- 172.21.15.177:0/364969218 shutdown_connections 2023-11-27T17:48:23.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/364969218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa388161590 0x7fa3881628d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/364969218 >> v2:172.21.15.178:3300/0 conn(0x7fa3880b33b0 0x7fa3880b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/364969218 >> v2:172.21.15.177:3300/0 conn(0x7fa3880c93c0 0x7fa3880b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.352+0000 7fa38ce5f700 1 -- 172.21.15.177:0/364969218 >> 172.21.15.177:0/364969218 conn(0x7fa3880b51d0 msgr2=0x7fa3880b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7f9267fff700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268165f40 0x7f92680b5010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f925c009fd0 tx=0x7f925c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fa38ce5f700 1 -- 172.21.15.177:0/364969218 shutdown_connections 2023-11-27T17:48:23.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fbf19830700 1 -- start start 2023-11-27T17:48:23.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2501230764 shutdown_connections 2023-11-27T17:48:23.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2501230764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a4162540 0x7fd0a4071b90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2501230764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 0x7fd0a40cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2501230764 >> 172.21.15.177:0/2501230764 conn(0x7fd0a40b15d0 msgr2=0x7fd0a40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2501230764 shutdown_connections 2023-11-27T17:48:23.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7f92657fa700 1 -- 172.21.15.177:0/3172012798 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c011830 con 0x7f9268165f40 2023-11-27T17:48:23.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7f92657fa700 1 -- 172.21.15.177:0/3172012798 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c0119b0 con 0x7f9268165f40 2023-11-27T17:48:23.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7f92657fa700 1 -- 172.21.15.177:0/3172012798 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c011d60 con 0x7f9268165f40 2023-11-27T17:48:23.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.353+0000 7fa38ce5f700 1 -- 172.21.15.177:0/364969218 wait complete. 2023-11-27T17:48:23.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7f18f13d9700 1 Processor -- start 2023-11-27T17:48:23.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7f18f13d9700 1 -- start start 2023-11-27T17:48:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2501230764 wait complete. 2023-11-27T17:48:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fbf19830700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc00afc0 0x7fbf14204680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fbf19830700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf140ad830 0x7fbf140c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fbf19830700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf140adcb0 0x7fbf140c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fbf19830700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14204bc0 con 0x7fbf140ad830 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fbf19830700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140c5a30 con 0x7fbefc00afc0 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fbf19830700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140ac790 con 0x7fbf140adcb0 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.354+0000 7fbf127fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf140ad830 0x7fbf140c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf127fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf140ad830 0x7fbf140c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51670/0 (socket says 172.21.15.177:51670) 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf127fc700 1 -- 172.21.15.177:0/1963866588 learned_addr learned my addr 172.21.15.177:0/1963866588 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf137fe700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf140adcb0 0x7fbf140c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf12ffd700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc00afc0 0x7fbf14204680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf137fe700 1 -- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc00afc0 msgr2=0x7fbf14204680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf137fe700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc00afc0 0x7fbf14204680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf137fe700 1 -- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf140ad830 msgr2=0x7fbf140c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf137fe700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf140ad830 0x7fbf140c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf137fe700 1 -- 172.21.15.177:0/1963866588 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140aca70 con 0x7fbf140adcb0 2023-11-27T17:48:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18f13d9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18ec06d910 0x7f18ec16a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18f13d9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec0b1600 0x7f18ec14c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18f13d9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ec15e880 0x7f18ec14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18f13d9700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec15acd0 con 0x7f18ec06d910 2023-11-27T17:48:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18f13d9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec16a750 con 0x7f18ec15e880 2023-11-27T17:48:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18f13d9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec16aa30 con 0x7f18ec0b1600 2023-11-27T17:48:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fbf137fe700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf140adcb0 0x7fbf140c54f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c019000 tx=0x7fbf0c001d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18eaffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18ec06d910 0x7f18ec16a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18eaffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18ec06d910 0x7f18ec16a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51674/0 (socket says 172.21.15.177:51674) 2023-11-27T17:48:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18eaffd700 1 -- 172.21.15.177:0/2600018237 learned_addr learned my addr 172.21.15.177:0/2600018237 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7f18ea7fc700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec0b1600 0x7f18ec14c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7f18eb7fe700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ec15e880 0x7f18ec14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7fbefbfff700 1 -- 172.21.15.177:0/1963866588 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0019b0 con 0x7fbf140adcb0 2023-11-27T17:48:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7fbefbfff700 1 -- 172.21.15.177:0/1963866588 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c01a470 con 0x7fbf140adcb0 2023-11-27T17:48:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7fbefbfff700 1 -- 172.21.15.177:0/1963866588 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c01a840 con 0x7fbf140adcb0 2023-11-27T17:48:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7fd0a8c06700 1 Processor -- start 2023-11-27T17:48:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf140acd50 con 0x7fbf140adcb0 2023-11-27T17:48:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf140ad310 con 0x7fbf140adcb0 2023-11-27T17:48:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7f18ea7fc700 1 -- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ec15e880 msgr2=0x7f18ec14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7f18ea7fc700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ec15e880 0x7f18ec14e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7f18ea7fc700 1 -- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18ec06d910 msgr2=0x7f18ec16a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7f18ea7fc700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18ec06d910 0x7f18ec16a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7f18ea7fc700 1 -- 172.21.15.177:0/2600018237 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4009b30 con 0x7f18ec0b1600 2023-11-27T17:48:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7f18ea7fc700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec0b1600 0x7f18ec14c510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18e0000f60 tx=0x7f18e000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7f18db7fe700 1 -- 172.21.15.177:0/2600018237 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00052d0 con 0x7f18ec0b1600 2023-11-27T17:48:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.358+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf14069400 con 0x7fbf140adcb0 2023-11-27T17:48:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fbefbfff700 1 -- 172.21.15.177:0/1963866588 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbf0c017070 con 0x7fbf140adcb0 2023-11-27T17:48:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fbefbfff700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf0006b250 0x7fbf0006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fbefbfff700 1 -- 172.21.15.177:0/1963866588 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf0c08ac60 con 0x7fbf140adcb0 2023-11-27T17:48:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7f18db7fe700 1 -- 172.21.15.177:0/2600018237 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e0005430 con 0x7f18ec0b1600 2023-11-27T17:48:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7f18db7fe700 1 -- 172.21.15.177:0/2600018237 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00038c0 con 0x7f18ec0b1600 2023-11-27T17:48:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec168040 con 0x7f18ec0b1600 2023-11-27T17:48:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec16ad10 con 0x7f18ec0b1600 2023-11-27T17:48:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92680b6420 con 0x7f9268165f40 2023-11-27T17:48:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92681452d0 con 0x7f9268165f40 2023-11-27T17:48:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7f92657fa700 1 -- 172.21.15.177:0/3172012798 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f925c01a400 con 0x7f9268165f40 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7f92657fa700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f924c06b2a0 0x7f924c06d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7f926c8b0700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f924c06b2a0 0x7f924c06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.358+0000 7fd0a8c06700 1 -- start start 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fd0a8c06700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 0x7fd0a415da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fd0a8c06700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a40cd210 0x7fd0a40ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fd0a8c06700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a4162540 0x7fd0a415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fd0a8c06700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4164550 con 0x7fd0a40cd210 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fd0a8c06700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a41647b0 con 0x7fd0a4162540 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fd0a8c06700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4164a90 con 0x7fd0a40720d0 2023-11-27T17:48:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a1d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a40cd210 0x7fd0a40ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a1d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a40cd210 0x7fd0a40ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51694/0 (socket says 172.21.15.177:51694) 2023-11-27T17:48:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a1d9b700 1 -- 172.21.15.177:0/2253855286 learned_addr learned my addr 172.21.15.177:0/2253855286 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fa38ce5f700 1 Processor -- start 2023-11-27T17:48:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.355+0000 7fa38ce5f700 1 -- start start 2023-11-27T17:48:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7fa38ce5f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3880c93c0 0x7fa3881fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.356+0000 7fa38ce5f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa388161590 0x7fa388155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa38ce5f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa388152a30 0x7fa3880cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa38ce5f700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa388153940 con 0x7fa388152a30 2023-11-27T17:48:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa38ce5f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881fbda0 con 0x7fa388161590 2023-11-27T17:48:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa38ce5f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881519c0 con 0x7fa3880c93c0 2023-11-27T17:48:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa388161590 0x7fa388155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa388161590 0x7fa388155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59706/0 (socket says 172.21.15.177:59706) 2023-11-27T17:48:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 -- 172.21.15.177:0/2248305164 learned_addr learned my addr 172.21.15.177:0/2248305164 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 -- 172.21.15.177:0/2248305164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3880c93c0 msgr2=0x7fa3881fc1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3880c93c0 0x7fa3881fc1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 -- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa388152a30 msgr2=0x7fa3880cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa388152a30 0x7fa3880cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 -- 172.21.15.177:0/2248305164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3780094a0 con 0x7fa388161590 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.357+0000 7fa385d9b700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa388161590 0x7fa388155290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa37000e9b0 tx=0x7fa37000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fa37effd700 1 -- 172.21.15.177:0/2248305164 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000c850 con 0x7fa388161590 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fa37effd700 1 -- 172.21.15.177:0/2248305164 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000c9b0 con 0x7fa388161590 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fa37effd700 1 -- 172.21.15.177:0/2248305164 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000cd20 con 0x7fa388161590 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3881fc700 con 0x7fa388161590 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.359+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa388153660 con 0x7fa388161590 2023-11-27T17:48:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fbf12ffd700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf0006b250 0x7fbf0006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7f92657fa700 1 -- 172.21.15.177:0/3172012798 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f925c057c70 con 0x7f9268165f40 2023-11-27T17:48:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a259c700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 0x7fd0a415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a1d9b700 1 -- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 msgr2=0x7fd0a415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a1d9b700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 0x7fd0a415da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a1d9b700 1 -- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a4162540 msgr2=0x7fd0a415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a2d9d700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a4162540 0x7fd0a415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fbf12ffd700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf0006b250 0x7fbf0006d710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009b60 tx=0x7fbf04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a1d9b700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a4162540 0x7fd0a415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a1d9b700 1 -- 172.21.15.177:0/2253855286 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098009550 con 0x7fd0a40cd210 2023-11-27T17:48:23.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7fd0a2d9d700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a4162540 0x7fd0a415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:23.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7f18db7fe700 1 -- 172.21.15.177:0/2600018237 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f18e0003a20 con 0x7f18ec0b1600 2023-11-27T17:48:23.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec073aa0 con 0x7f18ec0b1600 2023-11-27T17:48:23.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.360+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9268073aa0 con 0x7f9268165f40 2023-11-27T17:48:23.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.361+0000 7f926c8b0700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f924c06b2a0 0x7f924c06d760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9254009c40 tx=0x7f9254008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.361+0000 7fe27161d700 1 Processor -- start 2023-11-27T17:48:23.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.361+0000 7fe27161d700 1 -- start start 2023-11-27T17:48:23.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.361+0000 7f18db7fe700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f18d006b250 0x7f18d006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.361+0000 7fd0a1d9b700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a40cd210 0x7fd0a40ca280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e9b0 tx=0x7fd09400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.361+0000 7f18db7fe700 1 -- 172.21.15.177:0/2600018237 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18e0088cd0 con 0x7f18ec0b1600 2023-11-27T17:48:23.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.361+0000 7f18eaffd700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f18d006b250 0x7f18d006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe27161d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe26c1477f0 0x7fe26c0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe27161d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c0adee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe27161d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c0b68e0 con 0x7fe26c0b5b80 2023-11-27T17:48:23.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe27161d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c0ada00 con 0x7fe26c1477f0 2023-11-27T17:48:23.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe27161d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0b6040 con 0x7fe26c070c00 2023-11-27T17:48:23.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fa37effd700 1 -- 172.21.15.177:0/2248305164 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa370013470 con 0x7fa388161590 2023-11-27T17:48:23.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7f18eaffd700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f18d006b250 0x7f18d006d710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009fd0 tx=0x7f18e4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fa37effd700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36808d2b0 0x7fa36808f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fa37effd700 1 -- 172.21.15.177:0/2248305164 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa370089a40 con 0x7fa388161590 2023-11-27T17:48:23.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fa38659c700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36808d2b0 0x7fa36808f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe26affd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe26c1477f0 0x7fe26c0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe26affd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe26c1477f0 0x7fe26c0b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59720/0 (socket says 172.21.15.177:59720) 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe26affd700 1 -- 172.21.15.177:0/3843874473 learned_addr learned my addr 172.21.15.177:0/3843874473 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.362+0000 7fe26b7fe700 1 --2- 172.21.15.177:0/3843874473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c0adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe26affd700 1 -- 172.21.15.177:0/3843874473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 msgr2=0x7fe26c0adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe26affd700 1 --2- 172.21.15.177:0/3843874473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c0adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe26affd700 1 -- 172.21.15.177:0/3843874473 >> v1:172.21.15.178:6789/0 conn(0x7fe26c0b5b80 legacy=0x7fe26c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe26affd700 1 -- 172.21.15.177:0/3843874473 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c0b6320 con 0x7fe26c1477f0 2023-11-27T17:48:23.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe269ffb700 1 -- 172.21.15.177:0/3843874473 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224245323 0 0) 0x7fe26c0b68e0 con 0x7fe26c0b5b80 2023-11-27T17:48:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe26affd700 1 --2- 172.21.15.177:0/3843874473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c1477f0 0x7fe26c0b5640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe2600098f0 tx=0x7fe260009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d7a8ff61d5032b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe269ffb700 1 -- 172.21.15.177:0/3843874473 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011830 con 0x7fe26c1477f0 2023-11-27T17:48:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe269ffb700 1 -- 172.21.15.177:0/3843874473 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe260011990 con 0x7fe26c1477f0 2023-11-27T17:48:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fe269ffb700 1 -- 172.21.15.177:0/3843874473 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011d20 con 0x7fe26c1477f0 2023-11-27T17:48:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.363+0000 7fa38659c700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36808d2b0 0x7fa36808f770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3780090b0 tx=0x7fa378008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c0052e0 con 0x7fa388161590 2023-11-27T17:48:23.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fe27161d700 1 -- 172.21.15.177:0/3843874473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c1477f0 msgr2=0x7fe26c0b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fe27161d700 1 --2- 172.21.15.177:0/3843874473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c1477f0 0x7fe26c0b5640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe2600098f0 tx=0x7fe260009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:23.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fe27161d700 1 -- 172.21.15.177:0/3843874473 shutdown_connections 2023-11-27T17:48:23.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fe27161d700 1 --2- 172.21.15.177:0/3843874473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c1477f0 0x7fe26c0b5640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fe27161d700 1 --2- 172.21.15.177:0/3843874473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c0adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fe27161d700 1 -- 172.21.15.177:0/3843874473 >> 172.21.15.177:0/3843874473 conn(0x7fe26c0b2130 msgr2=0x7fe26c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fe27161d700 1 -- 172.21.15.177:0/3843874473 shutdown_connections 2023-11-27T17:48:23.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7fe27161d700 1 -- 172.21.15.177:0/3843874473 wait complete. 2023-11-27T17:48:23.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7f63c8a73700 1 Processor -- start 2023-11-27T17:48:23.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.364+0000 7f63c8a73700 1 -- start start 2023-11-27T17:48:23.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.365+0000 7fbefbfff700 1 -- 172.21.15.177:0/1963866588 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbf0c055a20 con 0x7fbf140adcb0 2023-11-27T17:48:23.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7fe27161d700 1 Processor -- start 2023-11-27T17:48:23.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7fe27161d700 1 -- start start 2023-11-27T17:48:23.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c8a73700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f63c41446c0 0x7f63c4143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c8a73700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 0x7f63c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c8a73700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c40af1d0 con 0x7f63c41436d0 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c8a73700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c4070ce0 con 0x7f63c41446c0 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c8a73700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4144480 con 0x7f63c4143ff0 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c259c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f63c41436d0 0x7f63c40704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46024/0 (socket says 172.21.15.177:46024) 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c259c700 1 -- 172.21.15.177:0/2424686280 learned_addr learned my addr 172.21.15.177:0/2424686280 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c2d9d700 1 --2- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 0x7f63c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.366+0000 7f63c1d9b700 1 --2- 172.21.15.177:0/2424686280 >> v2:172.21.15.178:3300/0 conn(0x7f63c41446c0 0x7f63c4143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7f63c1d9b700 1 -- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 msgr2=0x7f63c406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7f63c1d9b700 1 --2- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 0x7f63c406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7f63c1d9b700 1 -- 172.21.15.177:0/2424686280 >> v1:172.21.15.177:6789/0 conn(0x7f63c41436d0 legacy=0x7f63c40704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7f63c1d9b700 1 -- 172.21.15.177:0/2424686280 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40ae410 con 0x7f63c41446c0 2023-11-27T17:48:23.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7f63c2d9d700 1 --2- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 0x7f63c406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:23.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7f63c1d9b700 1 --2- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41446c0 0x7f63c4143ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009840 tx=0x7f63b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c5a615471efc541 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fab3f454700 1 Processor -- start 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe27161d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe27161d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0b5b80 0x7fe26c06d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe27161d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe26c1477f0 0x7fe26c06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe27161d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c15df30 con 0x7fe26c1477f0 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe27161d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c15e700 con 0x7fe26c0b5b80 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe27161d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c15ecc0 con 0x7fe26c070c00 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26a7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0b5b80 0x7fe26c06d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe26c1477f0 0x7fe26c06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c15d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39178/0 (socket says 172.21.15.177:39178) 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26a7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0b5b80 0x7fe26c06d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59736/0 (socket says 172.21.15.177:59736) 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe26c1477f0 0x7fe26c06dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51716/0 (socket says 172.21.15.177:51716) 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26affd700 1 -- 172.21.15.177:0/723208094 learned_addr learned my addr 172.21.15.177:0/723208094 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26affd700 1 -- 172.21.15.177:0/723208094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0b5b80 msgr2=0x7fe26c06d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26affd700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0b5b80 0x7fe26c06d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26affd700 1 -- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe26c1477f0 msgr2=0x7fe26c06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fe26affd700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe26c1477f0 0x7fe26c06dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fe26affd700 1 -- 172.21.15.177:0/723208094 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260009550 con 0x7fe26c070c00 2023-11-27T17:48:23.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fe26affd700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c15d9f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe260014040 tx=0x7fe260004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fd092ffd700 1 -- 172.21.15.177:0/2253855286 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094009710 con 0x7fd0a40cd210 2023-11-27T17:48:23.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fd092ffd700 1 -- 172.21.15.177:0/2253855286 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09400c850 con 0x7fd0a40cd210 2023-11-27T17:48:23.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fd092ffd700 1 -- 172.21.15.177:0/2253855286 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400cbc0 con 0x7fd0a40cd210 2023-11-27T17:48:23.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a4164d70 con 0x7fd0a40cd210 2023-11-27T17:48:23.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a4165330 con 0x7fd0a40cd210 2023-11-27T17:48:23.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7f92657fa700 1 -- 172.21.15.177:0/3172012798 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f925c08e060 con 0x7f9268165f40 2023-11-27T17:48:23.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.367+0000 7fab3f454700 1 -- start start 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3f454700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fab38143b20 0x7fab380729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3f454700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab3806d4e0 0x7fab380cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3f454700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3806da50 con 0x7fab380cc380 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3f454700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380cc810 con 0x7fab38143b20 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3f454700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380707e0 con 0x7fab3806d4e0 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3d1f0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fab38143b20 0x7fab380729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3d1f0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fab38143b20 0x7fab380729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51718/0 (socket says 172.21.15.177:51718) 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3d1f0700 1 -- 172.21.15.177:0/3356375556 learned_addr learned my addr 172.21.15.177:0/3356375556 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.368+0000 7fab3c9ef700 1 --2- 172.21.15.177:0/3356375556 >> v2:172.21.15.178:3300/0 conn(0x7fab3806d4e0 0x7fab380cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fab3d1f0700 1 -- 172.21.15.177:0/3356375556 >> v2:172.21.15.178:3300/0 conn(0x7fab3806d4e0 msgr2=0x7fab380cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fab3d1f0700 1 --2- 172.21.15.177:0/3356375556 >> v2:172.21.15.178:3300/0 conn(0x7fab3806d4e0 0x7fab380cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fab3d1f0700 1 -- 172.21.15.177:0/3356375556 >> v1:172.21.15.178:6789/0 conn(0x7fab380cc380 legacy=0x7fab3815de30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T17:48:23.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fab3d1f0700 1 -- 172.21.15.177:0/3356375556 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3806dd30 con 0x7fab38143b20 2023-11-27T17:48:23.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fab3d1f0700 1 --2- 172.21.15.177:0/3356375556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab38143b20 0x7fab380729c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab34007360 tx=0x7fab34007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d0bcf9530cc44d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7f63c159a700 1 -- 172.21.15.177:0/2424686280 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8011830 con 0x7f63c41446c0 2023-11-27T17:48:23.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7f63c159a700 1 -- 172.21.15.177:0/2424686280 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8011990 con 0x7f63c41446c0 2023-11-27T17:48:23.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7f63c159a700 1 -- 172.21.15.177:0/2424686280 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8011d20 con 0x7f63c41446c0 2023-11-27T17:48:23.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a4069400 con 0x7fd0a40cd210 2023-11-27T17:48:23.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fa37effd700 1 -- 172.21.15.177:0/2248305164 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa3700582e0 con 0x7fa388161590 2023-11-27T17:48:23.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fe2537fe700 1 -- 172.21.15.177:0/723208094 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260004590 con 0x7fe26c070c00 2023-11-27T17:48:23.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.369+0000 7fe2537fe700 1 -- 172.21.15.177:0/723208094 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26001e070 con 0x7fe26c070c00 2023-11-27T17:48:23.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.370+0000 7fe2537fe700 1 -- 172.21.15.177:0/723208094 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2600038c0 con 0x7fe26c070c00 2023-11-27T17:48:23.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.370+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c140480 con 0x7fe26c070c00 2023-11-27T17:48:23.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.370+0000 7fab2ffff700 1 -- 172.21.15.177:0/3356375556 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400f070 con 0x7fab38143b20 2023-11-27T17:48:23.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.370+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c15e950 con 0x7fe26c070c00 2023-11-27T17:48:23.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.370+0000 7f18db7fe700 1 -- 172.21.15.177:0/2600018237 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f18e00539f0 con 0x7f18ec0b1600 2023-11-27T17:48:23.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.370+0000 7f63c8a73700 1 -- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41446c0 msgr2=0x7f63c4143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.370+0000 7f63c8a73700 1 --2- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41446c0 0x7f63c4143ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009840 tx=0x7f63b8009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:23.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.371+0000 7fd092ffd700 1 -- 172.21.15.177:0/2253855286 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd09400cd20 con 0x7fd0a40cd210 2023-11-27T17:48:23.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.371+0000 7f63c8a73700 1 -- 172.21.15.177:0/2424686280 shutdown_connections 2023-11-27T17:48:23.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.371+0000 7f63c8a73700 1 --2- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 0x7f63c406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.371+0000 7f63c8a73700 1 --2- 172.21.15.177:0/2424686280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41446c0 0x7f63c4143ab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.371+0000 7f63c8a73700 1 -- 172.21.15.177:0/2424686280 >> 172.21.15.177:0/2424686280 conn(0x7f63c40d0e70 msgr2=0x7f63c40b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.371+0000 7f63c8a73700 1 -- 172.21.15.177:0/2424686280 shutdown_connections 2023-11-27T17:48:23.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.372+0000 7fd092ffd700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd08406b250 0x7fd08406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.372+0000 7fd092ffd700 1 -- 172.21.15.177:0/2253855286 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd09408a280 con 0x7fd0a40cd210 2023-11-27T17:48:23.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.371+0000 7f63c8a73700 1 -- 172.21.15.177:0/2424686280 wait complete. 2023-11-27T17:48:23.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.373+0000 7f63c8a73700 1 Processor -- start 2023-11-27T17:48:23.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7fe2537fe700 1 -- 172.21.15.177:0/723208094 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe260003a20 con 0x7fe26c070c00 2023-11-27T17:48:23.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.373+0000 7f63c8a73700 1 -- start start 2023-11-27T17:48:23.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c8a73700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41436d0 0x7f63c4161270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c8a73700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 0x7f63c41607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c8a73700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c41446c0 0x7f63c4146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c8a73700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41f8d20 con 0x7f63c41446c0 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c8a73700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4160d00 con 0x7f63c41436d0 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c8a73700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40ce910 con 0x7f63c4143ff0 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41436d0 0x7f63c4161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41436d0 0x7f63c4161270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59746/0 (socket says 172.21.15.177:59746) 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c259c700 1 -- 172.21.15.177:0/665861468 learned_addr learned my addr 172.21.15.177:0/665861468 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7fe2537fe700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe25806b250 0x7fe25806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7fe2537fe700 1 -- 172.21.15.177:0/723208094 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe26008a880 con 0x7fe26c070c00 2023-11-27T17:48:23.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7fe26a7fc700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe25806b250 0x7fe25806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c259c700 1 -- 172.21.15.177:0/665861468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 msgr2=0x7f63c41607c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:23.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c259c700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 0x7f63c41607c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c259c700 1 -- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c41446c0 msgr2=0x7f63c4146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.374+0000 7f63c259c700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c41446c0 0x7f63c4146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.375+0000 7f63c259c700 1 -- 172.21.15.177:0/665861468 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc009a70 con 0x7f63c41436d0 2023-11-27T17:48:23.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.375+0000 7f63c259c700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41436d0 0x7f63c4161270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f63b400c550 tx=0x7f63b400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.375+0000 7fe26a7fc700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe25806b250 0x7fe25806d710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe26c146b60 tx=0x7fe264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.375+0000 7f63b2ffd700 1 -- 172.21.15.177:0/665861468 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4005d70 con 0x7f63c41436d0 2023-11-27T17:48:23.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.375+0000 7f63b2ffd700 1 -- 172.21.15.177:0/665861468 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b40070d0 con 0x7f63c41436d0 2023-11-27T17:48:23.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.375+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b80094a0 con 0x7f63c41436d0 2023-11-27T17:48:23.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.375+0000 7f63b2ffd700 1 -- 172.21.15.177:0/665861468 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4007440 con 0x7f63c41436d0 2023-11-27T17:48:23.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.375+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c41f8380 con 0x7f63c41436d0 2023-11-27T17:48:23.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.376+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c0052e0 con 0x7fe26c070c00 2023-11-27T17:48:23.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.376+0000 7f63b2ffd700 1 -- 172.21.15.177:0/665861468 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f63b40075a0 con 0x7f63c41436d0 2023-11-27T17:48:23.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.377+0000 7f63b2ffd700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f63a406b250 0x7f63a406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.377+0000 7f63b2ffd700 1 -- 172.21.15.177:0/665861468 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63b40895e0 con 0x7f63c41436d0 2023-11-27T17:48:23.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.377+0000 7f63c1d9b700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f63a406b250 0x7f63a406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.377+0000 7f63c1d9b700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f63a406b250 0x7f63a406d710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f63c4141970 tx=0x7f63b8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.378+0000 7fab2ffff700 1 -- 172.21.15.177:0/3356375556 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34008bf0 con 0x7fab38143b20 2023-11-27T17:48:23.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.378+0000 7fab2ffff700 1 -- 172.21.15.177:0/3356375556 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34004030 con 0x7fab38143b20 2023-11-27T17:48:23.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.378+0000 7fab3f454700 1 -- 172.21.15.177:0/3356375556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab38143b20 msgr2=0x7fab380729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.378+0000 7fab3f454700 1 --2- 172.21.15.177:0/3356375556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab38143b20 0x7fab380729c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab34007360 tx=0x7fab34007670 comp rx=0 tx=0).stop 2023-11-27T17:48:23.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.379+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c4073aa0 con 0x7f63c41436d0 2023-11-27T17:48:23.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.379+0000 7fd092ffd700 1 -- 172.21.15.177:0/2253855286 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd094055020 con 0x7fd0a40cd210 2023-11-27T17:48:23.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.380+0000 7fab3f454700 1 -- 172.21.15.177:0/3356375556 shutdown_connections 2023-11-27T17:48:23.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.380+0000 7fab3f454700 1 --2- 172.21.15.177:0/3356375556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab38143b20 0x7fab380729c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.380+0000 7fab3f454700 1 --2- 172.21.15.177:0/3356375556 >> v2:172.21.15.178:3300/0 conn(0x7fab3806d4e0 0x7fab380cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.380+0000 7fab3f454700 1 -- 172.21.15.177:0/3356375556 >> 172.21.15.177:0/3356375556 conn(0x7fab380b2860 msgr2=0x7fab380b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.381+0000 7fe2537fe700 1 -- 172.21.15.177:0/723208094 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe260020080 con 0x7fe26c070c00 2023-11-27T17:48:23.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.382+0000 7fd0a259c700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd08406b250 0x7fd08406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.382+0000 7fd0a259c700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd08406b250 0x7fd08406d710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd098009c40 tx=0x7fd098008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.384+0000 7f63b2ffd700 1 -- 172.21.15.177:0/665861468 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f63b405ce60 con 0x7f63c41436d0 2023-11-27T17:48:23.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.391+0000 7fab3f454700 1 -- 172.21.15.177:0/3356375556 shutdown_connections 2023-11-27T17:48:23.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.393+0000 7fab3f454700 1 -- 172.21.15.177:0/3356375556 wait complete. 2023-11-27T17:48:23.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.394+0000 7fab3f454700 1 Processor -- start 2023-11-27T17:48:23.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.405+0000 7fab3f454700 1 -- start start 2023-11-27T17:48:23.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.406+0000 7fab3f454700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab3806d4e0 0x7fab381537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.406+0000 7fab3f454700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cc380 0x7fab38153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.406+0000 7fab3f454700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab38143b20 0x7fab381f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.406+0000 7fab3f454700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38152330 con 0x7fab380cc380 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.406+0000 7fab3f454700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38156870 con 0x7fab38143b20 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.406+0000 7fab3f454700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab38154670 con 0x7fab3806d4e0 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.407+0000 7fab3d9f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab38143b20 0x7fab381f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.407+0000 7fab3d9f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab38143b20 0x7fab381f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59758/0 (socket says 172.21.15.177:59758) 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.407+0000 7fab3d9f1700 1 -- 172.21.15.177:0/1858178643 learned_addr learned my addr 172.21.15.177:0/1858178643 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.408+0000 7fab3d1f0700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab3806d4e0 0x7fab381537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.408+0000 7fab3d1f0700 1 -- 172.21.15.177:0/1858178643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab38143b20 msgr2=0x7fab381f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.408+0000 7fab3d1f0700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab38143b20 0x7fab381f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.408+0000 7fab3d1f0700 1 -- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cc380 msgr2=0x7fab38153ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.408+0000 7fab3d1f0700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cc380 0x7fab38153ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.408+0000 7fab3d1f0700 1 -- 172.21.15.177:0/1858178643 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34007040 con 0x7fab3806d4e0 2023-11-27T17:48:23.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.411+0000 7fab3d1f0700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab3806d4e0 0x7fab381537a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab34015000 tx=0x7fab34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.415+0000 7fab2dffb700 1 -- 172.21.15.177:0/1858178643 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340036a0 con 0x7fab3806d4e0 2023-11-27T17:48:23.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.415+0000 7fab2dffb700 1 -- 172.21.15.177:0/1858178643 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34021070 con 0x7fab3806d4e0 2023-11-27T17:48:23.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.415+0000 7fab2dffb700 1 -- 172.21.15.177:0/1858178643 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34003a00 con 0x7fab3806d4e0 2023-11-27T17:48:23.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.415+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab38152580 con 0x7fab3806d4e0 2023-11-27T17:48:23.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.415+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab38152b40 con 0x7fab3806d4e0 2023-11-27T17:48:23.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.418+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab180052e0 con 0x7fab3806d4e0 2023-11-27T17:48:23.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.422+0000 7fab2dffb700 1 -- 172.21.15.177:0/1858178643 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fab34003b60 con 0x7fab3806d4e0 2023-11-27T17:48:23.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.422+0000 7fab2dffb700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fab1c06b320 0x7fab1c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:23.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.422+0000 7fab2dffb700 1 -- 172.21.15.177:0/1858178643 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab34023070 con 0x7fab3806d4e0 2023-11-27T17:48:23.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.423+0000 7fab3c9ef700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fab1c06b320 0x7fab1c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:23.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.423+0000 7fab3c9ef700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fab1c06b320 0x7fab1c06d7e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab380cc350 tx=0x7fab28009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:23.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.427+0000 7fab2dffb700 1 -- 172.21.15.177:0/1858178643 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fab340593a0 con 0x7fab3806d4e0 2023-11-27T17:48:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.739+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf140b6320 con 0x7fbf140adcb0 2023-11-27T17:48:23.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.740+0000 7fbefbfff700 1 -- 172.21.15.177:0/1963866588 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf0c029020 con 0x7fbf140adcb0 2023-11-27T17:48:23.745 INFO:teuthology.orchestra.run.smithi177.stdout:55834574852 2023-11-27T17:48:23.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.743+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf0006b250 msgr2=0x7fbf0006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.743+0000 7fbf19830700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf0006b250 0x7fbf0006d710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009b60 tx=0x7fbf04008040 comp rx=0 tx=0).stop 2023-11-27T17:48:23.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.743+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf140adcb0 msgr2=0x7fbf140c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.743+0000 7fbf19830700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf140adcb0 0x7fbf140c54f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c019000 tx=0x7fbf0c001d00 comp rx=0 tx=0).stop 2023-11-27T17:48:23.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.744+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 shutdown_connections 2023-11-27T17:48:23.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.744+0000 7fbf19830700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf0006b250 0x7fbf0006d710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.744+0000 7fbf19830700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf140adcb0 0x7fbf140c54f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.744+0000 7fbf19830700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbefc00afc0 0x7fbf14204680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.744+0000 7fbf19830700 1 --2- 172.21.15.177:0/1963866588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf140ad830 0x7fbf140c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.744+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 >> 172.21.15.177:0/1963866588 conn(0x7fbf140b51d0 msgr2=0x7fbf140cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.744+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 shutdown_connections 2023-11-27T17:48:23.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.744+0000 7fbf19830700 1 -- 172.21.15.177:0/1963866588 wait complete. 2023-11-27T17:48:23.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-11-27T17:48:23.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.767+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f18ec168560 con 0x7f18ec0b1600 2023-11-27T17:48:23.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.769+0000 7f18db7fe700 1 -- 172.21.15.177:0/2600018237 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18ec168560 con 0x7f18ec0b1600 2023-11-27T17:48:23.771 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-27T17:48:23.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f18d006b250 msgr2=0x7f18d006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f18d006b250 0x7f18d006d710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009fd0 tx=0x7f18e4009000 comp rx=0 tx=0).stop 2023-11-27T17:48:23.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec0b1600 msgr2=0x7f18ec14c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec0b1600 0x7f18ec14c510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18e0000f60 tx=0x7f18e000c730 comp rx=0 tx=0).stop 2023-11-27T17:48:23.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 shutdown_connections 2023-11-27T17:48:23.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f18d006b250 0x7f18d006d710 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009fd0 tx=0x7f18e4009000 comp rx=0 tx=0).stop 2023-11-27T17:48:23.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ec15e880 0x7f18ec14e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18ec06d910 0x7f18ec16a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 --2- 172.21.15.177:0/2600018237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ec0b1600 0x7f18ec14c510 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18e0000f60 tx=0x7f18e000c730 comp rx=0 tx=0).stop 2023-11-27T17:48:23.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 >> 172.21.15.177:0/2600018237 conn(0x7f18ec0b2130 msgr2=0x7f18ec151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 shutdown_connections 2023-11-27T17:48:23.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.773+0000 7f18f13d9700 1 -- 172.21.15.177:0/2600018237 wait complete. 2023-11-27T17:48:23.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.777+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa36c005860 con 0x7fa388161590 2023-11-27T17:48:23.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.780+0000 7fa37effd700 1 -- 172.21.15.177:0/2248305164 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa370021070 con 0x7fa388161590 2023-11-27T17:48:23.782 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:23.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.781+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9268069400 con 0x7f9268165f40 2023-11-27T17:48:23.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.781+0000 7f92657fa700 1 -- 172.21.15.177:0/3172012798 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f925c0538b0 con 0x7f9268165f40 2023-11-27T17:48:23.783 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-27T17:48:23.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.783+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd0a40cf120 con 0x7fd0a40cd210 2023-11-27T17:48:23.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.784+0000 7fd092ffd700 1 -- 172.21.15.177:0/2253855286 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd094058640 con 0x7fd0a40cd210 2023-11-27T17:48:23.786 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:23.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.785+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36808d2b0 msgr2=0x7fa36808f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.785+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36808d2b0 0x7fa36808f770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3780090b0 tx=0x7fa378008030 comp rx=0 tx=0).stop 2023-11-27T17:48:23.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.785+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa388161590 msgr2=0x7fa388155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.785+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa388161590 0x7fa388155290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa37000e9b0 tx=0x7fa37000ed70 comp rx=0 tx=0).stop 2023-11-27T17:48:23.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.785+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f924c06b2a0 msgr2=0x7f924c06d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.785+0000 7f926eb14700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f924c06b2a0 0x7f924c06d760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9254009c40 tx=0x7f9254008030 comp rx=0 tx=0).stop 2023-11-27T17:48:23.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.785+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268165f40 msgr2=0x7f92680b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.785+0000 7f926eb14700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268165f40 0x7f92680b5010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f925c009fd0 tx=0x7f925c00b6c0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe24c005590 con 0x7fe26c070c00 2023-11-27T17:48:23.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f63c41f8e60 con 0x7f63c41436d0 2023-11-27T17:48:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 shutdown_connections 2023-11-27T17:48:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36808d2b0 0x7fa36808f770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa388152a30 0x7fa3880cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3880c93c0 0x7fa3881fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7fa38ce5f700 1 --2- 172.21.15.177:0/2248305164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa388161590 0x7fa388155290 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 shutdown_connections 2023-11-27T17:48:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 >> 172.21.15.177:0/2248305164 conn(0x7fa3880b51d0 msgr2=0x7fa38815b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f926eb14700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f924c06b2a0 0x7f924c06d760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f926eb14700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9268144bd0 0x7f92680b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f926eb14700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9268072610 0x7f9268144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f926eb14700 1 --2- 172.21.15.177:0/3172012798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9268165f40 0x7f92680b5010 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 >> 172.21.15.177:0/3172012798 conn(0x7f926806aff0 msgr2=0x7f92680704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 shutdown_connections 2023-11-27T17:48:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.786+0000 7f926eb14700 1 -- 172.21.15.177:0/3172012798 wait complete. 2023-11-27T17:48:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.787+0000 7fe2537fe700 1 -- 172.21.15.177:0/723208094 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe260015030 con 0x7fe26c070c00 2023-11-27T17:48:23.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.787+0000 7f63b2ffd700 1 -- 172.21.15.177:0/665861468 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63c41f8e60 con 0x7f63c41436d0 2023-11-27T17:48:23.792 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-27T17:48:23.792 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-27T17:48:23.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.789+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f63a406b250 msgr2=0x7f63a406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.789+0000 7f63c8a73700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f63a406b250 0x7f63a406d710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f63c4141970 tx=0x7f63b8008030 comp rx=0 tx=0).stop 2023-11-27T17:48:23.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.789+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41436d0 msgr2=0x7f63c4161270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.789+0000 7f63c8a73700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41436d0 0x7f63c4161270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f63b400c550 tx=0x7f63b400c910 comp rx=0 tx=0).stop 2023-11-27T17:48:23.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe25806b250 msgr2=0x7fe25806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe25806b250 0x7fe25806d710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe26c146b60 tx=0x7fe264009040 comp rx=0 tx=0).stop 2023-11-27T17:48:23.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 msgr2=0x7fe26c15d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c15d9f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe260014040 tx=0x7fe260004750 comp rx=0 tx=0).stop 2023-11-27T17:48:23.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 shutdown_connections 2023-11-27T17:48:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7f63c8a73700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f63a406b250 0x7f63a406d710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7f63c8a73700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63c41446c0 0x7f63c4146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7f63c8a73700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c41436d0 0x7f63c4161270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7f63c8a73700 1 --2- 172.21.15.177:0/665861468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c4143ff0 0x7f63c41607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 >> 172.21.15.177:0/665861468 conn(0x7f63c40d0e70 msgr2=0x7f63c4140650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 shutdown_connections 2023-11-27T17:48:23.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe25806b250 0x7fe25806d710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe26c1477f0 0x7fe26c06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c070c00 0x7fe26c15d9f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 --2- 172.21.15.177:0/723208094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0b5b80 0x7fe26c06d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 >> 172.21.15.177:0/723208094 conn(0x7fe26c0b2130 msgr2=0x7fe26c0ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 shutdown_connections 2023-11-27T17:48:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 shutdown_connections 2023-11-27T17:48:23.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.790+0000 7fe27161d700 1 -- 172.21.15.177:0/723208094 wait complete. 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.787+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd08406b250 msgr2=0x7fd08406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.787+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd08406b250 0x7fd08406d710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd098009c40 tx=0x7fd098008030 comp rx=0 tx=0).stop 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.787+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a40cd210 msgr2=0x7fd0a40ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.787+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a40cd210 0x7fd0a40ca280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e9b0 tx=0x7fd09400ed70 comp rx=0 tx=0).stop 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.788+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 shutdown_connections 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.788+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd08406b250 0x7fd08406d710 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.788+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a4162540 0x7fd0a415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.788+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a40720d0 0x7fd0a415da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.788+0000 7fd0a8c06700 1 --2- 172.21.15.177:0/2253855286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0a40cd210 0x7fd0a40ca280 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd09400e9b0 tx=0x7fd09400ed70 comp rx=0 tx=0).stop 2023-11-27T17:48:23.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.788+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 >> 172.21.15.177:0/2253855286 conn(0x7fd0a40b15d0 msgr2=0x7fd0a4161440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-27T17:48:23.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.791+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 shutdown_connections 2023-11-27T17:48:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.791+0000 7fa38ce5f700 1 -- 172.21.15.177:0/2248305164 wait complete. 2023-11-27T17:48:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.791+0000 7f63c8a73700 1 -- 172.21.15.177:0/665861468 wait complete. 2023-11-27T17:48:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.793+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 shutdown_connections 2023-11-27T17:48:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.793+0000 7fd0a8c06700 1 -- 172.21.15.177:0/2253855286 wait complete. 2023-11-27T17:48:23.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.803+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fab18005590 con 0x7fab3806d4e0 2023-11-27T17:48:23.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.804+0000 7fab2dffb700 1 -- 172.21.15.177:0/1858178643 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab3405c9c0 con 0x7fab3806d4e0 2023-11-27T17:48:23.806 INFO:teuthology.orchestra.run.smithi177.stdout:55834574852 2023-11-27T17:48:23.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.807+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fab1c06b320 msgr2=0x7fab1c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.807+0000 7fab3f454700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fab1c06b320 0x7fab1c06d7e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab380cc350 tx=0x7fab28009210 comp rx=0 tx=0).stop 2023-11-27T17:48:23.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.807+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab3806d4e0 msgr2=0x7fab381537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:23.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.807+0000 7fab3f454700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab3806d4e0 0x7fab381537a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab34015000 tx=0x7fab34004750 comp rx=0 tx=0).stop 2023-11-27T17:48:23.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.809+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 shutdown_connections 2023-11-27T17:48:23.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.809+0000 7fab3f454700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fab1c06b320 0x7fab1c06d7e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.809+0000 7fab3f454700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab38143b20 0x7fab381f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.809+0000 7fab3f454700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab3806d4e0 0x7fab381537a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.809+0000 7fab3f454700 1 --2- 172.21.15.177:0/1858178643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab380cc380 0x7fab38153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:23.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.809+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 >> 172.21.15.177:0/1858178643 conn(0x7fab380b2860 msgr2=0x7fab3813ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:23.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.809+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 shutdown_connections 2023-11-27T17:48:23.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:23.809+0000 7fab3f454700 1 -- 172.21.15.177:0/1858178643 wait complete. 2023-11-27T17:48:23.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-27T17:48:23.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-27T17:48:23.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-27T17:48:23.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-11-27T17:48:23.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-11-27T17:48:23.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-11-27T17:48:24.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T17:48:24.798 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T17:48:24.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T17:48:24.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T17:48:24.819 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T17:48:24.822 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T17:48:24.822 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T17:48:24.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T17:48:24.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.944+0000 7fd7b9367700 1 Processor -- start 2023-11-27T17:48:24.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.944+0000 7fd7b9367700 1 -- start start 2023-11-27T17:48:24.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.945+0000 7fd7b9367700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7b4168860 0x7fd7b416b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:24.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.946+0000 7fd7b9367700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b4070890 con 0x7fd7b4071930 2023-11-27T17:48:24.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.946+0000 7fd7b9367700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b4070b70 con 0x7fd7b40cb0a0 2023-11-27T17:48:24.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.946+0000 7fd7b9367700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b4168c40 con 0x7fd7b4168860 2023-11-27T17:48:24.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.947+0000 7fd7b37fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd7b40cb0a0 0x7fd7b40b2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45042/0 (socket says 172.21.15.177:45042) 2023-11-27T17:48:24.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.947+0000 7fd7b37fe700 1 -- 172.21.15.177:0/3031637134 learned_addr learned my addr 172.21.15.177:0/3031637134 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:24.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.947+0000 7fd7b1ffb700 1 -- 172.21.15.177:0/3031637134 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298718883 0 0) 0x7fd7b4070b70 con 0x7fd7b40cb0a0 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.947+0000 7fd7b2ffd700 1 --2- 172.21.15.177:0/3031637134 >> v2:172.21.15.177:3300/0 conn(0x7fd7b4168860 0x7fd7b416b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.950+0000 7fd7b1ffb700 1 -- 172.21.15.177:0/3031637134 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd79c003e40 con 0x7fd7b40cb0a0 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.950+0000 7fd7b1ffb700 1 -- 172.21.15.177:0/3031637134 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452285781 0 0) 0x7fd7b4070890 con 0x7fd7b4071930 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.950+0000 7fd7b1ffb700 1 -- 172.21.15.177:0/3031637134 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b4070b70 con 0x7fd7b4071930 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.951+0000 7fd7b2ffd700 1 -- 172.21.15.177:0/3031637134 >> v1:172.21.15.178:6789/0 conn(0x7fd7b40cb0a0 legacy=0x7fd7b40b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.951+0000 7fd7b2ffd700 1 -- 172.21.15.177:0/3031637134 >> v1:172.21.15.177:6789/0 conn(0x7fd7b4071930 legacy=0x7fd7b40ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.951+0000 7fd7b2ffd700 1 -- 172.21.15.177:0/3031637134 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4070e50 con 0x7fd7b4168860 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.951+0000 7fd7b2ffd700 1 --2- 172.21.15.177:0/3031637134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4168860 0x7fd7b416b200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac007c40 tx=0x7fd7ac007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51993ef201836240 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:24.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.952+0000 7fd7b1ffb700 1 -- 172.21.15.177:0/3031637134 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4001670 con 0x7fd7b4168860 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.952+0000 7fd7b1ffb700 1 -- 172.21.15.177:0/3031637134 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac00cad0 con 0x7fd7b4168860 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.952+0000 7fd7b1ffb700 1 -- 172.21.15.177:0/3031637134 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac00ce60 con 0x7fd7b4168860 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.953+0000 7fd7b9367700 1 -- 172.21.15.177:0/3031637134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4168860 msgr2=0x7fd7b416b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.953+0000 7fd7b9367700 1 --2- 172.21.15.177:0/3031637134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4168860 0x7fd7b416b200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac007c40 tx=0x7fd7ac007f50 comp rx=0 tx=0).stop 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.953+0000 7fd7b9367700 1 -- 172.21.15.177:0/3031637134 shutdown_connections 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.953+0000 7fd7b9367700 1 --2- 172.21.15.177:0/3031637134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4168860 0x7fd7b416b200 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.953+0000 7fd7b9367700 1 -- 172.21.15.177:0/3031637134 >> 172.21.15.177:0/3031637134 conn(0x7fd7b40b51d0 msgr2=0x7fd7b40b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.953+0000 7fd7b9367700 1 -- 172.21.15.177:0/3031637134 shutdown_connections 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.953+0000 7fd7b9367700 1 -- 172.21.15.177:0/3031637134 wait complete. 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.955+0000 7fd7b9367700 1 Processor -- start 2023-11-27T17:48:24.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.956+0000 7fd7b9367700 1 -- start start 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.957+0000 7fd7b9367700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4071930 0x7fd7b40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.957+0000 7fd7b9367700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b40cb0a0 0x7fd7b406d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.957+0000 7fd7b9367700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b4168860 0x7fd7b408a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.957+0000 7fd7b9367700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b406ef90 con 0x7fd7b4071930 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.957+0000 7fd7b9367700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4163520 con 0x7fd7b4168860 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.957+0000 7fd7b9367700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b406c7c0 con 0x7fd7b40cb0a0 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.958+0000 7fd7b2ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4071930 0x7fd7b40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.958+0000 7fd7b2ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4071930 0x7fd7b40cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51750/0 (socket says 172.21.15.177:51750) 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.958+0000 7fd7b2ffd700 1 -- 172.21.15.177:0/2416477169 learned_addr learned my addr 172.21.15.177:0/2416477169 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.959+0000 7fd7b2ffd700 1 -- 172.21.15.177:0/2416477169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b40cb0a0 msgr2=0x7fd7b406d580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.959+0000 7fd7b2ffd700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b40cb0a0 0x7fd7b406d580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:24.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.959+0000 7fd7b2ffd700 1 -- 172.21.15.177:0/2416477169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b4168860 msgr2=0x7fd7b408a520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T17:48:24.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.959+0000 7fd7b2ffd700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b4168860 0x7fd7b408a520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:24.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.959+0000 7fd7b2ffd700 1 -- 172.21.15.177:0/2416477169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac007840 con 0x7fd7b4071930 2023-11-27T17:48:24.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.959+0000 7fd7b2ffd700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4071930 0x7fd7b40cf150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac000f80 tx=0x7fd7ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:24.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.960+0000 7fd79b7fe700 1 -- 172.21.15.177:0/2416477169 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac012070 con 0x7fd7b4071930 2023-11-27T17:48:24.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.960+0000 7fd79b7fe700 1 -- 172.21.15.177:0/2416477169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac015680 con 0x7fd7b4071930 2023-11-27T17:48:24.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.960+0000 7fd79b7fe700 1 -- 172.21.15.177:0/2416477169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac015a30 con 0x7fd7b4071930 2023-11-27T17:48:24.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.960+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b406caa0 con 0x7fd7b4071930 2023-11-27T17:48:24.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.960+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b406d060 con 0x7fd7b4071930 2023-11-27T17:48:24.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.963+0000 7fd79b7fe700 1 -- 172.21.15.177:0/2416477169 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd7ac008040 con 0x7fd7b4071930 2023-11-27T17:48:24.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.964+0000 7fd79b7fe700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd79c06b910 0x7fd79c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:24.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.964+0000 7fd79b7fe700 1 -- 172.21.15.177:0/2416477169 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7ac08b7b0 con 0x7fd7b4071930 2023-11-27T17:48:24.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.966+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a00052e0 con 0x7fd7b4071930 2023-11-27T17:48:24.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.970+0000 7fd7b27fc700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd79c06b910 0x7fd79c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:24.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.970+0000 7fd7b27fc700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd79c06b910 0x7fd79c06ddd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40ae860 tx=0x7fd7a4001490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:24.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.975+0000 7fd79b7fe700 1 -- 172.21.15.177:0/2416477169 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd7ac056550 con 0x7fd7b4071930 2023-11-27T17:48:25.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.995+0000 7f15cb8af700 1 Processor -- start 2023-11-27T17:48:25.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.995+0000 7f15cb8af700 1 -- start start 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.997+0000 7f15cb8af700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 0x7f15c40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.997+0000 7f15cb8af700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15c40cf7c0 0x7f15c415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.997+0000 7f15cb8af700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40cedf0 con 0x7f15c415d570 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.997+0000 7f15cb8af700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40ce500 con 0x7f15c40cf7c0 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.997+0000 7f15cb8af700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40cb7b0 con 0x7f15c40cb330 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.998+0000 7f15c964b700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f15c415d570 0x7f15c40704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46074/0 (socket says 172.21.15.177:46074) 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.998+0000 7f15c964b700 1 -- 172.21.15.177:0/2059160327 learned_addr learned my addr 172.21.15.177:0/2059160327 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.998+0000 7f15c9e4c700 1 --2- 172.21.15.177:0/2059160327 >> v2:172.21.15.177:3300/0 conn(0x7f15c40cf7c0 0x7f15c415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.998+0000 7f15c9e4c700 1 -- 172.21.15.177:0/2059160327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 msgr2=0x7f15c40cf280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T17:48:25.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.998+0000 7f15c9e4c700 1 --2- 172.21.15.177:0/2059160327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 0x7f15c40cf280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.998+0000 7f15c9e4c700 1 -- 172.21.15.177:0/2059160327 >> v1:172.21.15.177:6789/0 conn(0x7f15c415d570 legacy=0x7f15c40704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.998+0000 7f15c9e4c700 1 -- 172.21.15.177:0/2059160327 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40cba60 con 0x7f15c40cf7c0 2023-11-27T17:48:25.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:24.999+0000 7f15c9e4c700 1 --2- 172.21.15.177:0/2059160327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40cf7c0 0x7f15c415dd80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009840 tx=0x7f15b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cce506ea6cccec2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.000+0000 7f15bbfff700 1 -- 172.21.15.177:0/2059160327 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4004230 con 0x7f15c40cf7c0 2023-11-27T17:48:25.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.000+0000 7f15bbfff700 1 -- 172.21.15.177:0/2059160327 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4004390 con 0x7f15c40cf7c0 2023-11-27T17:48:25.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.000+0000 7f15bbfff700 1 -- 172.21.15.177:0/2059160327 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40036a0 con 0x7f15c40cf7c0 2023-11-27T17:48:25.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.001+0000 7f15cb8af700 1 -- 172.21.15.177:0/2059160327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40cf7c0 msgr2=0x7f15c415dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.001+0000 7f15cb8af700 1 --2- 172.21.15.177:0/2059160327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40cf7c0 0x7f15c415dd80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009840 tx=0x7f15b4009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:25.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.001+0000 7f15cb8af700 1 -- 172.21.15.177:0/2059160327 shutdown_connections 2023-11-27T17:48:25.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.001+0000 7f15cb8af700 1 --2- 172.21.15.177:0/2059160327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c40cf7c0 0x7f15c415dd80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.001+0000 7f15cb8af700 1 --2- 172.21.15.177:0/2059160327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 0x7f15c40cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.001+0000 7f15cb8af700 1 -- 172.21.15.177:0/2059160327 >> 172.21.15.177:0/2059160327 conn(0x7f15c40b51d0 msgr2=0x7f15c40b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.002+0000 7f15cb8af700 1 -- 172.21.15.177:0/2059160327 shutdown_connections 2023-11-27T17:48:25.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.002+0000 7f15cb8af700 1 -- 172.21.15.177:0/2059160327 wait complete. 2023-11-27T17:48:25.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.004+0000 7f15cb8af700 1 Processor -- start 2023-11-27T17:48:25.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.004+0000 7f15cb8af700 1 -- start start 2023-11-27T17:48:25.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f6f84ad7700 1 Processor -- start 2023-11-27T17:48:25.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15cb8af700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 0x7f15c414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15cb8af700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40cf7c0 0x7f15c41552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15cb8af700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415d570 0x7f15c40a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15cb8af700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c414f050 con 0x7f15c415d570 2023-11-27T17:48:25.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15cb8af700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4152aa0 con 0x7f15c40cf7c0 2023-11-27T17:48:25.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15cb8af700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4152d80 con 0x7f15c40cb330 2023-11-27T17:48:25.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15c964b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 0x7f15c414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15c8e4a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40cf7c0 0x7f15c41552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15c9e4c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415d570 0x7f15c40a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f15c9e4c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415d570 0x7f15c40a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51764/0 (socket says 172.21.15.177:51764) 2023-11-27T17:48:25.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f15c9e4c700 1 -- 172.21.15.177:0/442869747 learned_addr learned my addr 172.21.15.177:0/442869747 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f15c9e4c700 1 -- 172.21.15.177:0/442869747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 msgr2=0x7f15c414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f15c9e4c700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 0x7f15c414eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f15c9e4c700 1 -- 172.21.15.177:0/442869747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40cf7c0 msgr2=0x7f15c41552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f15c9e4c700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40cf7c0 0x7f15c41552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f15c9e4c700 1 -- 172.21.15.177:0/442869747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40094a0 con 0x7f15c415d570 2023-11-27T17:48:25.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.005+0000 7f6f84ad7700 1 -- start start 2023-11-27T17:48:25.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f6f84ad7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6f8015d570 0x7f6f800cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f6f84ad7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f800cf990 0x7f6f8015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f6f84ad7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f800cedf0 con 0x7f6f800704b0 2023-11-27T17:48:25.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f6f84ad7700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f800cb870 con 0x7f6f8015d570 2023-11-27T17:48:25.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f6f84ad7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800cfde0 con 0x7f6f800cf990 2023-11-27T17:48:25.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f6f7e59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6f8015d570 0x7f6f800cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.006+0000 7f6f7e59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6f8015d570 0x7f6f800cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51766/0 (socket says 172.21.15.177:51766) 2023-11-27T17:48:25.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f6f7e59c700 1 -- 172.21.15.177:0/141323486 learned_addr learned my addr 172.21.15.177:0/141323486 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f15c9e4c700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415d570 0x7f15c40a9450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f15c406c250 tx=0x7f15b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f6f7ed9d700 1 --2- 172.21.15.177:0/141323486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f800cf990 0x7f6f8015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f6f7e59c700 1 -- 172.21.15.177:0/141323486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f800cf990 msgr2=0x7f6f8015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:25.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f6f7e59c700 1 --2- 172.21.15.177:0/141323486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f800cf990 0x7f6f8015dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f6f7e59c700 1 -- 172.21.15.177:0/141323486 >> v1:172.21.15.178:6789/0 conn(0x7f6f800704b0 legacy=0x7f6f800cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:25.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f6f7e59c700 1 -- 172.21.15.177:0/141323486 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800ce500 con 0x7f6f8015d570 2023-11-27T17:48:25.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f15b9ffb700 1 -- 172.21.15.177:0/442869747 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b401f070 con 0x7f15c415d570 2023-11-27T17:48:25.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f15b9ffb700 1 -- 172.21.15.177:0/442869747 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4010600 con 0x7f15c415d570 2023-11-27T17:48:25.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.007+0000 7f15b9ffb700 1 -- 172.21.15.177:0/442869747 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4010990 con 0x7f15c415d570 2023-11-27T17:48:25.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.008+0000 7f6f7e59c700 1 --2- 172.21.15.177:0/141323486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8015d570 0x7f6f800cb330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800d3a0 tx=0x7f6f7800d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261b928d9ff76fca server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.008+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4153060 con 0x7f15c415d570 2023-11-27T17:48:25.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.008+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c4153620 con 0x7f15c415d570 2023-11-27T17:48:25.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.010+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4153840 con 0x7f15c415d570 2023-11-27T17:48:25.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.010+0000 7f6f7d59a700 1 -- 172.21.15.177:0/141323486 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78010070 con 0x7f6f8015d570 2023-11-27T17:48:25.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.010+0000 7f6f7d59a700 1 -- 172.21.15.177:0/141323486 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7800dcc0 con 0x7f6f8015d570 2023-11-27T17:48:25.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.010+0000 7f6f7d59a700 1 -- 172.21.15.177:0/141323486 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78007d70 con 0x7f6f8015d570 2023-11-27T17:48:25.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.011+0000 7f6f84ad7700 1 -- 172.21.15.177:0/141323486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8015d570 msgr2=0x7f6f800cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.011+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/141323486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8015d570 0x7f6f800cb330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800d3a0 tx=0x7f6f7800d6b0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.011+0000 7f15b9ffb700 1 -- 172.21.15.177:0/442869747 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f15b4010af0 con 0x7f15c415d570 2023-11-27T17:48:25.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.011+0000 7f15b9ffb700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f15a806b320 0x7f15a806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.012+0000 7f15b9ffb700 1 -- 172.21.15.177:0/442869747 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15b408ada0 con 0x7f15c415d570 2023-11-27T17:48:25.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.012+0000 7f6f84ad7700 1 -- 172.21.15.177:0/141323486 shutdown_connections 2023-11-27T17:48:25.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.012+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/141323486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8015d570 0x7f6f800cb330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.012+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/141323486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f800cf990 0x7f6f8015dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.012+0000 7f6f84ad7700 1 -- 172.21.15.177:0/141323486 >> 172.21.15.177:0/141323486 conn(0x7f6f800b51d0 msgr2=0x7f6f800b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.012+0000 7f6f84ad7700 1 -- 172.21.15.177:0/141323486 shutdown_connections 2023-11-27T17:48:25.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.012+0000 7f15c964b700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f15a806b320 0x7f15a806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.012+0000 7f6f84ad7700 1 -- 172.21.15.177:0/141323486 wait complete. 2023-11-27T17:48:25.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.013+0000 7f15c964b700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f15a806b320 0x7f15a806d7e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15c00012e0 tx=0x7f15c0001270 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.014+0000 7f6f84ad7700 1 Processor -- start 2023-11-27T17:48:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.014+0000 7f6f84ad7700 1 -- start start 2023-11-27T17:48:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.015+0000 7f6f84ad7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f800704b0 0x7f6f801f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.015+0000 7f6f84ad7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f800cf990 0x7f6f80152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.015+0000 7f6f84ad7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8015d570 0x7f6f8006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.015+0000 7f6f84ad7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80152c10 con 0x7f6f800cf990 2023-11-27T17:48:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.015+0000 7f6f84ad7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80153a70 con 0x7f6f800704b0 2023-11-27T17:48:25.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.015+0000 7f6f84ad7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f801f8d60 con 0x7f6f8015d570 2023-11-27T17:48:25.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8015d570 0x7f6f8006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8015d570 0x7f6f8006eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39242/0 (socket says 172.21.15.177:39242) 2023-11-27T17:48:25.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7ed9d700 1 -- 172.21.15.177:0/2995156989 learned_addr learned my addr 172.21.15.177:0/2995156989 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7e59c700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f800704b0 0x7f6f801f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7dd9b700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f800cf990 0x7f6f80152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7ed9d700 1 -- 172.21.15.177:0/2995156989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f800704b0 msgr2=0x7f6f801f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7ed9d700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f800704b0 0x7f6f801f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7ed9d700 1 -- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f800cf990 msgr2=0x7f6f80152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7ed9d700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f800cf990 0x7f6f80152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.016+0000 7f6f7ed9d700 1 -- 172.21.15.177:0/2995156989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7800d050 con 0x7f6f8015d570 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.017+0000 7f6f7ed9d700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8015d570 0x7f6f8006eb10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000c820 tx=0x7f6f7000cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.017+0000 7f6f6effd700 1 -- 172.21.15.177:0/2995156989 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70004220 con 0x7f6f8015d570 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.017+0000 7f6f6effd700 1 -- 172.21.15.177:0/2995156989 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f70004380 con 0x7f6f8015d570 2023-11-27T17:48:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.017+0000 7f6f6effd700 1 -- 172.21.15.177:0/2995156989 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700036a0 con 0x7f6f8015d570 2023-11-27T17:48:25.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.017+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f80152e60 con 0x7f6f8015d570 2023-11-27T17:48:25.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.017+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f80153420 con 0x7f6f8015d570 2023-11-27T17:48:25.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.019+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f80153c00 con 0x7f6f8015d570 2023-11-27T17:48:25.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f15b9ffb700 1 -- 172.21.15.177:0/442869747 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f15b4055b40 con 0x7f15c415d570 2023-11-27T17:48:25.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.022+0000 7f6f6effd700 1 -- 172.21.15.177:0/2995156989 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6f70003800 con 0x7f6f8015d570 2023-11-27T17:48:25.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.023+0000 7f6f6effd700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6f6006b320 0x7f6f6006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.023+0000 7f6f6effd700 1 -- 172.21.15.177:0/2995156989 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f700898e0 con 0x7f6f8015d570 2023-11-27T17:48:25.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.019+0000 7f5bb46d3700 1 Processor -- start 2023-11-27T17:48:25.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.019+0000 7f5bb46d3700 1 -- start start 2023-11-27T17:48:25.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f5bb46d3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5bac1622e0 0x7f5bac0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f5bb46d3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5bac0cb0a0 0x7f5bac0b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f5bb46d3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac0aeee0 con 0x7f5bac1626c0 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f5bb46d3700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bac0b2df0 con 0x7f5bac0cb0a0 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f5bb46d3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bac0719b0 con 0x7f5bac1622e0 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f5bb246f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5bac1622e0 0x7f5bac0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f5bb246f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5bac1622e0 0x7f5bac0713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59802/0 (socket says 172.21.15.177:59802) 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.021+0000 7f5bb246f700 1 -- 172.21.15.177:0/3426214308 learned_addr learned my addr 172.21.15.177:0/3426214308 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.022+0000 7f5bb246f700 1 -- 172.21.15.177:0/3426214308 >> v2:172.21.15.177:3300/0 conn(0x7f5bac0cb0a0 msgr2=0x7f5bac0b3210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.022+0000 7f5bb246f700 1 --2- 172.21.15.177:0/3426214308 >> v2:172.21.15.177:3300/0 conn(0x7f5bac0cb0a0 0x7f5bac0b3210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.022+0000 7f5bb246f700 1 -- 172.21.15.177:0/3426214308 >> v1:172.21.15.177:6789/0 conn(0x7f5bac1626c0 legacy=0x7f5bac0ca990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.022+0000 7f5bb246f700 1 -- 172.21.15.177:0/3426214308 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac071c90 con 0x7f5bac1622e0 2023-11-27T17:48:25.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.024+0000 7f5bb246f700 1 --2- 172.21.15.177:0/3426214308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac1622e0 0x7f5bac0713d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bac073c00 tx=0x7f5b9c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29d97ac762b24265 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.024+0000 7f6f7e59c700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6f6006b320 0x7f6f6006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.024+0000 7f5bb146d700 1 -- 172.21.15.177:0/3426214308 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c004230 con 0x7f5bac1622e0 2023-11-27T17:48:25.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.024+0000 7f5bb146d700 1 -- 172.21.15.177:0/3426214308 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c004390 con 0x7f5bac1622e0 2023-11-27T17:48:25.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.024+0000 7f5bb146d700 1 -- 172.21.15.177:0/3426214308 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0036a0 con 0x7f5bac1622e0 2023-11-27T17:48:25.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.025+0000 7f6f6effd700 1 -- 172.21.15.177:0/2995156989 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6f700545f0 con 0x7f6f8015d570 2023-11-27T17:48:25.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.025+0000 7f6f7e59c700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6f6006b320 0x7f6f6006d7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f78000f80 tx=0x7f6f7800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.025+0000 7f5bb46d3700 1 -- 172.21.15.177:0/3426214308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac1622e0 msgr2=0x7f5bac0713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.025+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/3426214308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac1622e0 0x7f5bac0713d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bac073c00 tx=0x7f5b9c009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.025+0000 7f5bb46d3700 1 -- 172.21.15.177:0/3426214308 shutdown_connections 2023-11-27T17:48:25.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.025+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/3426214308 >> v2:172.21.15.177:3300/0 conn(0x7f5bac0cb0a0 0x7f5bac0b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.025+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/3426214308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac1622e0 0x7f5bac0713d0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bac073c00 tx=0x7f5b9c009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.026+0000 7f5bb46d3700 1 -- 172.21.15.177:0/3426214308 >> 172.21.15.177:0/3426214308 conn(0x7f5bac0b51d0 msgr2=0x7f5bac0b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.028+0000 7f5bb46d3700 1 -- 172.21.15.177:0/3426214308 shutdown_connections 2023-11-27T17:48:25.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.028+0000 7f5bb46d3700 1 -- 172.21.15.177:0/3426214308 wait complete. 2023-11-27T17:48:25.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.030+0000 7f5bb46d3700 1 Processor -- start 2023-11-27T17:48:25.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.033+0000 7f5bb46d3700 1 -- start start 2023-11-27T17:48:25.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.034+0000 7f5bb46d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bac0cb0a0 0x7f5bac161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.034+0000 7f5bb46d3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bac1626c0 0x7f5bac0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.034+0000 7f5bb46d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac14f8d0 0x7f5bac14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.034+0000 7f5bb46d3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac161980 con 0x7f5bac1626c0 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.034+0000 7f5bb46d3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac14ed20 con 0x7f5bac14f8d0 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.034+0000 7f5bb46d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0aebf0 con 0x7f5bac0cb0a0 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.035+0000 7f5bb1c6e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bac1626c0 0x7f5bac0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.035+0000 7f5bb1c6e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bac1626c0 0x7f5bac0ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51786/0 (socket says 172.21.15.177:51786) 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.035+0000 7f5bb1c6e700 1 -- 172.21.15.177:0/178566532 learned_addr learned my addr 172.21.15.177:0/178566532 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.035+0000 7f5bb1c6e700 1 -- 172.21.15.177:0/178566532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bac0cb0a0 msgr2=0x7f5bac161070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.035+0000 7f5bb1c6e700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bac0cb0a0 0x7f5bac161070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.035+0000 7f5bb1c6e700 1 -- 172.21.15.177:0/178566532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac14f8d0 msgr2=0x7f5bac14fd50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:25.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.035+0000 7f5bb1c6e700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac14f8d0 0x7f5bac14fd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.035+0000 7f5bb1c6e700 1 -- 172.21.15.177:0/178566532 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c009550 con 0x7f5bac1626c0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.036+0000 7f5bb1c6e700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bac1626c0 0x7f5bac0ae6b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800b450 tx=0x7f5ba800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.036+0000 7f5ba2ffd700 1 -- 172.21.15.177:0/178566532 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8011830 con 0x7f5bac1626c0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.036+0000 7f5ba2ffd700 1 -- 172.21.15.177:0/178566532 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba80119b0 con 0x7f5bac1626c0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.036+0000 7f5ba2ffd700 1 -- 172.21.15.177:0/178566532 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8011d60 con 0x7f5bac1626c0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.036+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac0c5710 con 0x7f5bac1626c0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.036+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac0c5c40 con 0x7f5bac1626c0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.038+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac069400 con 0x7f5bac1626c0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.039+0000 7f5ba2ffd700 1 -- 172.21.15.177:0/178566532 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5ba801a400 con 0x7f5bac1626c0 2023-11-27T17:48:25.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.039+0000 7f5ba2ffd700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b9808d4c0 0x7f5b9808f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.039+0000 7f5ba2ffd700 1 -- 172.21.15.177:0/178566532 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ba80899d0 con 0x7f5bac1626c0 2023-11-27T17:48:25.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.040+0000 7f5bb246f700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b9808d4c0 0x7f5b9808f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.040+0000 7f5bb246f700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b9808d4c0 0x7f5b9808f980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0b4810 tx=0x7f5b9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.050+0000 7f5ba2ffd700 1 -- 172.21.15.177:0/178566532 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5ba8054770 con 0x7f5bac1626c0 2023-11-27T17:48:25.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.079+0000 7fcacfbf6700 1 Processor -- start 2023-11-27T17:48:25.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.079+0000 7fcacfbf6700 1 -- start start 2023-11-27T17:48:25.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.081+0000 7fcacfbf6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcac80cb0a0 0x7fcac80713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.081+0000 7fcacfbf6700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcac81626c0 0x7fcac80b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.081+0000 7fcacfbf6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac80aeee0 con 0x7fcac81622e0 2023-11-27T17:48:25.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.081+0000 7fcacfbf6700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac80b2df0 con 0x7fcac81626c0 2023-11-27T17:48:25.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.081+0000 7fcacfbf6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80719b0 con 0x7fcac80cb0a0 2023-11-27T17:48:25.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.081+0000 7fcace193700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcac81626c0 0x7fcac80b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.081+0000 7fcace193700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcac81626c0 0x7fcac80b3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51792/0 (socket says 172.21.15.177:51792) 2023-11-27T17:48:25.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.081+0000 7fcace193700 1 -- 172.21.15.177:0/2837614611 learned_addr learned my addr 172.21.15.177:0/2837614611 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.082+0000 7fcace193700 1 -- 172.21.15.177:0/2837614611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcac80cb0a0 msgr2=0x7fcac80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:25.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.082+0000 7fcace193700 1 --2- 172.21.15.177:0/2837614611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcac80cb0a0 0x7fcac80713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.082+0000 7fcace193700 1 -- 172.21.15.177:0/2837614611 >> v1:172.21.15.178:6789/0 conn(0x7fcac81622e0 legacy=0x7fcac80ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:25.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.082+0000 7fcace193700 1 -- 172.21.15.177:0/2837614611 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8071c90 con 0x7fcac81626c0 2023-11-27T17:48:25.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.082+0000 7fcace193700 1 --2- 172.21.15.177:0/2837614611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81626c0 0x7fcac80b3210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009e80 tx=0x7fcac000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff625335a30487b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.083+0000 7fcacc990700 1 -- 172.21.15.177:0/2837614611 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000e070 con 0x7fcac81626c0 2023-11-27T17:48:25.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.083+0000 7fcacc990700 1 -- 172.21.15.177:0/2837614611 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0003a20 con 0x7fcac81626c0 2023-11-27T17:48:25.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.083+0000 7fcacc990700 1 -- 172.21.15.177:0/2837614611 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0003dd0 con 0x7fcac81626c0 2023-11-27T17:48:25.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.084+0000 7fcacfbf6700 1 -- 172.21.15.177:0/2837614611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81626c0 msgr2=0x7fcac80b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.084+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/2837614611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81626c0 0x7fcac80b3210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009e80 tx=0x7fcac000b330 comp rx=0 tx=0).stop 2023-11-27T17:48:25.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.084+0000 7fcacfbf6700 1 -- 172.21.15.177:0/2837614611 shutdown_connections 2023-11-27T17:48:25.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.084+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/2837614611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81626c0 0x7fcac80b3210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.084+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/2837614611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcac80cb0a0 0x7fcac80713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.084+0000 7fcacfbf6700 1 -- 172.21.15.177:0/2837614611 >> 172.21.15.177:0/2837614611 conn(0x7fcac80b51d0 msgr2=0x7fcac80b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.084+0000 7fcacfbf6700 1 -- 172.21.15.177:0/2837614611 shutdown_connections 2023-11-27T17:48:25.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.084+0000 7fcacfbf6700 1 -- 172.21.15.177:0/2837614611 wait complete. 2023-11-27T17:48:25.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.086+0000 7fcacfbf6700 1 Processor -- start 2023-11-27T17:48:25.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.086+0000 7fcacfbf6700 1 -- start start 2023-11-27T17:48:25.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.087+0000 7f00482fb700 1 Processor -- start 2023-11-27T17:48:25.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacfbf6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcac80cb0a0 0x7fcac81338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacfbf6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81622e0 0x7fcac81515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacfbf6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcac81626c0 0x7fcac8152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacfbf6700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac81548d0 con 0x7fcac81622e0 2023-11-27T17:48:25.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacfbf6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8151c80 con 0x7fcac81626c0 2023-11-27T17:48:25.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacfbf6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8151f60 con 0x7fcac80cb0a0 2023-11-27T17:48:25.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacd191700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81622e0 0x7fcac81515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacd191700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81622e0 0x7fcac81515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51800/0 (socket says 172.21.15.177:51800) 2023-11-27T17:48:25.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacd191700 1 -- 172.21.15.177:0/4077595215 learned_addr learned my addr 172.21.15.177:0/4077595215 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacd191700 1 -- 172.21.15.177:0/4077595215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcac80cb0a0 msgr2=0x7fcac81338b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:25.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacd191700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcac80cb0a0 0x7fcac81338b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7fcacd191700 1 -- 172.21.15.177:0/4077595215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcac81626c0 msgr2=0x7fcac8152830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:25.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7fcacd191700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcac81626c0 0x7fcac8152830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7fcacd191700 1 -- 172.21.15.177:0/4077595215 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0009b30 con 0x7fcac81622e0 2023-11-27T17:48:25.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7fcacd191700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81622e0 0x7fcac81515f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcac400b530 tx=0x7fcac400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.088+0000 7f00482fb700 1 -- start start 2023-11-27T17:48:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7fcabe7fc700 1 -- 172.21.15.177:0/4077595215 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4011830 con 0x7fcac81622e0 2023-11-27T17:48:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7fcabe7fc700 1 -- 172.21.15.177:0/4077595215 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40119b0 con 0x7fcac81622e0 2023-11-27T17:48:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7fcabe7fc700 1 -- 172.21.15.177:0/4077595215 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4011d60 con 0x7fcac81622e0 2023-11-27T17:48:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7f00482fb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0040162540 0x7f0040071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7f00482fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400720d0 0x7f00400cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7f00482fb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400713a0 con 0x7f00400cd210 2023-11-27T17:48:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7f00482fb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00400cd6c0 con 0x7f0040162540 2023-11-27T17:48:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7f00482fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400cfca0 con 0x7f00400720d0 2023-11-27T17:48:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.090+0000 7f0045896700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400720d0 0x7f00400cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.090+0000 7f0046898700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f00400cd210 0x7f00400ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45102/0 (socket says 172.21.15.177:45102) 2023-11-27T17:48:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.090+0000 7f0046898700 1 -- 172.21.15.177:0/3446046651 learned_addr learned my addr 172.21.15.177:0/3446046651 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.089+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac8152240 con 0x7fcac81622e0 2023-11-27T17:48:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.090+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac813dd00 con 0x7fcac81622e0 2023-11-27T17:48:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.091+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac8075420 con 0x7fcac81622e0 2023-11-27T17:48:25.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.093+0000 7fcabe7fc700 1 -- 172.21.15.177:0/4077595215 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcac401a400 con 0x7fcac81622e0 2023-11-27T17:48:25.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.093+0000 7fcabe7fc700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcaac06b2a0 0x7fcaac06d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.094+0000 7fcabe7fc700 1 -- 172.21.15.177:0/4077595215 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcac4089f80 con 0x7fcac81622e0 2023-11-27T17:48:25.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.094+0000 7f4755bfd700 1 Processor -- start 2023-11-27T17:48:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.094+0000 7fcacd992700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcaac06b2a0 0x7fcaac06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.095+0000 7fcacd992700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcaac06b2a0 0x7fcaac06d760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcab8001590 tx=0x7fcab8007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.094+0000 7f4755bfd700 1 -- start start 2023-11-27T17:48:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.091+0000 7f0045095700 1 -- 172.21.15.177:0/3446046651 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011037662 0 0) 0x7f00400713a0 con 0x7f00400cd210 2023-11-27T17:48:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.091+0000 7f0045095700 1 -- 172.21.15.177:0/3446046651 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f002c0035b0 con 0x7f00400cd210 2023-11-27T17:48:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.092+0000 7f0046097700 1 --2- 172.21.15.177:0/3446046651 >> v2:172.21.15.177:3300/0 conn(0x7f0040162540 0x7f0040071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.092+0000 7f0046097700 1 -- 172.21.15.177:0/3446046651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400720d0 msgr2=0x7f00400cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.092+0000 7f0046097700 1 --2- 172.21.15.177:0/3446046651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400720d0 0x7f00400cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.092+0000 7f0046097700 1 -- 172.21.15.177:0/3446046651 >> v1:172.21.15.178:6789/0 conn(0x7f00400cd210 legacy=0x7f00400ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.092+0000 7f0046097700 1 -- 172.21.15.177:0/3446046651 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040162920 con 0x7f0040162540 2023-11-27T17:48:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.093+0000 7f0046097700 1 --2- 172.21.15.177:0/3446046651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 0x7f0040071b90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0038009d90 tx=0x7f003800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc13d86b057f24a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.095+0000 7f4755bfd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f47500b5cf0 0x7f47500cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.095+0000 7f4755bfd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f47500cf280 0x7f47500cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.095+0000 7f4755bfd700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500cedf0 con 0x7f47500704b0 2023-11-27T17:48:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.095+0000 7f4755bfd700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47500cb870 con 0x7f47500b5cf0 2023-11-27T17:48:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.095+0000 7f4755bfd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47500ce500 con 0x7f47500cf280 2023-11-27T17:48:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.096+0000 7f474f7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f47500b5cf0 0x7f47500cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.096+0000 7f474effd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f47500704b0 0x7f475015d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46130/0 (socket says 172.21.15.177:46130) 2023-11-27T17:48:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.096+0000 7f474effd700 1 -- 172.21.15.177:0/4196325397 learned_addr learned my addr 172.21.15.177:0/4196325397 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.096+0000 7f474f7fe700 1 -- 172.21.15.177:0/4196325397 >> v2:172.21.15.178:3300/0 conn(0x7f47500cf280 msgr2=0x7f47500cf690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T17:48:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.096+0000 7f474f7fe700 1 --2- 172.21.15.177:0/4196325397 >> v2:172.21.15.178:3300/0 conn(0x7f47500cf280 0x7f47500cf690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.096+0000 7f474f7fe700 1 -- 172.21.15.177:0/4196325397 >> v1:172.21.15.177:6789/0 conn(0x7f47500704b0 legacy=0x7f475015d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.096+0000 7f474f7fe700 1 -- 172.21.15.177:0/4196325397 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500cba60 con 0x7f47500b5cf0 2023-11-27T17:48:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.096+0000 7f474f7fe700 1 --2- 172.21.15.177:0/4196325397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500b5cf0 0x7f47500cb330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f47500cca40 tx=0x7f4740009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e70da650c8ed68 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.101+0000 7fcabe7fc700 1 -- 172.21.15.177:0/4077595215 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcac4054e40 con 0x7fcac81622e0 2023-11-27T17:48:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.101+0000 7f474e7fc700 1 -- 172.21.15.177:0/4196325397 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740011830 con 0x7f47500b5cf0 2023-11-27T17:48:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.101+0000 7f474e7fc700 1 -- 172.21.15.177:0/4196325397 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740011990 con 0x7f47500b5cf0 2023-11-27T17:48:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.101+0000 7f474e7fc700 1 -- 172.21.15.177:0/4196325397 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740011d20 con 0x7f47500b5cf0 2023-11-27T17:48:25.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.101+0000 7f0045095700 1 -- 172.21.15.177:0/3446046651 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800e070 con 0x7f0040162540 2023-11-27T17:48:25.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.101+0000 7f0045095700 1 -- 172.21.15.177:0/3446046651 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800bb20 con 0x7f0040162540 2023-11-27T17:48:25.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.101+0000 7f0045095700 1 -- 172.21.15.177:0/3446046651 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800be90 con 0x7f0040162540 2023-11-27T17:48:25.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f00482fb700 1 -- 172.21.15.177:0/3446046651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 msgr2=0x7f0040071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f00482fb700 1 --2- 172.21.15.177:0/3446046651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 0x7f0040071b90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0038009d90 tx=0x7f003800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:25.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f00482fb700 1 -- 172.21.15.177:0/3446046651 shutdown_connections 2023-11-27T17:48:25.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f00482fb700 1 --2- 172.21.15.177:0/3446046651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 0x7f0040071b90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f00482fb700 1 --2- 172.21.15.177:0/3446046651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400720d0 0x7f00400cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f00482fb700 1 -- 172.21.15.177:0/3446046651 >> 172.21.15.177:0/3446046651 conn(0x7f00400b15d0 msgr2=0x7f00400b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f00482fb700 1 -- 172.21.15.177:0/3446046651 shutdown_connections 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f00482fb700 1 -- 172.21.15.177:0/3446046651 wait complete. 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.104+0000 7f00482fb700 1 Processor -- start 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.104+0000 7f00482fb700 1 -- start start 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.105+0000 7f00482fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00400720d0 0x7f004006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.105+0000 7f00482fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400cd210 0x7f0040149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.105+0000 7f00482fb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 0x7f004014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.105+0000 7f00482fb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004015b350 con 0x7f0040162540 2023-11-27T17:48:25.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.105+0000 7f00482fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0040164b60 con 0x7f00400720d0 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.105+0000 7f00482fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0040164e40 con 0x7f00400cd210 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046097700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00400720d0 0x7f004006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046898700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 0x7f004014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046097700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00400720d0 0x7f004006ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:59840/0 (socket says 172.21.15.177:59840) 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046097700 1 -- 172.21.15.177:0/2063101190 learned_addr learned my addr 172.21.15.177:0/2063101190 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046898700 1 -- 172.21.15.177:0/2063101190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400cd210 msgr2=0x7f0040149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046898700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400cd210 0x7f0040149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046898700 1 -- 172.21.15.177:0/2063101190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00400720d0 msgr2=0x7f004006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046898700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00400720d0 0x7f004006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046898700 1 -- 172.21.15.177:0/2063101190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009a70 con 0x7f0040162540 2023-11-27T17:48:25.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f0046898700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 0x7f004014bc70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f003c007fd0 tx=0x7f003c00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f4755bfd700 1 -- 172.21.15.177:0/4196325397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500b5cf0 msgr2=0x7f47500cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f4755bfd700 1 --2- 172.21.15.177:0/4196325397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500b5cf0 0x7f47500cb330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f47500cca40 tx=0x7f4740009b20 comp rx=0 tx=0).stop 2023-11-27T17:48:25.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f4755bfd700 1 -- 172.21.15.177:0/4196325397 shutdown_connections 2023-11-27T17:48:25.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f4755bfd700 1 --2- 172.21.15.177:0/4196325397 >> v2:172.21.15.178:3300/0 conn(0x7f47500cf280 0x7f47500cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f4755bfd700 1 --2- 172.21.15.177:0/4196325397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500b5cf0 0x7f47500cb330 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f47500cca40 tx=0x7f4740009b20 comp rx=0 tx=0).stop 2023-11-27T17:48:25.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.102+0000 7f4755bfd700 1 -- 172.21.15.177:0/4196325397 >> 172.21.15.177:0/4196325397 conn(0x7f47500b51d0 msgr2=0x7f47500b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.103+0000 7f4755bfd700 1 -- 172.21.15.177:0/4196325397 shutdown_connections 2023-11-27T17:48:25.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.103+0000 7f4755bfd700 1 -- 172.21.15.177:0/4196325397 wait complete. 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.105+0000 7f4755bfd700 1 Processor -- start 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.106+0000 7f4755bfd700 1 -- start start 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f4755bfd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47500704b0 0x7f4750146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f4755bfd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47500cf280 0x7f4750146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f4755bfd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4750145e20 0x7f4750148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f4755bfd700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475006f090 con 0x7f4750145e20 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f4755bfd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475006d800 con 0x7f47500704b0 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f4755bfd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475006e760 con 0x7f47500cf280 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47500cf280 0x7f4750146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47500cf280 0x7f4750146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39292/0 (socket says 172.21.15.177:39292) 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474effd700 1 -- 172.21.15.177:0/791497520 learned_addr learned my addr 172.21.15.177:0/791497520 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474f7fe700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47500704b0 0x7f4750146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474ffff700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4750145e20 0x7f4750148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474ffff700 1 -- 172.21.15.177:0/791497520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47500cf280 msgr2=0x7f4750146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474ffff700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47500cf280 0x7f4750146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474ffff700 1 -- 172.21.15.177:0/791497520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47500704b0 msgr2=0x7f4750146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474ffff700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47500704b0 0x7f4750146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474ffff700 1 -- 172.21.15.177:0/791497520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400094a0 con 0x7f4750145e20 2023-11-27T17:48:25.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.117+0000 7fe6781bc700 1 Processor -- start 2023-11-27T17:48:25.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.117+0000 7f0036ffd700 1 -- 172.21.15.177:0/2063101190 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c005d70 con 0x7f0040162540 2023-11-27T17:48:25.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.107+0000 7f474ffff700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4750145e20 0x7f4750148580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f474800be20 tx=0x7f474800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.108+0000 7f4737fff700 1 -- 172.21.15.177:0/791497520 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474800cd10 con 0x7f4750145e20 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.108+0000 7f4737fff700 1 -- 172.21.15.177:0/791497520 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4748014440 con 0x7f4750145e20 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.108+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475006ea40 con 0x7f4750145e20 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.108+0000 7f4737fff700 1 -- 172.21.15.177:0/791497520 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47480147f0 con 0x7f4750145e20 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.108+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475006d320 con 0x7f4750145e20 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.110+0000 7f4737fff700 1 -- 172.21.15.177:0/791497520 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4748006d50 con 0x7f4750145e20 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.110+0000 7f4737fff700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473c06b250 0x7f473c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.110+0000 7f4737fff700 1 -- 172.21.15.177:0/791497520 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4748089730 con 0x7f4750145e20 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.111+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475006d5a0 con 0x7f4750145e20 2023-11-27T17:48:25.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.112+0000 7f474f7fe700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473c06b250 0x7f473c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.112+0000 7f474f7fe700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473c06b250 0x7f473c06d710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47500737d0 tx=0x7f4740008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.117+0000 7f4737fff700 1 -- 172.21.15.177:0/791497520 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4748054510 con 0x7f4750145e20 2023-11-27T17:48:25.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.117+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040165120 con 0x7f0040162540 2023-11-27T17:48:25.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.117+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004006f490 con 0x7f0040162540 2023-11-27T17:48:25.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.117+0000 7fe6781bc700 1 -- start start 2023-11-27T17:48:25.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.118+0000 7fe6781bc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe6700cb330 0x7fe6700cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.119+0000 7fe6781bc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6700cf7c0 0x7fe67015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.119+0000 7fe6781bc700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700cedf0 con 0x7fe67015d570 2023-11-27T17:48:25.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.119+0000 7fe6781bc700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700ce500 con 0x7fe6700cb330 2023-11-27T17:48:25.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.119+0000 7fe6781bc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700cb7b0 con 0x7fe6700cf7c0 2023-11-27T17:48:25.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.119+0000 7fe675f58700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe67015d570 0x7fe6700704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46150/0 (socket says 172.21.15.177:46150) 2023-11-27T17:48:25.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.119+0000 7fe675f58700 1 -- 172.21.15.177:0/3481986855 learned_addr learned my addr 172.21.15.177:0/3481986855 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:25.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.119+0000 7fe675757700 1 --2- 172.21.15.177:0/3481986855 >> v2:172.21.15.177:3300/0 conn(0x7fe6700cb330 0x7fe6700cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.120+0000 7fe675757700 1 -- 172.21.15.177:0/3481986855 >> v2:172.21.15.178:3300/0 conn(0x7fe6700cf7c0 msgr2=0x7fe67015dd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:48:25.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.120+0000 7fe675757700 1 --2- 172.21.15.177:0/3481986855 >> v2:172.21.15.178:3300/0 conn(0x7fe6700cf7c0 0x7fe67015dd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.120+0000 7fe675757700 1 -- 172.21.15.177:0/3481986855 >> v1:172.21.15.177:6789/0 conn(0x7fe67015d570 legacy=0x7fe6700704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.120+0000 7fe675757700 1 -- 172.21.15.177:0/3481986855 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700cba60 con 0x7fe6700cb330 2023-11-27T17:48:25.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.121+0000 7fe675757700 1 --2- 172.21.15.177:0/3481986855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe6700cf280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6700cca40 tx=0x7fe668009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33909bd3678afdd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.117+0000 7f0036ffd700 1 -- 172.21.15.177:0/2063101190 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c00ce50 con 0x7f0040162540 2023-11-27T17:48:25.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.121+0000 7f0036ffd700 1 -- 172.21.15.177:0/2063101190 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0072d0 con 0x7f0040162540 2023-11-27T17:48:25.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.121+0000 7f0036ffd700 1 -- 172.21.15.177:0/2063101190 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f003c007430 con 0x7f0040162540 2023-11-27T17:48:25.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.121+0000 7f0036ffd700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f002406b2a0 0x7f002406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.122+0000 7f0036ffd700 1 -- 172.21.15.177:0/2063101190 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f003c088bc0 con 0x7f0040162540 2023-11-27T17:48:25.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.123+0000 7f0046097700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f002406b2a0 0x7f002406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.124+0000 7f0046097700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f002406b2a0 0x7f002406d760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0038000f80 tx=0x7f003801d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.129+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00280052e0 con 0x7f0040162540 2023-11-27T17:48:25.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.125+0000 7fe674f56700 1 -- 172.21.15.177:0/3481986855 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668003a20 con 0x7fe6700cb330 2023-11-27T17:48:25.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.125+0000 7fe674f56700 1 -- 172.21.15.177:0/3481986855 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe668003b80 con 0x7fe6700cb330 2023-11-27T17:48:25.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.125+0000 7fe674f56700 1 -- 172.21.15.177:0/3481986855 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800c980 con 0x7fe6700cb330 2023-11-27T17:48:25.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.130+0000 7fe6781bc700 1 -- 172.21.15.177:0/3481986855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 msgr2=0x7fe6700cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.130+0000 7fe6781bc700 1 --2- 172.21.15.177:0/3481986855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe6700cf280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6700cca40 tx=0x7fe668009f60 comp rx=0 tx=0).stop 2023-11-27T17:48:25.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.130+0000 7fe6781bc700 1 -- 172.21.15.177:0/3481986855 shutdown_connections 2023-11-27T17:48:25.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.130+0000 7fe6781bc700 1 --2- 172.21.15.177:0/3481986855 >> v2:172.21.15.178:3300/0 conn(0x7fe6700cf7c0 0x7fe67015dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.130+0000 7fe6781bc700 1 --2- 172.21.15.177:0/3481986855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe6700cf280 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.130+0000 7fe6781bc700 1 -- 172.21.15.177:0/3481986855 >> 172.21.15.177:0/3481986855 conn(0x7fe6700b51d0 msgr2=0x7fe6700b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.134+0000 7f0036ffd700 1 -- 172.21.15.177:0/2063101190 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f003c017080 con 0x7f0040162540 2023-11-27T17:48:25.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.135+0000 7fe6781bc700 1 -- 172.21.15.177:0/3481986855 shutdown_connections 2023-11-27T17:48:25.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.135+0000 7fe6781bc700 1 -- 172.21.15.177:0/3481986855 wait complete. 2023-11-27T17:48:25.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.137+0000 7fe6781bc700 1 Processor -- start 2023-11-27T17:48:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.137+0000 7fe6781bc700 1 -- start start 2023-11-27T17:48:25.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.138+0000 7fe6781bc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe670149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.138+0000 7fe6781bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6700cf7c0 0x7fe670138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.138+0000 7fe6781bc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe67015d570 0x7fe670148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.138+0000 7fe6781bc700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701f8110 con 0x7fe6700cb330 2023-11-27T17:48:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.138+0000 7fe6781bc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701399c0 con 0x7fe67015d570 2023-11-27T17:48:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.138+0000 7fe6781bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe670139ca0 con 0x7fe6700cf7c0 2023-11-27T17:48:25.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.138+0000 7fe675f58700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe670149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.139+0000 7fe675f58700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe670149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51838/0 (socket says 172.21.15.177:51838) 2023-11-27T17:48:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.139+0000 7fe675f58700 1 -- 172.21.15.177:0/4021530208 learned_addr learned my addr 172.21.15.177:0/4021530208 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.139+0000 7fe675f58700 1 -- 172.21.15.177:0/4021530208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6700cf7c0 msgr2=0x7fe670138fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:48:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.139+0000 7fe675f58700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6700cf7c0 0x7fe670138fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.139+0000 7fe675f58700 1 -- 172.21.15.177:0/4021530208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe67015d570 msgr2=0x7fe670148300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T17:48:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.139+0000 7fe675f58700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe67015d570 0x7fe670148300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.139+0000 7fe675f58700 1 -- 172.21.15.177:0/4021530208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66800d040 con 0x7fe6700cb330 2023-11-27T17:48:25.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.139+0000 7fe675f58700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe670149500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00bdf0 tx=0x7fe66c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.146+0000 7fe6667fc700 1 -- 172.21.15.177:0/4021530208 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c006270 con 0x7fe6700cb330 2023-11-27T17:48:25.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.146+0000 7fe6667fc700 1 -- 172.21.15.177:0/4021530208 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c00f070 con 0x7fe6700cb330 2023-11-27T17:48:25.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.146+0000 7fe6667fc700 1 -- 172.21.15.177:0/4021530208 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0065d0 con 0x7fe6700cb330 2023-11-27T17:48:25.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.146+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe670139f80 con 0x7fe6700cb330 2023-11-27T17:48:25.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.146+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67013a540 con 0x7fe6700cb330 2023-11-27T17:48:25.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.150+0000 7fe6667fc700 1 -- 172.21.15.177:0/4021530208 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe66c011030 con 0x7fe6700cb330 2023-11-27T17:48:25.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.151+0000 7fe6667fc700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65406b320 0x7fe65406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.151+0000 7fe6667fc700 1 -- 172.21.15.177:0/4021530208 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe66c08a520 con 0x7fe6700cb330 2023-11-27T17:48:25.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.152+0000 7fe675757700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65406b320 0x7fe65406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.153+0000 7fe675757700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65406b320 0x7fe65406d7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe670071610 tx=0x7fe668012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.153+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6580052e0 con 0x7fe6700cb330 2023-11-27T17:48:25.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.163+0000 7fe6667fc700 1 -- 172.21.15.177:0/4021530208 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe66c0552c0 con 0x7fe6700cb330 2023-11-27T17:48:25.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.383+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd7a0005590 con 0x7fd7b4071930 2023-11-27T17:48:25.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.383+0000 7fd79b7fe700 1 -- 172.21.15.177:0/2416477169 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7ac02b020 con 0x7fd7b4071930 2023-11-27T17:48:25.388 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-27T17:48:25.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd79c06b910 msgr2=0x7fd79c06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd79c06b910 0x7fd79c06ddd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40ae860 tx=0x7fd7a4001490 comp rx=0 tx=0).stop 2023-11-27T17:48:25.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4071930 msgr2=0x7fd7b40cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4071930 0x7fd7b40cf150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac000f80 tx=0x7fd7ac004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 shutdown_connections 2023-11-27T17:48:25.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd79c06b910 0x7fd79c06ddd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b4168860 0x7fd7b408a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b4071930 0x7fd7b40cf150 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 --2- 172.21.15.177:0/2416477169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b40cb0a0 0x7fd7b406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.387+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 >> 172.21.15.177:0/2416477169 conn(0x7fd7b40b51d0 msgr2=0x7fd7b4167b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.388+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 shutdown_connections 2023-11-27T17:48:25.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.388+0000 7fd7b9367700 1 -- 172.21.15.177:0/2416477169 wait complete. 2023-11-27T17:48:25.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-11-27T17:48:25.409 DEBUG:teuthology.parallel:result is None 2023-11-27T17:48:25.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.420+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f15c4069400 con 0x7f15c415d570 2023-11-27T17:48:25.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.420+0000 7f15b9ffb700 1 -- 172.21.15.177:0/442869747 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15b4059160 con 0x7f15c415d570 2023-11-27T17:48:25.424 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:25.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.423+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6f80070910 con 0x7f6f8015d570 2023-11-27T17:48:25.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.424+0000 7f6f6effd700 1 -- 172.21.15.177:0/2995156989 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f80070910 con 0x7f6f8015d570 2023-11-27T17:48:25.430 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f15a806b320 msgr2=0x7f15a806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f15a806b320 0x7f15a806d7e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15c00012e0 tx=0x7f15c0001270 comp rx=0 tx=0).stop 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415d570 msgr2=0x7f15c40a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415d570 0x7f15c40a9450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f15c406c250 tx=0x7f15b4004750 comp rx=0 tx=0).stop 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 shutdown_connections 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f15a806b320 0x7f15a806d7e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15c415d570 0x7f15c40a9450 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40cb330 0x7f15c414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 --2- 172.21.15.177:0/442869747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40cf7c0 0x7f15c41552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 >> 172.21.15.177:0/442869747 conn(0x7f15c40b51d0 msgr2=0x7f15c4166160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 shutdown_connections 2023-11-27T17:48:25.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.428+0000 7f15cb8af700 1 -- 172.21.15.177:0/442869747 wait complete. 2023-11-27T17:48:25.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6f6006b320 msgr2=0x7f6f6006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6f6006b320 0x7f6f6006d7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f78000f80 tx=0x7f6f7800b040 comp rx=0 tx=0).stop 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8015d570 msgr2=0x7f6f8006eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8015d570 0x7f6f8006eb10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000c820 tx=0x7f6f7000cb30 comp rx=0 tx=0).stop 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 shutdown_connections 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6f6006b320 0x7f6f6006d7e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8015d570 0x7f6f8006eb10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f800704b0 0x7f6f801f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 --2- 172.21.15.177:0/2995156989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f800cf990 0x7f6f80152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 >> 172.21.15.177:0/2995156989 conn(0x7f6f800b51d0 msgr2=0x7f6f80158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 shutdown_connections 2023-11-27T17:48:25.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.432+0000 7f6f84ad7700 1 -- 172.21.15.177:0/2995156989 wait complete. 2023-11-27T17:48:25.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-11-27T17:48:25.446 DEBUG:teuthology.parallel:result is None 2023-11-27T17:48:25.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.446+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5bac0b0f60 con 0x7f5bac1626c0 2023-11-27T17:48:25.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.446+0000 7f5ba2ffd700 1 -- 172.21.15.177:0/178566532 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ba8015090 con 0x7f5bac1626c0 2023-11-27T17:48:25.448 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:25.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.449+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b9808d4c0 msgr2=0x7f5b9808f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.449+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b9808d4c0 0x7f5b9808f980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0b4810 tx=0x7f5b9c008030 comp rx=0 tx=0).stop 2023-11-27T17:48:25.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.449+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bac1626c0 msgr2=0x7f5bac0ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.449+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bac1626c0 0x7f5bac0ae6b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800b450 tx=0x7f5ba800b810 comp rx=0 tx=0).stop 2023-11-27T17:48:25.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.451+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 shutdown_connections 2023-11-27T17:48:25.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.451+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5b9808d4c0 0x7f5b9808f980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.451+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bac14f8d0 0x7f5bac14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.451+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bac0cb0a0 0x7f5bac161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.451+0000 7f5bb46d3700 1 --2- 172.21.15.177:0/178566532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bac1626c0 0x7f5bac0ae6b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.451+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 >> 172.21.15.177:0/178566532 conn(0x7f5bac0b51d0 msgr2=0x7f5bac164ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-11-27T17:48:25.454 DEBUG:teuthology.parallel:result is None 2023-11-27T17:48:25.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.455+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 shutdown_connections 2023-11-27T17:48:25.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.455+0000 7f5bb46d3700 1 -- 172.21.15.177:0/178566532 wait complete. 2023-11-27T17:48:25.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-11-27T17:48:25.474 DEBUG:teuthology.parallel:result is None 2023-11-27T17:48:25.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.477+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcac8069400 con 0x7fcac81622e0 2023-11-27T17:48:25.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.478+0000 7fcabe7fc700 1 -- 172.21.15.177:0/4077595215 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcac4015090 con 0x7fcac81622e0 2023-11-27T17:48:25.480 INFO:teuthology.orchestra.run.smithi177.stdout:55834574855 2023-11-27T17:48:25.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.480+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcaac06b2a0 msgr2=0x7fcaac06d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.480+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcaac06b2a0 0x7fcaac06d760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcab8001590 tx=0x7fcab8007a20 comp rx=0 tx=0).stop 2023-11-27T17:48:25.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.480+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81622e0 msgr2=0x7fcac81515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.480+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81622e0 0x7fcac81515f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcac400b530 tx=0x7fcac400b8f0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.481+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 shutdown_connections 2023-11-27T17:48:25.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.481+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcaac06b2a0 0x7fcaac06d760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.481+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcac81626c0 0x7fcac8152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.481+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcac80cb0a0 0x7fcac81338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.481+0000 7fcacfbf6700 1 --2- 172.21.15.177:0/4077595215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcac81622e0 0x7fcac81515f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.481+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 >> 172.21.15.177:0/4077595215 conn(0x7fcac80b51d0 msgr2=0x7fcac80b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.481+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 shutdown_connections 2023-11-27T17:48:25.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.481+0000 7fcacfbf6700 1 -- 172.21.15.177:0/4077595215 wait complete. 2023-11-27T17:48:25.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-11-27T17:48:25.495 DEBUG:teuthology.parallel:result is None 2023-11-27T17:48:25.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.502+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0028005590 con 0x7f0040162540 2023-11-27T17:48:25.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.503+0000 7f0036ffd700 1 -- 172.21.15.177:0/2063101190 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f003c053ad0 con 0x7f0040162540 2023-11-27T17:48:25.505 INFO:teuthology.orchestra.run.smithi177.stdout:55834574855 2023-11-27T17:48:25.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f002406b2a0 msgr2=0x7f002406d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f002406b2a0 0x7f002406d760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0038000f80 tx=0x7f003801d040 comp rx=0 tx=0).stop 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 msgr2=0x7f004014bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 0x7f004014bc70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f003c007fd0 tx=0x7f003c00c6e0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 shutdown_connections 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f002406b2a0 0x7f002406d760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040162540 0x7f004014bc70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00400720d0 0x7f004006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 --2- 172.21.15.177:0/2063101190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00400cd210 0x7f0040149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 >> 172.21.15.177:0/2063101190 conn(0x7f00400b15d0 msgr2=0x7f00400aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 shutdown_connections 2023-11-27T17:48:25.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.505+0000 7f00482fb700 1 -- 172.21.15.177:0/2063101190 wait complete. 2023-11-27T17:48:25.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-11-27T17:48:25.519 DEBUG:teuthology.parallel:result is None 2023-11-27T17:48:25.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.518+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4750069400 con 0x7f4750145e20 2023-11-27T17:48:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.519+0000 7f4737fff700 1 -- 172.21.15.177:0/791497520 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4748019020 con 0x7f4750145e20 2023-11-27T17:48:25.521 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473c06b250 msgr2=0x7f473c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473c06b250 0x7f473c06d710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47500737d0 tx=0x7f4740008030 comp rx=0 tx=0).stop 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4750145e20 msgr2=0x7f4750148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4750145e20 0x7f4750148580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f474800be20 tx=0x7f474800bf00 comp rx=0 tx=0).stop 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 shutdown_connections 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f473c06b250 0x7f473c06d710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4750145e20 0x7f4750148580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47500704b0 0x7f4750146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 --2- 172.21.15.177:0/791497520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47500cf280 0x7f4750146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 >> 172.21.15.177:0/791497520 conn(0x7f47500b51d0 msgr2=0x7f47500b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 shutdown_connections 2023-11-27T17:48:25.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.522+0000 7f4755bfd700 1 -- 172.21.15.177:0/791497520 wait complete. 2023-11-27T17:48:25.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-11-27T17:48:25.541 DEBUG:teuthology.parallel:result is None 2023-11-27T17:48:25.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.551+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe658005590 con 0x7fe6700cb330 2023-11-27T17:48:25.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.551+0000 7fe6667fc700 1 -- 172.21.15.177:0/4021530208 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe66c0588e0 con 0x7fe6700cb330 2023-11-27T17:48:25.553 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-11-27T17:48:25.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.553+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65406b320 msgr2=0x7fe65406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.553+0000 7fe6781bc700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65406b320 0x7fe65406d7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe670071610 tx=0x7fe668012000 comp rx=0 tx=0).stop 2023-11-27T17:48:25.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.553+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 msgr2=0x7fe670149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.553+0000 7fe6781bc700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe670149500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00bdf0 tx=0x7fe66c009f60 comp rx=0 tx=0).stop 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.554+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 shutdown_connections 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.554+0000 7fe6781bc700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe65406b320 0x7fe65406d7e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.554+0000 7fe6781bc700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe67015d570 0x7fe670148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.554+0000 7fe6781bc700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6700cb330 0x7fe670149500 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.554+0000 7fe6781bc700 1 --2- 172.21.15.177:0/4021530208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6700cf7c0 0x7fe670138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.554+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 >> 172.21.15.177:0/4021530208 conn(0x7fe6700b51d0 msgr2=0x7fe6700af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.554+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 shutdown_connections 2023-11-27T17:48:25.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.554+0000 7fe6781bc700 1 -- 172.21.15.177:0/4021530208 wait complete. 2023-11-27T17:48:25.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-11-27T17:48:25.568 DEBUG:teuthology.parallel:result is None 2023-11-27T17:48:25.568 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T17:48:25.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:48:25.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.726+0000 7f9cf2da3700 1 Processor -- start 2023-11-27T17:48:25.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.726+0000 7f9cf2da3700 1 -- start start 2023-11-27T17:48:25.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9cf2da3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0b64f0 0x7f9cec0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9cf2da3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec06e200 con 0x7f9cec070a30 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9cf2da3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec06e4e0 con 0x7f9cec147810 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9cf2da3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec070ec0 con 0x7f9cec0b64f0 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9cf1340700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9cec070a30 0x7f9cec15f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46166/0 (socket says 172.21.15.177:46166) 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9cf1340700 1 -- 172.21.15.177:0/3257196575 learned_addr learned my addr 172.21.15.177:0/3257196575 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9cebfff700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0b64f0 0x7f9cec0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368478257 0 0) 0x7f9cec06e200 con 0x7f9cec070a30 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cdc0035b0 con 0x7f9cec070a30 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595821640 0 0) 0x7f9cdc0035b0 con 0x7f9cec070a30 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0b64f0 msgr2=0x7f9cec0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0b64f0 0x7f9cec0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 >> v1:172.21.15.178:6789/0 conn(0x7f9cec147810 legacy=0x7f9cec06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec15e970 con 0x7f9cec070a30 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f9ce40019f0 con 0x7f9cec070a30 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.727+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 >> v1:172.21.15.177:6789/0 conn(0x7f9cec070a30 legacy=0x7f9cec15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cdc003a30 0x7f9cdc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0b64f0 0x7f9cdc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cdc004d90 0x7f9cdc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec070ec0 con 0x7f9cdc004d90 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc00bba0 con 0x7f9cdc003a30 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc00bd30 con 0x7f9cec0b64f0 2023-11-27T17:48:25.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cf1340700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cdc004d90 0x7f9cdc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cf0b3f700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cdc003a30 0x7f9cdc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cebfff700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0b64f0 0x7f9cdc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cf1340700 1 -- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0b64f0 msgr2=0x7f9cdc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cf1340700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0b64f0 0x7f9cdc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cf1340700 1 -- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cdc003a30 msgr2=0x7f9cdc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cf1340700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cdc003a30 0x7f9cdc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cf1340700 1 -- 172.21.15.177:0/3257196575 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc0035b0 con 0x7f9cdc004d90 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9cf1340700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cdc004d90 0x7f9cdc005210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400a860 tx=0x7f9cdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad291df2184fd47 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4012600 con 0x7f9cdc004d90 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4012780 con 0x7f9cdc004d90 2023-11-27T17:48:25.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.728+0000 7f9ceb7fe700 1 -- 172.21.15.177:0/3257196575 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4012b30 con 0x7f9cdc004d90 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.729+0000 7f9cf2da3700 1 -- 172.21.15.177:0/3257196575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cdc004d90 msgr2=0x7f9cdc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.729+0000 7f9cf2da3700 1 --2- 172.21.15.177:0/3257196575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cdc004d90 0x7f9cdc005210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400a860 tx=0x7f9cdc005880 comp rx=0 tx=0).stop 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.729+0000 7f9cf1340700 1 -- 172.21.15.177:0/3257196575 reap_dead start 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.729+0000 7f9cf2da3700 1 -- 172.21.15.177:0/3257196575 shutdown_connections 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.729+0000 7f9cf2da3700 1 -- 172.21.15.177:0/3257196575 >> 172.21.15.177:0/3257196575 conn(0x7f9cec0b2130 msgr2=0x7f9cec0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.729+0000 7f9cf2da3700 1 -- 172.21.15.177:0/3257196575 shutdown_connections 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.729+0000 7f9cf2da3700 1 -- 172.21.15.177:0/3257196575 wait complete. 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.730+0000 7f9cf2da3700 1 Processor -- start 2023-11-27T17:48:25.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.730+0000 7f9cf2da3700 1 -- start start 2023-11-27T17:48:25.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf2da3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec15db60 0x7f9cec0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf2da3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cec15df40 0x7f9cec160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf2da3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0c9c90 0x7f9cec1610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf2da3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0cc350 con 0x7f9cec15db60 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf2da3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0cae50 con 0x7f9cec15df40 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf2da3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0ca1d0 con 0x7f9cec0c9c90 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec15db60 0x7f9cec0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec15db60 0x7f9cec0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51856/0 (socket says 172.21.15.177:51856) 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 -- 172.21.15.177:0/4186262723 learned_addr learned my addr 172.21.15.177:0/4186262723 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf1340700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0c9c90 0x7f9cec1610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cebfff700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cec15df40 0x7f9cec160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 -- 172.21.15.177:0/4186262723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0c9c90 msgr2=0x7f9cec1610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0c9c90 0x7f9cec1610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 -- 172.21.15.177:0/4186262723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cec15df40 msgr2=0x7f9cec160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cec15df40 0x7f9cec160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 -- 172.21.15.177:0/4186262723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0ca4b0 con 0x7f9cec15db60 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf0b3f700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec15db60 0x7f9cec0c9750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000f770 tx=0x7f9ce000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9ce97fa700 1 -- 172.21.15.177:0/4186262723 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00052e0 con 0x7f9cec15db60 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9ce97fa700 1 -- 172.21.15.177:0/4186262723 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce0005460 con 0x7f9cec15db60 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9ce97fa700 1 -- 172.21.15.177:0/4186262723 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00038c0 con 0x7f9cec15db60 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.731+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec0ca790 con 0x7f9cec15db60 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.732+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec0cb850 con 0x7f9cec15db60 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.732+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec073aa0 con 0x7f9cec15db60 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.733+0000 7f9ce97fa700 1 -- 172.21.15.177:0/4186262723 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9ce0003a20 con 0x7f9cec15db60 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.733+0000 7f9ce97fa700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9cd006b250 0x7f9cd006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:25.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.733+0000 7f9cebfff700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9cd006b250 0x7f9cd006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:25.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.733+0000 7f9ce97fa700 1 -- 172.21.15.177:0/4186262723 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ce00898f0 con 0x7f9cec15db60 2023-11-27T17:48:25.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.734+0000 7f9cebfff700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9cd006b250 0x7f9cd006d710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0cb530 tx=0x7f9cd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:25.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.738+0000 7f9ce97fa700 1 -- 172.21.15.177:0/4186262723 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9ce0054620 con 0x7f9cec15db60 2023-11-27T17:48:25.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.924+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cec0b1d70 con 0x7f9cd006b250 2023-11-27T17:48:25.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.931+0000 7f9ce97fa700 1 -- 172.21.15.177:0/4186262723 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264612 (secure 0 0 0) 0x7f9cec0b1d70 con 0x7f9cd006b250 2023-11-27T17:48:25.937 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:25.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.934+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9cd006b250 msgr2=0x7f9cd006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.934+0000 7f9cf2da3700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9cd006b250 0x7f9cd006d710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0cb530 tx=0x7f9cd8008040 comp rx=0 tx=0).stop 2023-11-27T17:48:25.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.934+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec15db60 msgr2=0x7f9cec0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:25.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.934+0000 7f9cf2da3700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec15db60 0x7f9cec0c9750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000f770 tx=0x7f9ce000fb30 comp rx=0 tx=0).stop 2023-11-27T17:48:25.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.935+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 shutdown_connections 2023-11-27T17:48:25.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.935+0000 7f9cf2da3700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9cd006b250 0x7f9cd006d710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.935+0000 7f9cf2da3700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cec0c9c90 0x7f9cec1610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.935+0000 7f9cf2da3700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec15db60 0x7f9cec0c9750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.935+0000 7f9cf2da3700 1 --2- 172.21.15.177:0/4186262723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cec15df40 0x7f9cec160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.935+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 >> 172.21.15.177:0/4186262723 conn(0x7f9cec0b2130 msgr2=0x7f9cec145cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.935+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 shutdown_connections 2023-11-27T17:48:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:25.935+0000 7f9cf2da3700 1 -- 172.21.15.177:0/4186262723 wait complete. 2023-11-27T17:48:25.940 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:48:25.949 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-27T17:48:24.621419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001683"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180718+0000","last_change":"2023-11-27T17:48:17.200652+0000","last_active":"2023-11-27T17:48:18.180718+0000","last_peered":"2023-11-27T17:48:18.180718+0000","last_clean":"2023-11-27T17:48:18.180718+0000","last_became_active":"2023-11-27T17:48:17.200367+0000","last_became_peered":"2023-11-27T17:48:17.200367+0000","last_unstale":"2023-11-27T17:48:18.180718+0000","last_undegraded":"2023-11-27T17:48:18.180718+0000","last_fullsized":"2023-11-27T17:48:18.180718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:48.898798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033497+0000","last_change":"2023-11-27T17:48:17.178900+0000","last_active":"2023-11-27T17:48:20.033497+0000","last_peered":"2023-11-27T17:48:20.033497+0000","last_clean":"2023-11-27T17:48:20.033497+0000","last_became_active":"2023-11-27T17:48:17.178688+0000","last_became_peered":"2023-11-27T17:48:17.178688+0000","last_unstale":"2023-11-27T17:48:20.033497+0000","last_undegraded":"2023-11-27T17:48:20.033497+0000","last_fullsized":"2023-11-27T17:48:20.033497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349059+0000","last_change":"2023-11-27T17:48:17.183900+0000","last_active":"2023-11-27T17:48:19.349059+0000","last_peered":"2023-11-27T17:48:19.349059+0000","last_clean":"2023-11-27T17:48:19.349059+0000","last_became_active":"2023-11-27T17:48:17.183057+0000","last_became_peered":"2023-11-27T17:48:17.183057+0000","last_unstale":"2023-11-27T17:48:19.349059+0000","last_undegraded":"2023-11-27T17:48:19.349059+0000","last_fullsized":"2023-11-27T17:48:19.349059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:35.744910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450557+0000","last_change":"2023-11-27T17:48:17.194895+0000","last_active":"2023-11-27T17:48:20.450557+0000","last_peered":"2023-11-27T17:48:20.450557+0000","last_clean":"2023-11-27T17:48:20.450557+0000","last_became_active":"2023-11-27T17:48:17.194569+0000","last_became_peered":"2023-11-27T17:48:17.194569+0000","last_unstale":"2023-11-27T17:48:20.450557+0000","last_undegraded":"2023-11-27T17:48:20.450557+0000","last_fullsized":"2023-11-27T17:48:20.450557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:16.621575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180037+0000","last_change":"2023-11-27T17:48:17.190418+0000","last_active":"2023-11-27T17:48:18.180037+0000","last_peered":"2023-11-27T17:48:18.180037+0000","last_clean":"2023-11-27T17:48:18.180037+0000","last_became_active":"2023-11-27T17:48:17.190089+0000","last_became_peered":"2023-11-27T17:48:17.190089+0000","last_unstale":"2023-11-27T17:48:18.180037+0000","last_undegraded":"2023-11-27T17:48:18.180037+0000","last_fullsized":"2023-11-27T17:48:18.180037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450001+0000","last_change":"2023-11-27T17:48:17.183458+0000","last_active":"2023-11-27T17:48:20.450001+0000","last_peered":"2023-11-27T17:48:20.450001+0000","last_clean":"2023-11-27T17:48:20.450001+0000","last_became_active":"2023-11-27T17:48:17.183168+0000","last_became_peered":"2023-11-27T17:48:17.183168+0000","last_unstale":"2023-11-27T17:48:20.450001+0000","last_undegraded":"2023-11-27T17:48:20.450001+0000","last_fullsized":"2023-11-27T17:48:20.450001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180103+0000","last_change":"2023-11-27T17:48:17.185791+0000","last_active":"2023-11-27T17:48:18.180103+0000","last_peered":"2023-11-27T17:48:18.180103+0000","last_clean":"2023-11-27T17:48:18.180103+0000","last_became_active":"2023-11-27T17:48:17.185040+0000","last_became_peered":"2023-11-27T17:48:17.185040+0000","last_unstale":"2023-11-27T17:48:18.180103+0000","last_undegraded":"2023-11-27T17:48:18.180103+0000","last_fullsized":"2023-11-27T17:48:18.180103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026403+0000","last_change":"2023-11-27T17:48:17.189241+0000","last_active":"2023-11-27T17:48:19.026403+0000","last_peered":"2023-11-27T17:48:19.026403+0000","last_clean":"2023-11-27T17:48:19.026403+0000","last_became_active":"2023-11-27T17:48:17.188950+0000","last_became_peered":"2023-11-27T17:48:17.188950+0000","last_unstale":"2023-11-27T17:48:19.026403+0000","last_undegraded":"2023-11-27T17:48:19.026403+0000","last_fullsized":"2023-11-27T17:48:19.026403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180691+0000","last_change":"2023-11-27T17:48:17.196341+0000","last_active":"2023-11-27T17:48:18.180691+0000","last_peered":"2023-11-27T17:48:18.180691+0000","last_clean":"2023-11-27T17:48:18.180691+0000","last_became_active":"2023-11-27T17:48:17.195932+0000","last_became_peered":"2023-11-27T17:48:17.195932+0000","last_unstale":"2023-11-27T17:48:18.180691+0000","last_undegraded":"2023-11-27T17:48:18.180691+0000","last_fullsized":"2023-11-27T17:48:18.180691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:12:54.004348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.036232+0000","last_change":"2023-11-27T17:48:17.182144+0000","last_active":"2023-11-27T17:48:20.036232+0000","last_peered":"2023-11-27T17:48:20.036232+0000","last_clean":"2023-11-27T17:48:20.036232+0000","last_became_active":"2023-11-27T17:48:17.181882+0000","last_became_peered":"2023-11-27T17:48:17.181882+0000","last_unstale":"2023-11-27T17:48:20.036232+0000","last_undegraded":"2023-11-27T17:48:20.036232+0000","last_fullsized":"2023-11-27T17:48:20.036232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035948+0000","last_change":"2023-11-27T17:48:17.182351+0000","last_active":"2023-11-27T17:48:20.035948+0000","last_peered":"2023-11-27T17:48:20.035948+0000","last_clean":"2023-11-27T17:48:20.035948+0000","last_became_active":"2023-11-27T17:48:17.182036+0000","last_became_peered":"2023-11-27T17:48:17.182036+0000","last_unstale":"2023-11-27T17:48:20.035948+0000","last_undegraded":"2023-11-27T17:48:20.035948+0000","last_fullsized":"2023-11-27T17:48:20.035948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181409+0000","last_change":"2023-11-27T17:48:17.179857+0000","last_active":"2023-11-27T17:48:18.181409+0000","last_peered":"2023-11-27T17:48:18.181409+0000","last_clean":"2023-11-27T17:48:18.181409+0000","last_became_active":"2023-11-27T17:48:17.179396+0000","last_became_peered":"2023-11-27T17:48:17.179396+0000","last_unstale":"2023-11-27T17:48:18.181409+0000","last_undegraded":"2023-11-27T17:48:18.181409+0000","last_fullsized":"2023-11-27T17:48:18.181409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026911+0000","last_change":"2023-11-27T17:48:17.201660+0000","last_active":"2023-11-27T17:48:19.026911+0000","last_peered":"2023-11-27T17:48:19.026911+0000","last_clean":"2023-11-27T17:48:19.026911+0000","last_became_active":"2023-11-27T17:48:17.201412+0000","last_became_peered":"2023-11-27T17:48:17.201412+0000","last_unstale":"2023-11-27T17:48:19.026911+0000","last_undegraded":"2023-11-27T17:48:19.026911+0000","last_fullsized":"2023-11-27T17:48:19.026911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349083+0000","last_change":"2023-11-27T17:48:17.179417+0000","last_active":"2023-11-27T17:48:19.349083+0000","last_peered":"2023-11-27T17:48:19.349083+0000","last_clean":"2023-11-27T17:48:19.349083+0000","last_became_active":"2023-11-27T17:48:17.178865+0000","last_became_peered":"2023-11-27T17:48:17.178865+0000","last_unstale":"2023-11-27T17:48:19.349083+0000","last_undegraded":"2023-11-27T17:48:19.349083+0000","last_fullsized":"2023-11-27T17:48:19.349083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033117+0000","last_change":"2023-11-27T17:48:17.171870+0000","last_active":"2023-11-27T17:48:20.033117+0000","last_peered":"2023-11-27T17:48:20.033117+0000","last_clean":"2023-11-27T17:48:20.033117+0000","last_became_active":"2023-11-27T17:48:17.171444+0000","last_became_peered":"2023-11-27T17:48:17.171444+0000","last_unstale":"2023-11-27T17:48:20.033117+0000","last_undegraded":"2023-11-27T17:48:20.033117+0000","last_fullsized":"2023-11-27T17:48:20.033117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.449917+0000","last_change":"2023-11-27T17:48:17.183467+0000","last_active":"2023-11-27T17:48:20.449917+0000","last_peered":"2023-11-27T17:48:20.449917+0000","last_clean":"2023-11-27T17:48:20.449917+0000","last_became_active":"2023-11-27T17:48:17.183203+0000","last_became_peered":"2023-11-27T17:48:17.183203+0000","last_unstale":"2023-11-27T17:48:20.449917+0000","last_undegraded":"2023-11-27T17:48:20.449917+0000","last_fullsized":"2023-11-27T17:48:20.449917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450557+0000","last_change":"2023-11-27T17:48:17.193109+0000","last_active":"2023-11-27T17:48:20.450557+0000","last_peered":"2023-11-27T17:48:20.450557+0000","last_clean":"2023-11-27T17:48:20.450557+0000","last_became_active":"2023-11-27T17:48:17.192836+0000","last_became_peered":"2023-11-27T17:48:17.192836+0000","last_unstale":"2023-11-27T17:48:20.450557+0000","last_undegraded":"2023-11-27T17:48:20.450557+0000","last_fullsized":"2023-11-27T17:48:20.450557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:30:58.565092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178610+0000","last_change":"2023-11-27T17:48:17.178927+0000","last_active":"2023-11-27T17:48:18.178610+0000","last_peered":"2023-11-27T17:48:18.178610+0000","last_clean":"2023-11-27T17:48:18.178610+0000","last_became_active":"2023-11-27T17:48:17.178668+0000","last_became_peered":"2023-11-27T17:48:17.178668+0000","last_unstale":"2023-11-27T17:48:18.178610+0000","last_undegraded":"2023-11-27T17:48:18.178610+0000","last_fullsized":"2023-11-27T17:48:18.178610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180294+0000","last_change":"2023-11-27T17:48:17.196844+0000","last_active":"2023-11-27T17:48:18.180294+0000","last_peered":"2023-11-27T17:48:18.180294+0000","last_clean":"2023-11-27T17:48:18.180294+0000","last_became_active":"2023-11-27T17:48:17.196588+0000","last_became_peered":"2023-11-27T17:48:17.196588+0000","last_unstale":"2023-11-27T17:48:18.180294+0000","last_undegraded":"2023-11-27T17:48:18.180294+0000","last_fullsized":"2023-11-27T17:48:18.180294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:03.113296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349135+0000","last_change":"2023-11-27T17:48:16.182157+0000","last_active":"2023-11-27T17:48:19.349135+0000","last_peered":"2023-11-27T17:48:19.349135+0000","last_clean":"2023-11-27T17:48:19.349135+0000","last_became_active":"2023-11-27T17:48:16.181789+0000","last_became_peered":"2023-11-27T17:48:16.181789+0000","last_unstale":"2023-11-27T17:48:19.349135+0000","last_undegraded":"2023-11-27T17:48:19.349135+0000","last_fullsized":"2023-11-27T17:48:19.349135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:55.133591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026801+0000","last_change":"2023-11-27T17:48:17.184258+0000","last_active":"2023-11-27T17:48:19.026801+0000","last_peered":"2023-11-27T17:48:19.026801+0000","last_clean":"2023-11-27T17:48:19.026801+0000","last_became_active":"2023-11-27T17:48:17.183985+0000","last_became_peered":"2023-11-27T17:48:17.183985+0000","last_unstale":"2023-11-27T17:48:19.026801+0000","last_undegraded":"2023-11-27T17:48:19.026801+0000","last_fullsized":"2023-11-27T17:48:19.026801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:51.585949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026822+0000","last_change":"2023-11-27T17:48:16.189592+0000","last_active":"2023-11-27T17:48:19.026822+0000","last_peered":"2023-11-27T17:48:19.026822+0000","last_clean":"2023-11-27T17:48:19.026822+0000","last_became_active":"2023-11-27T17:48:16.189296+0000","last_became_peered":"2023-11-27T17:48:16.189296+0000","last_unstale":"2023-11-27T17:48:19.026822+0000","last_undegraded":"2023-11-27T17:48:19.026822+0000","last_fullsized":"2023-11-27T17:48:19.026822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:44.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349044+0000","last_change":"2023-11-27T17:48:17.181599+0000","last_active":"2023-11-27T17:48:19.349044+0000","last_peered":"2023-11-27T17:48:19.349044+0000","last_clean":"2023-11-27T17:48:19.349044+0000","last_became_active":"2023-11-27T17:48:17.180736+0000","last_became_peered":"2023-11-27T17:48:17.180736+0000","last_unstale":"2023-11-27T17:48:19.349044+0000","last_undegraded":"2023-11-27T17:48:19.349044+0000","last_fullsized":"2023-11-27T17:48:19.349044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:48.392176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180482+0000","last_change":"2023-11-27T17:48:16.185981+0000","last_active":"2023-11-27T17:48:18.180482+0000","last_peered":"2023-11-27T17:48:18.180482+0000","last_clean":"2023-11-27T17:48:18.180482+0000","last_became_active":"2023-11-27T17:48:16.185648+0000","last_became_peered":"2023-11-27T17:48:16.185648+0000","last_unstale":"2023-11-27T17:48:18.180482+0000","last_undegraded":"2023-11-27T17:48:18.180482+0000","last_fullsized":"2023-11-27T17:48:18.180482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:27.226337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450222+0000","last_change":"2023-11-27T17:48:17.192478+0000","last_active":"2023-11-27T17:48:20.450222+0000","last_peered":"2023-11-27T17:48:20.450222+0000","last_clean":"2023-11-27T17:48:20.450222+0000","last_became_active":"2023-11-27T17:48:17.191295+0000","last_became_peered":"2023-11-27T17:48:17.191295+0000","last_unstale":"2023-11-27T17:48:20.450222+0000","last_undegraded":"2023-11-27T17:48:20.450222+0000","last_fullsized":"2023-11-27T17:48:20.450222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179959+0000","last_change":"2023-11-27T17:48:16.182525+0000","last_active":"2023-11-27T17:48:18.179959+0000","last_peered":"2023-11-27T17:48:18.179959+0000","last_clean":"2023-11-27T17:48:18.179959+0000","last_became_active":"2023-11-27T17:48:16.182208+0000","last_became_peered":"2023-11-27T17:48:16.182208+0000","last_unstale":"2023-11-27T17:48:18.179959+0000","last_undegraded":"2023-11-27T17:48:18.179959+0000","last_fullsized":"2023-11-27T17:48:18.179959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450336+0000","last_change":"2023-11-27T17:48:17.190913+0000","last_active":"2023-11-27T17:48:20.450336+0000","last_peered":"2023-11-27T17:48:20.450336+0000","last_clean":"2023-11-27T17:48:20.450336+0000","last_became_active":"2023-11-27T17:48:17.190591+0000","last_became_peered":"2023-11-27T17:48:17.190591+0000","last_unstale":"2023-11-27T17:48:20.450336+0000","last_undegraded":"2023-11-27T17:48:20.450336+0000","last_fullsized":"2023-11-27T17:48:20.450336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026931+0000","last_change":"2023-11-27T17:48:16.188491+0000","last_active":"2023-11-27T17:48:19.026931+0000","last_peered":"2023-11-27T17:48:19.026931+0000","last_clean":"2023-11-27T17:48:19.026931+0000","last_became_active":"2023-11-27T17:48:16.188301+0000","last_became_peered":"2023-11-27T17:48:16.188301+0000","last_unstale":"2023-11-27T17:48:19.026931+0000","last_undegraded":"2023-11-27T17:48:19.026931+0000","last_fullsized":"2023-11-27T17:48:19.026931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180319+0000","last_change":"2023-11-27T17:48:17.178657+0000","last_active":"2023-11-27T17:48:18.180319+0000","last_peered":"2023-11-27T17:48:18.180319+0000","last_clean":"2023-11-27T17:48:18.180319+0000","last_became_active":"2023-11-27T17:48:17.178374+0000","last_became_peered":"2023-11-27T17:48:17.178374+0000","last_unstale":"2023-11-27T17:48:18.180319+0000","last_undegraded":"2023-11-27T17:48:18.180319+0000","last_fullsized":"2023-11-27T17:48:18.180319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761727+0000","last_change":"2023-11-27T17:48:16.182101+0000","last_active":"2023-11-27T17:48:19.761727+0000","last_peered":"2023-11-27T17:48:19.761727+0000","last_clean":"2023-11-27T17:48:19.761727+0000","last_became_active":"2023-11-27T17:48:16.181767+0000","last_became_peered":"2023-11-27T17:48:16.181767+0000","last_unstale":"2023-11-27T17:48:19.761727+0000","last_undegraded":"2023-11-27T17:48:19.761727+0000","last_fullsized":"2023-11-27T17:48:19.761727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349273+0000","last_change":"2023-11-27T17:48:17.180782+0000","last_active":"2023-11-27T17:48:19.349273+0000","last_peered":"2023-11-27T17:48:19.349273+0000","last_clean":"2023-11-27T17:48:19.349273+0000","last_became_active":"2023-11-27T17:48:17.180463+0000","last_became_peered":"2023-11-27T17:48:17.180463+0000","last_unstale":"2023-11-27T17:48:19.349273+0000","last_undegraded":"2023-11-27T17:48:19.349273+0000","last_fullsized":"2023-11-27T17:48:19.349273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026513+0000","last_change":"2023-11-27T17:48:16.186582+0000","last_active":"2023-11-27T17:48:19.026513+0000","last_peered":"2023-11-27T17:48:19.026513+0000","last_clean":"2023-11-27T17:48:19.026513+0000","last_became_active":"2023-11-27T17:48:16.186290+0000","last_became_peered":"2023-11-27T17:48:16.186290+0000","last_unstale":"2023-11-27T17:48:19.026513+0000","last_undegraded":"2023-11-27T17:48:19.026513+0000","last_fullsized":"2023-11-27T17:48:19.026513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026554+0000","last_change":"2023-11-27T17:48:17.189577+0000","last_active":"2023-11-27T17:48:19.026554+0000","last_peered":"2023-11-27T17:48:19.026554+0000","last_clean":"2023-11-27T17:48:19.026554+0000","last_became_active":"2023-11-27T17:48:17.188679+0000","last_became_peered":"2023-11-27T17:48:17.188679+0000","last_unstale":"2023-11-27T17:48:19.026554+0000","last_undegraded":"2023-11-27T17:48:19.026554+0000","last_fullsized":"2023-11-27T17:48:19.026554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767411+0000","last_change":"2023-11-27T17:48:16.180119+0000","last_active":"2023-11-27T17:48:19.767411+0000","last_peered":"2023-11-27T17:48:19.767411+0000","last_clean":"2023-11-27T17:48:19.767411+0000","last_became_active":"2023-11-27T17:48:16.179826+0000","last_became_peered":"2023-11-27T17:48:16.179826+0000","last_unstale":"2023-11-27T17:48:19.767411+0000","last_undegraded":"2023-11-27T17:48:19.767411+0000","last_fullsized":"2023-11-27T17:48:19.767411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:47.385160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033271+0000","last_change":"2023-11-27T17:48:17.186966+0000","last_active":"2023-11-27T17:48:20.033271+0000","last_peered":"2023-11-27T17:48:20.033271+0000","last_clean":"2023-11-27T17:48:20.033271+0000","last_became_active":"2023-11-27T17:48:17.186650+0000","last_became_peered":"2023-11-27T17:48:17.186650+0000","last_unstale":"2023-11-27T17:48:20.033271+0000","last_undegraded":"2023-11-27T17:48:20.033271+0000","last_fullsized":"2023-11-27T17:48:20.033271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761840+0000","last_change":"2023-11-27T17:48:16.180021+0000","last_active":"2023-11-27T17:48:19.761840+0000","last_peered":"2023-11-27T17:48:19.761840+0000","last_clean":"2023-11-27T17:48:19.761840+0000","last_became_active":"2023-11-27T17:48:16.179702+0000","last_became_peered":"2023-11-27T17:48:16.179702+0000","last_unstale":"2023-11-27T17:48:19.761840+0000","last_undegraded":"2023-11-27T17:48:19.761840+0000","last_fullsized":"2023-11-27T17:48:19.761840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:55.133591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450455+0000","last_change":"2023-11-27T17:48:17.186938+0000","last_active":"2023-11-27T17:48:20.450455+0000","last_peered":"2023-11-27T17:48:20.450455+0000","last_clean":"2023-11-27T17:48:20.450455+0000","last_became_active":"2023-11-27T17:48:17.186711+0000","last_became_peered":"2023-11-27T17:48:17.186711+0000","last_unstale":"2023-11-27T17:48:20.450455+0000","last_undegraded":"2023-11-27T17:48:20.450455+0000","last_fullsized":"2023-11-27T17:48:20.450455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:36.527615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767587+0000","last_change":"2023-11-27T17:48:16.182253+0000","last_active":"2023-11-27T17:48:19.767587+0000","last_peered":"2023-11-27T17:48:19.767587+0000","last_clean":"2023-11-27T17:48:19.767587+0000","last_became_active":"2023-11-27T17:48:16.181399+0000","last_became_peered":"2023-11-27T17:48:16.181399+0000","last_unstale":"2023-11-27T17:48:19.767587+0000","last_undegraded":"2023-11-27T17:48:19.767587+0000","last_fullsized":"2023-11-27T17:48:19.767587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:44.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349254+0000","last_change":"2023-11-27T17:48:17.181837+0000","last_active":"2023-11-27T17:48:19.349254+0000","last_peered":"2023-11-27T17:48:19.349254+0000","last_clean":"2023-11-27T17:48:19.349254+0000","last_became_active":"2023-11-27T17:48:17.181271+0000","last_became_peered":"2023-11-27T17:48:17.181271+0000","last_unstale":"2023-11-27T17:48:19.349254+0000","last_undegraded":"2023-11-27T17:48:19.349254+0000","last_fullsized":"2023-11-27T17:48:19.349254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760122+0000","last_change":"2023-11-27T17:48:16.177994+0000","last_active":"2023-11-27T17:48:19.760122+0000","last_peered":"2023-11-27T17:48:19.760122+0000","last_clean":"2023-11-27T17:48:19.760122+0000","last_became_active":"2023-11-27T17:48:16.177727+0000","last_became_peered":"2023-11-27T17:48:16.177727+0000","last_unstale":"2023-11-27T17:48:19.760122+0000","last_undegraded":"2023-11-27T17:48:19.760122+0000","last_fullsized":"2023-11-27T17:48:19.760122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181325+0000","last_change":"2023-11-27T17:48:17.198710+0000","last_active":"2023-11-27T17:48:18.181325+0000","last_peered":"2023-11-27T17:48:18.181325+0000","last_clean":"2023-11-27T17:48:18.181325+0000","last_became_active":"2023-11-27T17:48:17.198406+0000","last_became_peered":"2023-11-27T17:48:17.198406+0000","last_unstale":"2023-11-27T17:48:18.181325+0000","last_undegraded":"2023-11-27T17:48:18.181325+0000","last_fullsized":"2023-11-27T17:48:18.181325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761754+0000","last_change":"2023-11-27T17:48:16.191881+0000","last_active":"2023-11-27T17:48:19.761754+0000","last_peered":"2023-11-27T17:48:19.761754+0000","last_clean":"2023-11-27T17:48:19.761754+0000","last_became_active":"2023-11-27T17:48:16.191647+0000","last_became_peered":"2023-11-27T17:48:16.191647+0000","last_unstale":"2023-11-27T17:48:19.761754+0000","last_undegraded":"2023-11-27T17:48:19.761754+0000","last_fullsized":"2023-11-27T17:48:19.761754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180322+0000","last_change":"2023-11-27T17:48:17.196086+0000","last_active":"2023-11-27T17:48:18.180322+0000","last_peered":"2023-11-27T17:48:18.180322+0000","last_clean":"2023-11-27T17:48:18.180322+0000","last_became_active":"2023-11-27T17:48:17.195707+0000","last_became_peered":"2023-11-27T17:48:17.195707+0000","last_unstale":"2023-11-27T17:48:18.180322+0000","last_undegraded":"2023-11-27T17:48:18.180322+0000","last_fullsized":"2023-11-27T17:48:18.180322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:36.527615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349199+0000","last_change":"2023-11-27T17:48:16.178114+0000","last_active":"2023-11-27T17:48:19.349199+0000","last_peered":"2023-11-27T17:48:19.349199+0000","last_clean":"2023-11-27T17:48:19.349199+0000","last_became_active":"2023-11-27T17:48:16.177834+0000","last_became_peered":"2023-11-27T17:48:16.177834+0000","last_unstale":"2023-11-27T17:48:19.349199+0000","last_undegraded":"2023-11-27T17:48:19.349199+0000","last_fullsized":"2023-11-27T17:48:19.349199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349059+0000","last_change":"2023-11-27T17:48:17.187918+0000","last_active":"2023-11-27T17:48:19.349059+0000","last_peered":"2023-11-27T17:48:19.349059+0000","last_clean":"2023-11-27T17:48:19.349059+0000","last_became_active":"2023-11-27T17:48:17.187649+0000","last_became_peered":"2023-11-27T17:48:17.187649+0000","last_unstale":"2023-11-27T17:48:19.349059+0000","last_undegraded":"2023-11-27T17:48:19.349059+0000","last_fullsized":"2023-11-27T17:48:19.349059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:40.893618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767495+0000","last_change":"2023-11-27T17:48:16.188695+0000","last_active":"2023-11-27T17:48:19.767495+0000","last_peered":"2023-11-27T17:48:19.767495+0000","last_clean":"2023-11-27T17:48:19.767495+0000","last_became_active":"2023-11-27T17:48:16.188414+0000","last_became_peered":"2023-11-27T17:48:16.188414+0000","last_unstale":"2023-11-27T17:48:19.767495+0000","last_undegraded":"2023-11-27T17:48:19.767495+0000","last_fullsized":"2023-11-27T17:48:19.767495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:17.074762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180262+0000","last_change":"2023-11-27T17:48:17.192145+0000","last_active":"2023-11-27T17:48:18.180262+0000","last_peered":"2023-11-27T17:48:18.180262+0000","last_clean":"2023-11-27T17:48:18.180262+0000","last_became_active":"2023-11-27T17:48:17.191826+0000","last_became_peered":"2023-11-27T17:48:17.191826+0000","last_unstale":"2023-11-27T17:48:18.180262+0000","last_undegraded":"2023-11-27T17:48:18.180262+0000","last_fullsized":"2023-11-27T17:48:18.180262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761699+0000","last_change":"2023-11-27T17:48:16.181257+0000","last_active":"2023-11-27T17:48:19.761699+0000","last_peered":"2023-11-27T17:48:19.761699+0000","last_clean":"2023-11-27T17:48:19.761699+0000","last_became_active":"2023-11-27T17:48:16.180955+0000","last_became_peered":"2023-11-27T17:48:16.180955+0000","last_unstale":"2023-11-27T17:48:19.761699+0000","last_undegraded":"2023-11-27T17:48:19.761699+0000","last_fullsized":"2023-11-27T17:48:19.761699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:57.362173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035737+0000","last_change":"2023-11-27T17:48:17.184780+0000","last_active":"2023-11-27T17:48:20.035737+0000","last_peered":"2023-11-27T17:48:20.035737+0000","last_clean":"2023-11-27T17:48:20.035737+0000","last_became_active":"2023-11-27T17:48:17.184496+0000","last_became_peered":"2023-11-27T17:48:17.184496+0000","last_unstale":"2023-11-27T17:48:20.035737+0000","last_undegraded":"2023-11-27T17:48:20.035737+0000","last_fullsized":"2023-11-27T17:48:20.035737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178470+0000","last_change":"2023-11-27T17:48:16.176239+0000","last_active":"2023-11-27T17:48:18.178470+0000","last_peered":"2023-11-27T17:48:18.178470+0000","last_clean":"2023-11-27T17:48:18.178470+0000","last_became_active":"2023-11-27T17:48:16.175935+0000","last_became_peered":"2023-11-27T17:48:16.175935+0000","last_unstale":"2023-11-27T17:48:18.178470+0000","last_undegraded":"2023-11-27T17:48:18.178470+0000","last_fullsized":"2023-11-27T17:48:18.178470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:31:17.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180890+0000","last_change":"2023-11-27T17:48:17.192173+0000","last_active":"2023-11-27T17:48:18.180890+0000","last_peered":"2023-11-27T17:48:18.180890+0000","last_clean":"2023-11-27T17:48:18.180890+0000","last_became_active":"2023-11-27T17:48:17.191886+0000","last_became_peered":"2023-11-27T17:48:17.191886+0000","last_unstale":"2023-11-27T17:48:18.180890+0000","last_undegraded":"2023-11-27T17:48:18.180890+0000","last_fullsized":"2023-11-27T17:48:18.180890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:59.251403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181348+0000","last_change":"2023-11-27T17:48:16.178737+0000","last_active":"2023-11-27T17:48:18.181348+0000","last_peered":"2023-11-27T17:48:18.181348+0000","last_clean":"2023-11-27T17:48:18.181348+0000","last_became_active":"2023-11-27T17:48:16.178440+0000","last_became_peered":"2023-11-27T17:48:16.178440+0000","last_unstale":"2023-11-27T17:48:18.181348+0000","last_undegraded":"2023-11-27T17:48:18.181348+0000","last_fullsized":"2023-11-27T17:48:18.181348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:46:28.658758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180221+0000","last_change":"2023-11-27T17:48:17.199254+0000","last_active":"2023-11-27T17:48:18.180221+0000","last_peered":"2023-11-27T17:48:18.180221+0000","last_clean":"2023-11-27T17:48:18.180221+0000","last_became_active":"2023-11-27T17:48:17.198787+0000","last_became_peered":"2023-11-27T17:48:17.198787+0000","last_unstale":"2023-11-27T17:48:18.180221+0000","last_undegraded":"2023-11-27T17:48:18.180221+0000","last_fullsized":"2023-11-27T17:48:18.180221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760086+0000","last_change":"2023-11-27T17:48:16.178655+0000","last_active":"2023-11-27T17:48:19.760086+0000","last_peered":"2023-11-27T17:48:19.760086+0000","last_clean":"2023-11-27T17:48:19.760086+0000","last_became_active":"2023-11-27T17:48:16.178370+0000","last_became_peered":"2023-11-27T17:48:16.178370+0000","last_unstale":"2023-11-27T17:48:19.760086+0000","last_undegraded":"2023-11-27T17:48:19.760086+0000","last_fullsized":"2023-11-27T17:48:19.760086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:34.737894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450421+0000","last_change":"2023-11-27T17:48:17.194445+0000","last_active":"2023-11-27T17:48:20.450421+0000","last_peered":"2023-11-27T17:48:20.450421+0000","last_clean":"2023-11-27T17:48:20.450421+0000","last_became_active":"2023-11-27T17:48:17.194134+0000","last_became_peered":"2023-11-27T17:48:17.194134+0000","last_unstale":"2023-11-27T17:48:20.450421+0000","last_undegraded":"2023-11-27T17:48:20.450421+0000","last_fullsized":"2023-11-27T17:48:20.450421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:03.113296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767484+0000","last_change":"2023-11-27T17:48:16.182152+0000","last_active":"2023-11-27T17:48:19.767484+0000","last_peered":"2023-11-27T17:48:19.767484+0000","last_clean":"2023-11-27T17:48:19.767484+0000","last_became_active":"2023-11-27T17:48:16.181769+0000","last_became_peered":"2023-11-27T17:48:16.181769+0000","last_unstale":"2023-11-27T17:48:19.767484+0000","last_undegraded":"2023-11-27T17:48:19.767484+0000","last_fullsized":"2023-11-27T17:48:19.767484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:48.481068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181152+0000","last_change":"2023-11-27T17:48:17.189104+0000","last_active":"2023-11-27T17:48:18.181152+0000","last_peered":"2023-11-27T17:48:18.181152+0000","last_clean":"2023-11-27T17:48:18.181152+0000","last_became_active":"2023-11-27T17:48:17.188416+0000","last_became_peered":"2023-11-27T17:48:17.188416+0000","last_unstale":"2023-11-27T17:48:18.181152+0000","last_undegraded":"2023-11-27T17:48:18.181152+0000","last_fullsized":"2023-11-27T17:48:18.181152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033151+0000","last_change":"2023-11-27T17:48:17.177845+0000","last_active":"2023-11-27T17:48:20.033151+0000","last_peered":"2023-11-27T17:48:20.033151+0000","last_clean":"2023-11-27T17:48:20.033151+0000","last_became_active":"2023-11-27T17:48:17.177556+0000","last_became_peered":"2023-11-27T17:48:17.177556+0000","last_unstale":"2023-11-27T17:48:20.033151+0000","last_undegraded":"2023-11-27T17:48:20.033151+0000","last_fullsized":"2023-11-27T17:48:20.033151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178490+0000","last_change":"2023-11-27T17:48:16.189008+0000","last_active":"2023-11-27T17:48:18.178490+0000","last_peered":"2023-11-27T17:48:18.178490+0000","last_clean":"2023-11-27T17:48:18.178490+0000","last_became_active":"2023-11-27T17:48:16.188800+0000","last_became_peered":"2023-11-27T17:48:16.188800+0000","last_unstale":"2023-11-27T17:48:18.178490+0000","last_undegraded":"2023-11-27T17:48:18.178490+0000","last_fullsized":"2023-11-27T17:48:18.178490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:00.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026519+0000","last_change":"2023-11-27T17:48:17.186845+0000","last_active":"2023-11-27T17:48:19.026519+0000","last_peered":"2023-11-27T17:48:19.026519+0000","last_clean":"2023-11-27T17:48:19.026519+0000","last_became_active":"2023-11-27T17:48:17.186071+0000","last_became_peered":"2023-11-27T17:48:17.186071+0000","last_unstale":"2023-11-27T17:48:19.026519+0000","last_undegraded":"2023-11-27T17:48:19.026519+0000","last_fullsized":"2023-11-27T17:48:19.026519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767510+0000","last_change":"2023-11-27T17:48:16.183104+0000","last_active":"2023-11-27T17:48:19.767510+0000","last_peered":"2023-11-27T17:48:19.767510+0000","last_clean":"2023-11-27T17:48:19.767510+0000","last_became_active":"2023-11-27T17:48:16.182831+0000","last_became_peered":"2023-11-27T17:48:16.182831+0000","last_unstale":"2023-11-27T17:48:19.767510+0000","last_undegraded":"2023-11-27T17:48:19.767510+0000","last_fullsized":"2023-11-27T17:48:19.767510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.177763+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:48:17.177763+0000","last_peered":"2023-11-27T17:48:17.177763+0000","last_clean":"2023-11-27T17:48:17.177763+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:48:17.177763+0000","last_undegraded":"2023-11-27T17:48:17.177763+0000","last_fullsized":"2023-11-27T17:48:17.177763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.348882+0000","last_change":"2023-11-27T17:48:17.179815+0000","last_active":"2023-11-27T17:48:19.348882+0000","last_peered":"2023-11-27T17:48:19.348882+0000","last_clean":"2023-11-27T17:48:19.348882+0000","last_became_active":"2023-11-27T17:48:17.179567+0000","last_became_peered":"2023-11-27T17:48:17.179567+0000","last_unstale":"2023-11-27T17:48:19.348882+0000","last_undegraded":"2023-11-27T17:48:19.348882+0000","last_fullsized":"2023-11-27T17:48:19.348882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:49.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179912+0000","last_change":"2023-11-27T17:48:16.178695+0000","last_active":"2023-11-27T17:48:18.179912+0000","last_peered":"2023-11-27T17:48:18.179912+0000","last_clean":"2023-11-27T17:48:18.179912+0000","last_became_active":"2023-11-27T17:48:16.178387+0000","last_became_peered":"2023-11-27T17:48:16.178387+0000","last_unstale":"2023-11-27T17:48:18.179912+0000","last_undegraded":"2023-11-27T17:48:18.179912+0000","last_fullsized":"2023-11-27T17:48:18.179912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180387+0000","last_change":"2023-11-27T17:48:16.187600+0000","last_active":"2023-11-27T17:48:18.180387+0000","last_peered":"2023-11-27T17:48:18.180387+0000","last_clean":"2023-11-27T17:48:18.180387+0000","last_became_active":"2023-11-27T17:48:16.187268+0000","last_became_peered":"2023-11-27T17:48:16.187268+0000","last_unstale":"2023-11-27T17:48:18.180387+0000","last_undegraded":"2023-11-27T17:48:18.180387+0000","last_fullsized":"2023-11-27T17:48:18.180387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:17.074762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033375+0000","last_change":"2023-11-27T17:48:17.175788+0000","last_active":"2023-11-27T17:48:20.033375+0000","last_peered":"2023-11-27T17:48:20.033375+0000","last_clean":"2023-11-27T17:48:20.033375+0000","last_became_active":"2023-11-27T17:48:17.175498+0000","last_became_peered":"2023-11-27T17:48:17.175498+0000","last_unstale":"2023-11-27T17:48:20.033375+0000","last_undegraded":"2023-11-27T17:48:20.033375+0000","last_fullsized":"2023-11-27T17:48:20.033375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033406+0000","last_change":"2023-11-27T17:48:16.182683+0000","last_active":"2023-11-27T17:48:20.033406+0000","last_peered":"2023-11-27T17:48:20.033406+0000","last_clean":"2023-11-27T17:48:20.033406+0000","last_became_active":"2023-11-27T17:48:16.182410+0000","last_became_peered":"2023-11-27T17:48:16.182410+0000","last_unstale":"2023-11-27T17:48:20.033406+0000","last_undegraded":"2023-11-27T17:48:20.033406+0000","last_fullsized":"2023-11-27T17:48:20.033406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026903+0000","last_change":"2023-11-27T17:48:17.193285+0000","last_active":"2023-11-27T17:48:19.026903+0000","last_peered":"2023-11-27T17:48:19.026903+0000","last_clean":"2023-11-27T17:48:19.026903+0000","last_became_active":"2023-11-27T17:48:17.192965+0000","last_became_peered":"2023-11-27T17:48:17.192965+0000","last_unstale":"2023-11-27T17:48:19.026903+0000","last_undegraded":"2023-11-27T17:48:19.026903+0000","last_fullsized":"2023-11-27T17:48:19.026903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761826+0000","last_change":"2023-11-27T17:48:16.182590+0000","last_active":"2023-11-27T17:48:19.761826+0000","last_peered":"2023-11-27T17:48:19.761826+0000","last_clean":"2023-11-27T17:48:19.761826+0000","last_became_active":"2023-11-27T17:48:16.182327+0000","last_became_peered":"2023-11-27T17:48:16.182327+0000","last_unstale":"2023-11-27T17:48:19.761826+0000","last_undegraded":"2023-11-27T17:48:19.761826+0000","last_fullsized":"2023-11-27T17:48:19.761826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349130+0000","last_change":"2023-11-27T17:48:17.182568+0000","last_active":"2023-11-27T17:48:19.349130+0000","last_peered":"2023-11-27T17:48:19.349130+0000","last_clean":"2023-11-27T17:48:19.349130+0000","last_became_active":"2023-11-27T17:48:17.182245+0000","last_became_peered":"2023-11-27T17:48:17.182245+0000","last_unstale":"2023-11-27T17:48:19.349130+0000","last_undegraded":"2023-11-27T17:48:19.349130+0000","last_fullsized":"2023-11-27T17:48:19.349130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179561+0000","last_change":"2023-11-27T17:48:16.188084+0000","last_active":"2023-11-27T17:48:18.179561+0000","last_peered":"2023-11-27T17:48:18.179561+0000","last_clean":"2023-11-27T17:48:18.179561+0000","last_became_active":"2023-11-27T17:48:16.187806+0000","last_became_peered":"2023-11-27T17:48:16.187806+0000","last_unstale":"2023-11-27T17:48:18.179561+0000","last_undegraded":"2023-11-27T17:48:18.179561+0000","last_fullsized":"2023-11-27T17:48:18.179561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:57.362173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180842+0000","last_change":"2023-11-27T17:48:17.175327+0000","last_active":"2023-11-27T17:48:18.180842+0000","last_peered":"2023-11-27T17:48:18.180842+0000","last_clean":"2023-11-27T17:48:18.180842+0000","last_became_active":"2023-11-27T17:48:17.173427+0000","last_became_peered":"2023-11-27T17:48:17.173427+0000","last_unstale":"2023-11-27T17:48:18.180842+0000","last_undegraded":"2023-11-27T17:48:18.180842+0000","last_fullsized":"2023-11-27T17:48:18.180842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:58.369189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760038+0000","last_change":"2023-11-27T17:48:16.181314+0000","last_active":"2023-11-27T17:48:19.760038+0000","last_peered":"2023-11-27T17:48:19.760038+0000","last_clean":"2023-11-27T17:48:19.760038+0000","last_became_active":"2023-11-27T17:48:16.181069+0000","last_became_peered":"2023-11-27T17:48:16.181069+0000","last_unstale":"2023-11-27T17:48:19.760038+0000","last_undegraded":"2023-11-27T17:48:19.760038+0000","last_fullsized":"2023-11-27T17:48:19.760038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:47.385160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026499+0000","last_change":"2023-11-27T17:48:17.189442+0000","last_active":"2023-11-27T17:48:19.026499+0000","last_peered":"2023-11-27T17:48:19.026499+0000","last_clean":"2023-11-27T17:48:19.026499+0000","last_became_active":"2023-11-27T17:48:17.188944+0000","last_became_peered":"2023-11-27T17:48:17.188944+0000","last_unstale":"2023-11-27T17:48:19.026499+0000","last_undegraded":"2023-11-27T17:48:19.026499+0000","last_fullsized":"2023-11-27T17:48:19.026499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760065+0000","last_change":"2023-11-27T17:48:16.188610+0000","last_active":"2023-11-27T17:48:19.760065+0000","last_peered":"2023-11-27T17:48:19.760065+0000","last_clean":"2023-11-27T17:48:19.760065+0000","last_became_active":"2023-11-27T17:48:16.188323+0000","last_became_peered":"2023-11-27T17:48:16.188323+0000","last_unstale":"2023-11-27T17:48:19.760065+0000","last_undegraded":"2023-11-27T17:48:19.760065+0000","last_fullsized":"2023-11-27T17:48:19.760065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:07:09.462696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.027010+0000","last_change":"2023-11-27T17:48:17.191974+0000","last_active":"2023-11-27T17:48:19.027010+0000","last_peered":"2023-11-27T17:48:19.027010+0000","last_clean":"2023-11-27T17:48:19.027010+0000","last_became_active":"2023-11-27T17:48:17.191681+0000","last_became_peered":"2023-11-27T17:48:17.191681+0000","last_unstale":"2023-11-27T17:48:19.027010+0000","last_undegraded":"2023-11-27T17:48:19.027010+0000","last_fullsized":"2023-11-27T17:48:19.027010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180165+0000","last_change":"2023-11-27T17:48:16.186595+0000","last_active":"2023-11-27T17:48:18.180165+0000","last_peered":"2023-11-27T17:48:18.180165+0000","last_clean":"2023-11-27T17:48:18.180165+0000","last_became_active":"2023-11-27T17:48:16.186241+0000","last_became_peered":"2023-11-27T17:48:16.186241+0000","last_unstale":"2023-11-27T17:48:18.180165+0000","last_undegraded":"2023-11-27T17:48:18.180165+0000","last_fullsized":"2023-11-27T17:48:18.180165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035901+0000","last_change":"2023-11-27T17:48:17.183997+0000","last_active":"2023-11-27T17:48:20.035901+0000","last_peered":"2023-11-27T17:48:20.035901+0000","last_clean":"2023-11-27T17:48:20.035901+0000","last_became_active":"2023-11-27T17:48:17.183811+0000","last_became_peered":"2023-11-27T17:48:17.183811+0000","last_unstale":"2023-11-27T17:48:20.035901+0000","last_undegraded":"2023-11-27T17:48:20.035901+0000","last_fullsized":"2023-11-27T17:48:20.035901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178737+0000","last_change":"2023-11-27T17:48:16.181997+0000","last_active":"2023-11-27T17:48:18.178737+0000","last_peered":"2023-11-27T17:48:18.178737+0000","last_clean":"2023-11-27T17:48:18.178737+0000","last_became_active":"2023-11-27T17:48:16.181707+0000","last_became_peered":"2023-11-27T17:48:16.181707+0000","last_unstale":"2023-11-27T17:48:18.178737+0000","last_undegraded":"2023-11-27T17:48:18.178737+0000","last_fullsized":"2023-11-27T17:48:18.178737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:40:57.780308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180474+0000","last_change":"2023-11-27T17:48:17.193351+0000","last_active":"2023-11-27T17:48:18.180474+0000","last_peered":"2023-11-27T17:48:18.180474+0000","last_clean":"2023-11-27T17:48:18.180474+0000","last_became_active":"2023-11-27T17:48:17.193076+0000","last_became_peered":"2023-11-27T17:48:17.193076+0000","last_unstale":"2023-11-27T17:48:18.180474+0000","last_undegraded":"2023-11-27T17:48:18.180474+0000","last_fullsized":"2023-11-27T17:48:18.180474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:30:58.565092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760110+0000","last_change":"2023-11-27T17:48:16.178672+0000","last_active":"2023-11-27T17:48:19.760110+0000","last_peered":"2023-11-27T17:48:19.760110+0000","last_clean":"2023-11-27T17:48:19.760110+0000","last_became_active":"2023-11-27T17:48:16.178391+0000","last_became_peered":"2023-11-27T17:48:16.178391+0000","last_unstale":"2023-11-27T17:48:19.760110+0000","last_undegraded":"2023-11-27T17:48:19.760110+0000","last_fullsized":"2023-11-27T17:48:19.760110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450287+0000","last_change":"2023-11-27T17:48:17.194730+0000","last_active":"2023-11-27T17:48:20.450287+0000","last_peered":"2023-11-27T17:48:20.450287+0000","last_clean":"2023-11-27T17:48:20.450287+0000","last_became_active":"2023-11-27T17:48:17.194183+0000","last_became_peered":"2023-11-27T17:48:17.194183+0000","last_unstale":"2023-11-27T17:48:20.450287+0000","last_undegraded":"2023-11-27T17:48:20.450287+0000","last_fullsized":"2023-11-27T17:48:20.450287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178784+0000","last_change":"2023-11-27T17:48:16.188442+0000","last_active":"2023-11-27T17:48:18.178784+0000","last_peered":"2023-11-27T17:48:18.178784+0000","last_clean":"2023-11-27T17:48:18.178784+0000","last_became_active":"2023-11-27T17:48:16.188146+0000","last_became_peered":"2023-11-27T17:48:16.188146+0000","last_unstale":"2023-11-27T17:48:18.178784+0000","last_undegraded":"2023-11-27T17:48:18.178784+0000","last_fullsized":"2023-11-27T17:48:18.178784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:08.552823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180553+0000","last_change":"2023-11-27T17:48:17.199070+0000","last_active":"2023-11-27T17:48:18.180553+0000","last_peered":"2023-11-27T17:48:18.180553+0000","last_clean":"2023-11-27T17:48:18.180553+0000","last_became_active":"2023-11-27T17:48:17.198789+0000","last_became_peered":"2023-11-27T17:48:17.198789+0000","last_unstale":"2023-11-27T17:48:18.180553+0000","last_undegraded":"2023-11-27T17:48:18.180553+0000","last_fullsized":"2023-11-27T17:48:18.180553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:16.621575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035721+0000","last_change":"2023-11-27T17:48:17.184790+0000","last_active":"2023-11-27T17:48:20.035721+0000","last_peered":"2023-11-27T17:48:20.035721+0000","last_clean":"2023-11-27T17:48:20.035721+0000","last_became_active":"2023-11-27T17:48:17.184506+0000","last_became_peered":"2023-11-27T17:48:17.184506+0000","last_unstale":"2023-11-27T17:48:20.035721+0000","last_undegraded":"2023-11-27T17:48:20.035721+0000","last_fullsized":"2023-11-27T17:48:20.035721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:35.744910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178588+0000","last_change":"2023-11-27T17:48:17.178158+0000","last_active":"2023-11-27T17:48:18.178588+0000","last_peered":"2023-11-27T17:48:18.178588+0000","last_clean":"2023-11-27T17:48:18.178588+0000","last_became_active":"2023-11-27T17:48:17.176996+0000","last_became_peered":"2023-11-27T17:48:17.176996+0000","last_unstale":"2023-11-27T17:48:18.178588+0000","last_undegraded":"2023-11-27T17:48:18.178588+0000","last_fullsized":"2023-11-27T17:48:18.178588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450574+0000","last_change":"2023-11-27T17:48:17.194747+0000","last_active":"2023-11-27T17:48:20.450574+0000","last_peered":"2023-11-27T17:48:20.450574+0000","last_clean":"2023-11-27T17:48:20.450574+0000","last_became_active":"2023-11-27T17:48:17.194564+0000","last_became_peered":"2023-11-27T17:48:17.194564+0000","last_unstale":"2023-11-27T17:48:20.450574+0000","last_undegraded":"2023-11-27T17:48:20.450574+0000","last_fullsized":"2023-11-27T17:48:20.450574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:12:54.004348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349197+0000","last_change":"2023-11-27T17:48:17.187682+0000","last_active":"2023-11-27T17:48:19.349197+0000","last_peered":"2023-11-27T17:48:19.349197+0000","last_clean":"2023-11-27T17:48:19.349197+0000","last_became_active":"2023-11-27T17:48:17.187461+0000","last_became_peered":"2023-11-27T17:48:17.187461+0000","last_unstale":"2023-11-27T17:48:19.349197+0000","last_undegraded":"2023-11-27T17:48:19.349197+0000","last_fullsized":"2023-11-27T17:48:19.349197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026758+0000","last_change":"2023-11-27T17:48:17.186202+0000","last_active":"2023-11-27T17:48:19.026758+0000","last_peered":"2023-11-27T17:48:19.026758+0000","last_clean":"2023-11-27T17:48:19.026758+0000","last_became_active":"2023-11-27T17:48:17.185863+0000","last_became_peered":"2023-11-27T17:48:17.185863+0000","last_unstale":"2023-11-27T17:48:19.026758+0000","last_undegraded":"2023-11-27T17:48:19.026758+0000","last_fullsized":"2023-11-27T17:48:19.026758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033360+0000","last_change":"2023-11-27T17:48:17.190715+0000","last_active":"2023-11-27T17:48:20.033360+0000","last_peered":"2023-11-27T17:48:20.033360+0000","last_clean":"2023-11-27T17:48:20.033360+0000","last_became_active":"2023-11-27T17:48:17.190445+0000","last_became_peered":"2023-11-27T17:48:17.190445+0000","last_unstale":"2023-11-27T17:48:20.033360+0000","last_undegraded":"2023-11-27T17:48:20.033360+0000","last_fullsized":"2023-11-27T17:48:20.033360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.036181+0000","last_change":"2023-11-27T17:48:17.194783+0000","last_active":"2023-11-27T17:48:20.036181+0000","last_peered":"2023-11-27T17:48:20.036181+0000","last_clean":"2023-11-27T17:48:20.036181+0000","last_became_active":"2023-11-27T17:48:17.194541+0000","last_became_peered":"2023-11-27T17:48:17.194541+0000","last_unstale":"2023-11-27T17:48:20.036181+0000","last_undegraded":"2023-11-27T17:48:20.036181+0000","last_fullsized":"2023-11-27T17:48:20.036181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026895+0000","last_change":"2023-11-27T17:48:17.185329+0000","last_active":"2023-11-27T17:48:19.026895+0000","last_peered":"2023-11-27T17:48:19.026895+0000","last_clean":"2023-11-27T17:48:19.026895+0000","last_became_active":"2023-11-27T17:48:17.185069+0000","last_became_peered":"2023-11-27T17:48:17.185069+0000","last_unstale":"2023-11-27T17:48:19.026895+0000","last_undegraded":"2023-11-27T17:48:19.026895+0000","last_fullsized":"2023-11-27T17:48:19.026895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450112+0000","last_change":"2023-11-27T17:48:17.195514+0000","last_active":"2023-11-27T17:48:20.450112+0000","last_peered":"2023-11-27T17:48:20.450112+0000","last_clean":"2023-11-27T17:48:20.450112+0000","last_became_active":"2023-11-27T17:48:17.195197+0000","last_became_peered":"2023-11-27T17:48:17.195197+0000","last_unstale":"2023-11-27T17:48:20.450112+0000","last_undegraded":"2023-11-27T17:48:20.450112+0000","last_fullsized":"2023-11-27T17:48:20.450112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:51.585949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026425+0000","last_change":"2023-11-27T17:48:17.190515+0000","last_active":"2023-11-27T17:48:19.026425+0000","last_peered":"2023-11-27T17:48:19.026425+0000","last_clean":"2023-11-27T17:48:19.026425+0000","last_became_active":"2023-11-27T17:48:17.190249+0000","last_became_peered":"2023-11-27T17:48:17.190249+0000","last_unstale":"2023-11-27T17:48:19.026425+0000","last_undegraded":"2023-11-27T17:48:19.026425+0000","last_fullsized":"2023-11-27T17:48:19.026425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450098+0000","last_change":"2023-11-27T17:48:17.193170+0000","last_active":"2023-11-27T17:48:20.450098+0000","last_peered":"2023-11-27T17:48:20.450098+0000","last_clean":"2023-11-27T17:48:20.450098+0000","last_became_active":"2023-11-27T17:48:17.192869+0000","last_became_peered":"2023-11-27T17:48:17.192869+0000","last_unstale":"2023-11-27T17:48:20.450098+0000","last_undegraded":"2023-11-27T17:48:20.450098+0000","last_fullsized":"2023-11-27T17:48:20.450098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349111+0000","last_change":"2023-11-27T17:48:17.183735+0000","last_active":"2023-11-27T17:48:19.349111+0000","last_peered":"2023-11-27T17:48:19.349111+0000","last_clean":"2023-11-27T17:48:19.349111+0000","last_became_active":"2023-11-27T17:48:17.183424+0000","last_became_peered":"2023-11-27T17:48:17.183424+0000","last_unstale":"2023-11-27T17:48:19.349111+0000","last_undegraded":"2023-11-27T17:48:19.349111+0000","last_fullsized":"2023-11-27T17:48:19.349111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035961+0000","last_change":"2023-11-27T17:48:17.178805+0000","last_active":"2023-11-27T17:48:20.035961+0000","last_peered":"2023-11-27T17:48:20.035961+0000","last_clean":"2023-11-27T17:48:20.035961+0000","last_became_active":"2023-11-27T17:48:17.177473+0000","last_became_peered":"2023-11-27T17:48:17.177473+0000","last_unstale":"2023-11-27T17:48:20.035961+0000","last_undegraded":"2023-11-27T17:48:20.035961+0000","last_fullsized":"2023-11-27T17:48:20.035961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:48:25.954 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:48:26.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.106+0000 7f8693bf0700 1 Processor -- start 2023-11-27T17:48:26.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.107+0000 7f8693bf0700 1 -- start start 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.107+0000 7f8693bf0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.107+0000 7f8693bf0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f868c06dd00 0x7f868c143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.107+0000 7f8693bf0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c06e510 con 0x7f868c141030 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f8693bf0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c161ac0 con 0x7f868c06dd00 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f8693bf0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c141410 con 0x7f868c072d20 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869198c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f868c141030 0x7f868c072610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46182/0 (socket says 172.21.15.177:46182) 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869198c700 1 -- 172.21.15.177:0/507738383 learned_addr learned my addr 172.21.15.177:0/507738383 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869118b700 1 --2- 172.21.15.177:0/507738383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869218d700 1 --2- 172.21.15.177:0/507738383 >> v2:172.21.15.178:3300/0 conn(0x7f868c06dd00 0x7f868c143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869098a700 1 -- 172.21.15.177:0/507738383 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628911537 0 0) 0x7f867c001110 con 0x7f868c141030 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869098a700 1 -- 172.21.15.177:0/507738383 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86780035b0 con 0x7f868c141030 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869118b700 1 -- 172.21.15.177:0/507738383 >> v2:172.21.15.178:3300/0 conn(0x7f868c06dd00 msgr2=0x7f868c143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869118b700 1 --2- 172.21.15.177:0/507738383 >> v2:172.21.15.178:3300/0 conn(0x7f868c06dd00 0x7f868c143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869118b700 1 -- 172.21.15.177:0/507738383 >> v1:172.21.15.177:6789/0 conn(0x7f868c141030 legacy=0x7f868c072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869118b700 1 -- 172.21.15.177:0/507738383 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c161ca0 con 0x7f868c072d20 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869218d700 1 --2- 172.21.15.177:0/507738383 >> v2:172.21.15.178:3300/0 conn(0x7f868c06dd00 0x7f868c143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869118b700 1 --2- 172.21.15.177:0/507738383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c06d7c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8688009840 tx=0x7f8688009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c00799c165efd96 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.108+0000 7f869098a700 1 -- 172.21.15.177:0/507738383 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688011830 con 0x7f868c072d20 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f869098a700 1 -- 172.21.15.177:0/507738383 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8688011990 con 0x7f868c072d20 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f869098a700 1 -- 172.21.15.177:0/507738383 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688011d20 con 0x7f868c072d20 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f8693bf0700 1 -- 172.21.15.177:0/507738383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 msgr2=0x7f868c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f8693bf0700 1 --2- 172.21.15.177:0/507738383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c06d7c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8688009840 tx=0x7f8688009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f8693bf0700 1 -- 172.21.15.177:0/507738383 shutdown_connections 2023-11-27T17:48:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f8693bf0700 1 --2- 172.21.15.177:0/507738383 >> v2:172.21.15.178:3300/0 conn(0x7f868c06dd00 0x7f868c143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f8693bf0700 1 --2- 172.21.15.177:0/507738383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c06d7c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f8693bf0700 1 -- 172.21.15.177:0/507738383 >> 172.21.15.177:0/507738383 conn(0x7f868c06aff0 msgr2=0x7f868c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f8693bf0700 1 -- 172.21.15.177:0/507738383 shutdown_connections 2023-11-27T17:48:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.109+0000 7f8693bf0700 1 -- 172.21.15.177:0/507738383 wait complete. 2023-11-27T17:48:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.111+0000 7f8693bf0700 1 Processor -- start 2023-11-27T17:48:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.111+0000 7f8693bf0700 1 -- start start 2023-11-27T17:48:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f8693bf0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868c06dd00 0x7f868c13e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f8693bf0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f8693bf0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868c141030 0x7f868c13da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f8693bf0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c1598a0 con 0x7f868c141030 2023-11-27T17:48:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f8693bf0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c159b80 con 0x7f868c06dd00 2023-11-27T17:48:26.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f8693bf0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c159e60 con 0x7f868c072d20 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868c141030 0x7f868c13da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868c141030 0x7f868c13da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51874/0 (socket says 172.21.15.177:51874) 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 -- 172.21.15.177:0/4222574637 learned_addr learned my addr 172.21.15.177:0/4222574637 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869118b700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869198c700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868c06dd00 0x7f868c13e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 -- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 msgr2=0x7f868c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 -- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868c06dd00 msgr2=0x7f868c13e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868c06dd00 0x7f868c13e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 -- 172.21.15.177:0/4222574637 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684009a70 con 0x7f868c141030 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869198c700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868c06dd00 0x7f868c13e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:26.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f869218d700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868c141030 0x7f868c13da90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f868400efc0 tx=0x7f868400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f86827fc700 1 -- 172.21.15.177:0/4222574637 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400cb40 con 0x7f868c141030 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f86827fc700 1 -- 172.21.15.177:0/4222574637 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868400f040 con 0x7f868c141030 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86880094a0 con 0x7f868c141030 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f86827fc700 1 -- 172.21.15.177:0/4222574637 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684003a20 con 0x7f868c141030 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.112+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c15a420 con 0x7f868c141030 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.113+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c073aa0 con 0x7f868c141030 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.114+0000 7f86827fc700 1 -- 172.21.15.177:0/4222574637 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8684014480 con 0x7f868c141030 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.114+0000 7f86827fc700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f867006b250 0x7f867006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.114+0000 7f86827fc700 1 -- 172.21.15.177:0/4222574637 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f868408a3b0 con 0x7f868c141030 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.114+0000 7f869198c700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f867006b250 0x7f867006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.114+0000 7f869198c700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f867006b250 0x7f867006d710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f867c001270 tx=0x7f867c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.118+0000 7f86827fc700 1 -- 172.21.15.177:0/4222574637 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f86840550e0 con 0x7f868c141030 2023-11-27T17:48:26.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.305+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f868c159cf0 con 0x7f867006b250 2023-11-27T17:48:26.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.312+0000 7f86827fc700 1 -- 172.21.15.177:0/4222574637 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264612 (secure 0 0 0) 0x7f868c159cf0 con 0x7f867006b250 2023-11-27T17:48:26.320 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:26.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.315+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f867006b250 msgr2=0x7f867006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.315+0000 7f8693bf0700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f867006b250 0x7f867006d710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f867c001270 tx=0x7f867c009040 comp rx=0 tx=0).stop 2023-11-27T17:48:26.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.315+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868c141030 msgr2=0x7f868c13da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.315+0000 7f8693bf0700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868c141030 0x7f868c13da90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f868400efc0 tx=0x7f868400c3a0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.316+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 shutdown_connections 2023-11-27T17:48:26.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.316+0000 7f8693bf0700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f867006b250 0x7f867006d710 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.316+0000 7f8693bf0700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868c141030 0x7f868c13da90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.316+0000 7f8693bf0700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868c06dd00 0x7f868c13e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.316+0000 7f8693bf0700 1 --2- 172.21.15.177:0/4222574637 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868c072d20 0x7f868c159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.316+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 >> 172.21.15.177:0/4222574637 conn(0x7f868c06aff0 msgr2=0x7f868c071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:26.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.316+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 shutdown_connections 2023-11-27T17:48:26.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.316+0000 7f8693bf0700 1 -- 172.21.15.177:0/4222574637 wait complete. 2023-11-27T17:48:26.325 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:48:26.330 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-27T17:48:24.621419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001683"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180718+0000","last_change":"2023-11-27T17:48:17.200652+0000","last_active":"2023-11-27T17:48:18.180718+0000","last_peered":"2023-11-27T17:48:18.180718+0000","last_clean":"2023-11-27T17:48:18.180718+0000","last_became_active":"2023-11-27T17:48:17.200367+0000","last_became_peered":"2023-11-27T17:48:17.200367+0000","last_unstale":"2023-11-27T17:48:18.180718+0000","last_undegraded":"2023-11-27T17:48:18.180718+0000","last_fullsized":"2023-11-27T17:48:18.180718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:48.898798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033497+0000","last_change":"2023-11-27T17:48:17.178900+0000","last_active":"2023-11-27T17:48:20.033497+0000","last_peered":"2023-11-27T17:48:20.033497+0000","last_clean":"2023-11-27T17:48:20.033497+0000","last_became_active":"2023-11-27T17:48:17.178688+0000","last_became_peered":"2023-11-27T17:48:17.178688+0000","last_unstale":"2023-11-27T17:48:20.033497+0000","last_undegraded":"2023-11-27T17:48:20.033497+0000","last_fullsized":"2023-11-27T17:48:20.033497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349059+0000","last_change":"2023-11-27T17:48:17.183900+0000","last_active":"2023-11-27T17:48:19.349059+0000","last_peered":"2023-11-27T17:48:19.349059+0000","last_clean":"2023-11-27T17:48:19.349059+0000","last_became_active":"2023-11-27T17:48:17.183057+0000","last_became_peered":"2023-11-27T17:48:17.183057+0000","last_unstale":"2023-11-27T17:48:19.349059+0000","last_undegraded":"2023-11-27T17:48:19.349059+0000","last_fullsized":"2023-11-27T17:48:19.349059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:35.744910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450557+0000","last_change":"2023-11-27T17:48:17.194895+0000","last_active":"2023-11-27T17:48:20.450557+0000","last_peered":"2023-11-27T17:48:20.450557+0000","last_clean":"2023-11-27T17:48:20.450557+0000","last_became_active":"2023-11-27T17:48:17.194569+0000","last_became_peered":"2023-11-27T17:48:17.194569+0000","last_unstale":"2023-11-27T17:48:20.450557+0000","last_undegraded":"2023-11-27T17:48:20.450557+0000","last_fullsized":"2023-11-27T17:48:20.450557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:16.621575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180037+0000","last_change":"2023-11-27T17:48:17.190418+0000","last_active":"2023-11-27T17:48:18.180037+0000","last_peered":"2023-11-27T17:48:18.180037+0000","last_clean":"2023-11-27T17:48:18.180037+0000","last_became_active":"2023-11-27T17:48:17.190089+0000","last_became_peered":"2023-11-27T17:48:17.190089+0000","last_unstale":"2023-11-27T17:48:18.180037+0000","last_undegraded":"2023-11-27T17:48:18.180037+0000","last_fullsized":"2023-11-27T17:48:18.180037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450001+0000","last_change":"2023-11-27T17:48:17.183458+0000","last_active":"2023-11-27T17:48:20.450001+0000","last_peered":"2023-11-27T17:48:20.450001+0000","last_clean":"2023-11-27T17:48:20.450001+0000","last_became_active":"2023-11-27T17:48:17.183168+0000","last_became_peered":"2023-11-27T17:48:17.183168+0000","last_unstale":"2023-11-27T17:48:20.450001+0000","last_undegraded":"2023-11-27T17:48:20.450001+0000","last_fullsized":"2023-11-27T17:48:20.450001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180103+0000","last_change":"2023-11-27T17:48:17.185791+0000","last_active":"2023-11-27T17:48:18.180103+0000","last_peered":"2023-11-27T17:48:18.180103+0000","last_clean":"2023-11-27T17:48:18.180103+0000","last_became_active":"2023-11-27T17:48:17.185040+0000","last_became_peered":"2023-11-27T17:48:17.185040+0000","last_unstale":"2023-11-27T17:48:18.180103+0000","last_undegraded":"2023-11-27T17:48:18.180103+0000","last_fullsized":"2023-11-27T17:48:18.180103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026403+0000","last_change":"2023-11-27T17:48:17.189241+0000","last_active":"2023-11-27T17:48:19.026403+0000","last_peered":"2023-11-27T17:48:19.026403+0000","last_clean":"2023-11-27T17:48:19.026403+0000","last_became_active":"2023-11-27T17:48:17.188950+0000","last_became_peered":"2023-11-27T17:48:17.188950+0000","last_unstale":"2023-11-27T17:48:19.026403+0000","last_undegraded":"2023-11-27T17:48:19.026403+0000","last_fullsized":"2023-11-27T17:48:19.026403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180691+0000","last_change":"2023-11-27T17:48:17.196341+0000","last_active":"2023-11-27T17:48:18.180691+0000","last_peered":"2023-11-27T17:48:18.180691+0000","last_clean":"2023-11-27T17:48:18.180691+0000","last_became_active":"2023-11-27T17:48:17.195932+0000","last_became_peered":"2023-11-27T17:48:17.195932+0000","last_unstale":"2023-11-27T17:48:18.180691+0000","last_undegraded":"2023-11-27T17:48:18.180691+0000","last_fullsized":"2023-11-27T17:48:18.180691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:12:54.004348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.036232+0000","last_change":"2023-11-27T17:48:17.182144+0000","last_active":"2023-11-27T17:48:20.036232+0000","last_peered":"2023-11-27T17:48:20.036232+0000","last_clean":"2023-11-27T17:48:20.036232+0000","last_became_active":"2023-11-27T17:48:17.181882+0000","last_became_peered":"2023-11-27T17:48:17.181882+0000","last_unstale":"2023-11-27T17:48:20.036232+0000","last_undegraded":"2023-11-27T17:48:20.036232+0000","last_fullsized":"2023-11-27T17:48:20.036232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035948+0000","last_change":"2023-11-27T17:48:17.182351+0000","last_active":"2023-11-27T17:48:20.035948+0000","last_peered":"2023-11-27T17:48:20.035948+0000","last_clean":"2023-11-27T17:48:20.035948+0000","last_became_active":"2023-11-27T17:48:17.182036+0000","last_became_peered":"2023-11-27T17:48:17.182036+0000","last_unstale":"2023-11-27T17:48:20.035948+0000","last_undegraded":"2023-11-27T17:48:20.035948+0000","last_fullsized":"2023-11-27T17:48:20.035948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181409+0000","last_change":"2023-11-27T17:48:17.179857+0000","last_active":"2023-11-27T17:48:18.181409+0000","last_peered":"2023-11-27T17:48:18.181409+0000","last_clean":"2023-11-27T17:48:18.181409+0000","last_became_active":"2023-11-27T17:48:17.179396+0000","last_became_peered":"2023-11-27T17:48:17.179396+0000","last_unstale":"2023-11-27T17:48:18.181409+0000","last_undegraded":"2023-11-27T17:48:18.181409+0000","last_fullsized":"2023-11-27T17:48:18.181409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026911+0000","last_change":"2023-11-27T17:48:17.201660+0000","last_active":"2023-11-27T17:48:19.026911+0000","last_peered":"2023-11-27T17:48:19.026911+0000","last_clean":"2023-11-27T17:48:19.026911+0000","last_became_active":"2023-11-27T17:48:17.201412+0000","last_became_peered":"2023-11-27T17:48:17.201412+0000","last_unstale":"2023-11-27T17:48:19.026911+0000","last_undegraded":"2023-11-27T17:48:19.026911+0000","last_fullsized":"2023-11-27T17:48:19.026911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349083+0000","last_change":"2023-11-27T17:48:17.179417+0000","last_active":"2023-11-27T17:48:19.349083+0000","last_peered":"2023-11-27T17:48:19.349083+0000","last_clean":"2023-11-27T17:48:19.349083+0000","last_became_active":"2023-11-27T17:48:17.178865+0000","last_became_peered":"2023-11-27T17:48:17.178865+0000","last_unstale":"2023-11-27T17:48:19.349083+0000","last_undegraded":"2023-11-27T17:48:19.349083+0000","last_fullsized":"2023-11-27T17:48:19.349083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033117+0000","last_change":"2023-11-27T17:48:17.171870+0000","last_active":"2023-11-27T17:48:20.033117+0000","last_peered":"2023-11-27T17:48:20.033117+0000","last_clean":"2023-11-27T17:48:20.033117+0000","last_became_active":"2023-11-27T17:48:17.171444+0000","last_became_peered":"2023-11-27T17:48:17.171444+0000","last_unstale":"2023-11-27T17:48:20.033117+0000","last_undegraded":"2023-11-27T17:48:20.033117+0000","last_fullsized":"2023-11-27T17:48:20.033117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.449917+0000","last_change":"2023-11-27T17:48:17.183467+0000","last_active":"2023-11-27T17:48:20.449917+0000","last_peered":"2023-11-27T17:48:20.449917+0000","last_clean":"2023-11-27T17:48:20.449917+0000","last_became_active":"2023-11-27T17:48:17.183203+0000","last_became_peered":"2023-11-27T17:48:17.183203+0000","last_unstale":"2023-11-27T17:48:20.449917+0000","last_undegraded":"2023-11-27T17:48:20.449917+0000","last_fullsized":"2023-11-27T17:48:20.449917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450557+0000","last_change":"2023-11-27T17:48:17.193109+0000","last_active":"2023-11-27T17:48:20.450557+0000","last_peered":"2023-11-27T17:48:20.450557+0000","last_clean":"2023-11-27T17:48:20.450557+0000","last_became_active":"2023-11-27T17:48:17.192836+0000","last_became_peered":"2023-11-27T17:48:17.192836+0000","last_unstale":"2023-11-27T17:48:20.450557+0000","last_undegraded":"2023-11-27T17:48:20.450557+0000","last_fullsized":"2023-11-27T17:48:20.450557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:30:58.565092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178610+0000","last_change":"2023-11-27T17:48:17.178927+0000","last_active":"2023-11-27T17:48:18.178610+0000","last_peered":"2023-11-27T17:48:18.178610+0000","last_clean":"2023-11-27T17:48:18.178610+0000","last_became_active":"2023-11-27T17:48:17.178668+0000","last_became_peered":"2023-11-27T17:48:17.178668+0000","last_unstale":"2023-11-27T17:48:18.178610+0000","last_undegraded":"2023-11-27T17:48:18.178610+0000","last_fullsized":"2023-11-27T17:48:18.178610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:56.140606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180294+0000","last_change":"2023-11-27T17:48:17.196844+0000","last_active":"2023-11-27T17:48:18.180294+0000","last_peered":"2023-11-27T17:48:18.180294+0000","last_clean":"2023-11-27T17:48:18.180294+0000","last_became_active":"2023-11-27T17:48:17.196588+0000","last_became_peered":"2023-11-27T17:48:17.196588+0000","last_unstale":"2023-11-27T17:48:18.180294+0000","last_undegraded":"2023-11-27T17:48:18.180294+0000","last_fullsized":"2023-11-27T17:48:18.180294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:03.113296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349135+0000","last_change":"2023-11-27T17:48:16.182157+0000","last_active":"2023-11-27T17:48:19.349135+0000","last_peered":"2023-11-27T17:48:19.349135+0000","last_clean":"2023-11-27T17:48:19.349135+0000","last_became_active":"2023-11-27T17:48:16.181789+0000","last_became_peered":"2023-11-27T17:48:16.181789+0000","last_unstale":"2023-11-27T17:48:19.349135+0000","last_undegraded":"2023-11-27T17:48:19.349135+0000","last_fullsized":"2023-11-27T17:48:19.349135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:55.133591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026801+0000","last_change":"2023-11-27T17:48:17.184258+0000","last_active":"2023-11-27T17:48:19.026801+0000","last_peered":"2023-11-27T17:48:19.026801+0000","last_clean":"2023-11-27T17:48:19.026801+0000","last_became_active":"2023-11-27T17:48:17.183985+0000","last_became_peered":"2023-11-27T17:48:17.183985+0000","last_unstale":"2023-11-27T17:48:19.026801+0000","last_undegraded":"2023-11-27T17:48:19.026801+0000","last_fullsized":"2023-11-27T17:48:19.026801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:51.585949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026822+0000","last_change":"2023-11-27T17:48:16.189592+0000","last_active":"2023-11-27T17:48:19.026822+0000","last_peered":"2023-11-27T17:48:19.026822+0000","last_clean":"2023-11-27T17:48:19.026822+0000","last_became_active":"2023-11-27T17:48:16.189296+0000","last_became_peered":"2023-11-27T17:48:16.189296+0000","last_unstale":"2023-11-27T17:48:19.026822+0000","last_undegraded":"2023-11-27T17:48:19.026822+0000","last_fullsized":"2023-11-27T17:48:19.026822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:44.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349044+0000","last_change":"2023-11-27T17:48:17.181599+0000","last_active":"2023-11-27T17:48:19.349044+0000","last_peered":"2023-11-27T17:48:19.349044+0000","last_clean":"2023-11-27T17:48:19.349044+0000","last_became_active":"2023-11-27T17:48:17.180736+0000","last_became_peered":"2023-11-27T17:48:17.180736+0000","last_unstale":"2023-11-27T17:48:19.349044+0000","last_undegraded":"2023-11-27T17:48:19.349044+0000","last_fullsized":"2023-11-27T17:48:19.349044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:48.392176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180482+0000","last_change":"2023-11-27T17:48:16.185981+0000","last_active":"2023-11-27T17:48:18.180482+0000","last_peered":"2023-11-27T17:48:18.180482+0000","last_clean":"2023-11-27T17:48:18.180482+0000","last_became_active":"2023-11-27T17:48:16.185648+0000","last_became_peered":"2023-11-27T17:48:16.185648+0000","last_unstale":"2023-11-27T17:48:18.180482+0000","last_undegraded":"2023-11-27T17:48:18.180482+0000","last_fullsized":"2023-11-27T17:48:18.180482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:27.226337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450222+0000","last_change":"2023-11-27T17:48:17.192478+0000","last_active":"2023-11-27T17:48:20.450222+0000","last_peered":"2023-11-27T17:48:20.450222+0000","last_clean":"2023-11-27T17:48:20.450222+0000","last_became_active":"2023-11-27T17:48:17.191295+0000","last_became_peered":"2023-11-27T17:48:17.191295+0000","last_unstale":"2023-11-27T17:48:20.450222+0000","last_undegraded":"2023-11-27T17:48:20.450222+0000","last_fullsized":"2023-11-27T17:48:20.450222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179959+0000","last_change":"2023-11-27T17:48:16.182525+0000","last_active":"2023-11-27T17:48:18.179959+0000","last_peered":"2023-11-27T17:48:18.179959+0000","last_clean":"2023-11-27T17:48:18.179959+0000","last_became_active":"2023-11-27T17:48:16.182208+0000","last_became_peered":"2023-11-27T17:48:16.182208+0000","last_unstale":"2023-11-27T17:48:18.179959+0000","last_undegraded":"2023-11-27T17:48:18.179959+0000","last_fullsized":"2023-11-27T17:48:18.179959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450336+0000","last_change":"2023-11-27T17:48:17.190913+0000","last_active":"2023-11-27T17:48:20.450336+0000","last_peered":"2023-11-27T17:48:20.450336+0000","last_clean":"2023-11-27T17:48:20.450336+0000","last_became_active":"2023-11-27T17:48:17.190591+0000","last_became_peered":"2023-11-27T17:48:17.190591+0000","last_unstale":"2023-11-27T17:48:20.450336+0000","last_undegraded":"2023-11-27T17:48:20.450336+0000","last_fullsized":"2023-11-27T17:48:20.450336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026931+0000","last_change":"2023-11-27T17:48:16.188491+0000","last_active":"2023-11-27T17:48:19.026931+0000","last_peered":"2023-11-27T17:48:19.026931+0000","last_clean":"2023-11-27T17:48:19.026931+0000","last_became_active":"2023-11-27T17:48:16.188301+0000","last_became_peered":"2023-11-27T17:48:16.188301+0000","last_unstale":"2023-11-27T17:48:19.026931+0000","last_undegraded":"2023-11-27T17:48:19.026931+0000","last_fullsized":"2023-11-27T17:48:19.026931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180319+0000","last_change":"2023-11-27T17:48:17.178657+0000","last_active":"2023-11-27T17:48:18.180319+0000","last_peered":"2023-11-27T17:48:18.180319+0000","last_clean":"2023-11-27T17:48:18.180319+0000","last_became_active":"2023-11-27T17:48:17.178374+0000","last_became_peered":"2023-11-27T17:48:17.178374+0000","last_unstale":"2023-11-27T17:48:18.180319+0000","last_undegraded":"2023-11-27T17:48:18.180319+0000","last_fullsized":"2023-11-27T17:48:18.180319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:09.559838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761727+0000","last_change":"2023-11-27T17:48:16.182101+0000","last_active":"2023-11-27T17:48:19.761727+0000","last_peered":"2023-11-27T17:48:19.761727+0000","last_clean":"2023-11-27T17:48:19.761727+0000","last_became_active":"2023-11-27T17:48:16.181767+0000","last_became_peered":"2023-11-27T17:48:16.181767+0000","last_unstale":"2023-11-27T17:48:19.761727+0000","last_undegraded":"2023-11-27T17:48:19.761727+0000","last_fullsized":"2023-11-27T17:48:19.761727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349273+0000","last_change":"2023-11-27T17:48:17.180782+0000","last_active":"2023-11-27T17:48:19.349273+0000","last_peered":"2023-11-27T17:48:19.349273+0000","last_clean":"2023-11-27T17:48:19.349273+0000","last_became_active":"2023-11-27T17:48:17.180463+0000","last_became_peered":"2023-11-27T17:48:17.180463+0000","last_unstale":"2023-11-27T17:48:19.349273+0000","last_undegraded":"2023-11-27T17:48:19.349273+0000","last_fullsized":"2023-11-27T17:48:19.349273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026513+0000","last_change":"2023-11-27T17:48:16.186582+0000","last_active":"2023-11-27T17:48:19.026513+0000","last_peered":"2023-11-27T17:48:19.026513+0000","last_clean":"2023-11-27T17:48:19.026513+0000","last_became_active":"2023-11-27T17:48:16.186290+0000","last_became_peered":"2023-11-27T17:48:16.186290+0000","last_unstale":"2023-11-27T17:48:19.026513+0000","last_undegraded":"2023-11-27T17:48:19.026513+0000","last_fullsized":"2023-11-27T17:48:19.026513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:39.886602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026554+0000","last_change":"2023-11-27T17:48:17.189577+0000","last_active":"2023-11-27T17:48:19.026554+0000","last_peered":"2023-11-27T17:48:19.026554+0000","last_clean":"2023-11-27T17:48:19.026554+0000","last_became_active":"2023-11-27T17:48:17.188679+0000","last_became_peered":"2023-11-27T17:48:17.188679+0000","last_unstale":"2023-11-27T17:48:19.026554+0000","last_undegraded":"2023-11-27T17:48:19.026554+0000","last_fullsized":"2023-11-27T17:48:19.026554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767411+0000","last_change":"2023-11-27T17:48:16.180119+0000","last_active":"2023-11-27T17:48:19.767411+0000","last_peered":"2023-11-27T17:48:19.767411+0000","last_clean":"2023-11-27T17:48:19.767411+0000","last_became_active":"2023-11-27T17:48:16.179826+0000","last_became_peered":"2023-11-27T17:48:16.179826+0000","last_unstale":"2023-11-27T17:48:19.767411+0000","last_undegraded":"2023-11-27T17:48:19.767411+0000","last_fullsized":"2023-11-27T17:48:19.767411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:47.385160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033271+0000","last_change":"2023-11-27T17:48:17.186966+0000","last_active":"2023-11-27T17:48:20.033271+0000","last_peered":"2023-11-27T17:48:20.033271+0000","last_clean":"2023-11-27T17:48:20.033271+0000","last_became_active":"2023-11-27T17:48:17.186650+0000","last_became_peered":"2023-11-27T17:48:17.186650+0000","last_unstale":"2023-11-27T17:48:20.033271+0000","last_undegraded":"2023-11-27T17:48:20.033271+0000","last_fullsized":"2023-11-27T17:48:20.033271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761840+0000","last_change":"2023-11-27T17:48:16.180021+0000","last_active":"2023-11-27T17:48:19.761840+0000","last_peered":"2023-11-27T17:48:19.761840+0000","last_clean":"2023-11-27T17:48:19.761840+0000","last_became_active":"2023-11-27T17:48:16.179702+0000","last_became_peered":"2023-11-27T17:48:16.179702+0000","last_unstale":"2023-11-27T17:48:19.761840+0000","last_undegraded":"2023-11-27T17:48:19.761840+0000","last_fullsized":"2023-11-27T17:48:19.761840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:23:55.133591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450455+0000","last_change":"2023-11-27T17:48:17.186938+0000","last_active":"2023-11-27T17:48:20.450455+0000","last_peered":"2023-11-27T17:48:20.450455+0000","last_clean":"2023-11-27T17:48:20.450455+0000","last_became_active":"2023-11-27T17:48:17.186711+0000","last_became_peered":"2023-11-27T17:48:17.186711+0000","last_unstale":"2023-11-27T17:48:20.450455+0000","last_undegraded":"2023-11-27T17:48:20.450455+0000","last_fullsized":"2023-11-27T17:48:20.450455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:36.527615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767587+0000","last_change":"2023-11-27T17:48:16.182253+0000","last_active":"2023-11-27T17:48:19.767587+0000","last_peered":"2023-11-27T17:48:19.767587+0000","last_clean":"2023-11-27T17:48:19.767587+0000","last_became_active":"2023-11-27T17:48:16.181399+0000","last_became_peered":"2023-11-27T17:48:16.181399+0000","last_unstale":"2023-11-27T17:48:19.767587+0000","last_undegraded":"2023-11-27T17:48:19.767587+0000","last_fullsized":"2023-11-27T17:48:19.767587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:50:44.630856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349254+0000","last_change":"2023-11-27T17:48:17.181837+0000","last_active":"2023-11-27T17:48:19.349254+0000","last_peered":"2023-11-27T17:48:19.349254+0000","last_clean":"2023-11-27T17:48:19.349254+0000","last_became_active":"2023-11-27T17:48:17.181271+0000","last_became_peered":"2023-11-27T17:48:17.181271+0000","last_unstale":"2023-11-27T17:48:19.349254+0000","last_undegraded":"2023-11-27T17:48:19.349254+0000","last_fullsized":"2023-11-27T17:48:19.349254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760122+0000","last_change":"2023-11-27T17:48:16.177994+0000","last_active":"2023-11-27T17:48:19.760122+0000","last_peered":"2023-11-27T17:48:19.760122+0000","last_clean":"2023-11-27T17:48:19.760122+0000","last_became_active":"2023-11-27T17:48:16.177727+0000","last_became_peered":"2023-11-27T17:48:16.177727+0000","last_unstale":"2023-11-27T17:48:19.760122+0000","last_undegraded":"2023-11-27T17:48:19.760122+0000","last_fullsized":"2023-11-27T17:48:19.760122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181325+0000","last_change":"2023-11-27T17:48:17.198710+0000","last_active":"2023-11-27T17:48:18.181325+0000","last_peered":"2023-11-27T17:48:18.181325+0000","last_clean":"2023-11-27T17:48:18.181325+0000","last_became_active":"2023-11-27T17:48:17.198406+0000","last_became_peered":"2023-11-27T17:48:17.198406+0000","last_unstale":"2023-11-27T17:48:18.181325+0000","last_undegraded":"2023-11-27T17:48:18.181325+0000","last_fullsized":"2023-11-27T17:48:18.181325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761754+0000","last_change":"2023-11-27T17:48:16.191881+0000","last_active":"2023-11-27T17:48:19.761754+0000","last_peered":"2023-11-27T17:48:19.761754+0000","last_clean":"2023-11-27T17:48:19.761754+0000","last_became_active":"2023-11-27T17:48:16.191647+0000","last_became_peered":"2023-11-27T17:48:16.191647+0000","last_unstale":"2023-11-27T17:48:19.761754+0000","last_undegraded":"2023-11-27T17:48:19.761754+0000","last_fullsized":"2023-11-27T17:48:19.761754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180322+0000","last_change":"2023-11-27T17:48:17.196086+0000","last_active":"2023-11-27T17:48:18.180322+0000","last_peered":"2023-11-27T17:48:18.180322+0000","last_clean":"2023-11-27T17:48:18.180322+0000","last_became_active":"2023-11-27T17:48:17.195707+0000","last_became_peered":"2023-11-27T17:48:17.195707+0000","last_unstale":"2023-11-27T17:48:18.180322+0000","last_undegraded":"2023-11-27T17:48:18.180322+0000","last_fullsized":"2023-11-27T17:48:18.180322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:13:36.527615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349199+0000","last_change":"2023-11-27T17:48:16.178114+0000","last_active":"2023-11-27T17:48:19.349199+0000","last_peered":"2023-11-27T17:48:19.349199+0000","last_clean":"2023-11-27T17:48:19.349199+0000","last_became_active":"2023-11-27T17:48:16.177834+0000","last_became_peered":"2023-11-27T17:48:16.177834+0000","last_unstale":"2023-11-27T17:48:19.349199+0000","last_undegraded":"2023-11-27T17:48:19.349199+0000","last_fullsized":"2023-11-27T17:48:19.349199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:15.354630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349059+0000","last_change":"2023-11-27T17:48:17.187918+0000","last_active":"2023-11-27T17:48:19.349059+0000","last_peered":"2023-11-27T17:48:19.349059+0000","last_clean":"2023-11-27T17:48:19.349059+0000","last_became_active":"2023-11-27T17:48:17.187649+0000","last_became_peered":"2023-11-27T17:48:17.187649+0000","last_unstale":"2023-11-27T17:48:19.349059+0000","last_undegraded":"2023-11-27T17:48:19.349059+0000","last_fullsized":"2023-11-27T17:48:19.349059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:40.893618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767495+0000","last_change":"2023-11-27T17:48:16.188695+0000","last_active":"2023-11-27T17:48:19.767495+0000","last_peered":"2023-11-27T17:48:19.767495+0000","last_clean":"2023-11-27T17:48:19.767495+0000","last_became_active":"2023-11-27T17:48:16.188414+0000","last_became_peered":"2023-11-27T17:48:16.188414+0000","last_unstale":"2023-11-27T17:48:19.767495+0000","last_undegraded":"2023-11-27T17:48:19.767495+0000","last_fullsized":"2023-11-27T17:48:19.767495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:17.074762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180262+0000","last_change":"2023-11-27T17:48:17.192145+0000","last_active":"2023-11-27T17:48:18.180262+0000","last_peered":"2023-11-27T17:48:18.180262+0000","last_clean":"2023-11-27T17:48:18.180262+0000","last_became_active":"2023-11-27T17:48:17.191826+0000","last_became_peered":"2023-11-27T17:48:17.191826+0000","last_unstale":"2023-11-27T17:48:18.180262+0000","last_undegraded":"2023-11-27T17:48:18.180262+0000","last_fullsized":"2023-11-27T17:48:18.180262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761699+0000","last_change":"2023-11-27T17:48:16.181257+0000","last_active":"2023-11-27T17:48:19.761699+0000","last_peered":"2023-11-27T17:48:19.761699+0000","last_clean":"2023-11-27T17:48:19.761699+0000","last_became_active":"2023-11-27T17:48:16.180955+0000","last_became_peered":"2023-11-27T17:48:16.180955+0000","last_unstale":"2023-11-27T17:48:19.761699+0000","last_undegraded":"2023-11-27T17:48:19.761699+0000","last_fullsized":"2023-11-27T17:48:19.761699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:57.362173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035737+0000","last_change":"2023-11-27T17:48:17.184780+0000","last_active":"2023-11-27T17:48:20.035737+0000","last_peered":"2023-11-27T17:48:20.035737+0000","last_clean":"2023-11-27T17:48:20.035737+0000","last_became_active":"2023-11-27T17:48:17.184496+0000","last_became_peered":"2023-11-27T17:48:17.184496+0000","last_unstale":"2023-11-27T17:48:20.035737+0000","last_undegraded":"2023-11-27T17:48:20.035737+0000","last_fullsized":"2023-11-27T17:48:20.035737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178470+0000","last_change":"2023-11-27T17:48:16.176239+0000","last_active":"2023-11-27T17:48:18.178470+0000","last_peered":"2023-11-27T17:48:18.178470+0000","last_clean":"2023-11-27T17:48:18.178470+0000","last_became_active":"2023-11-27T17:48:16.175935+0000","last_became_peered":"2023-11-27T17:48:16.175935+0000","last_unstale":"2023-11-27T17:48:18.178470+0000","last_undegraded":"2023-11-27T17:48:18.178470+0000","last_fullsized":"2023-11-27T17:48:18.178470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:31:17.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180890+0000","last_change":"2023-11-27T17:48:17.192173+0000","last_active":"2023-11-27T17:48:18.180890+0000","last_peered":"2023-11-27T17:48:18.180890+0000","last_clean":"2023-11-27T17:48:18.180890+0000","last_became_active":"2023-11-27T17:48:17.191886+0000","last_became_peered":"2023-11-27T17:48:17.191886+0000","last_unstale":"2023-11-27T17:48:18.180890+0000","last_undegraded":"2023-11-27T17:48:18.180890+0000","last_fullsized":"2023-11-27T17:48:18.180890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:04:59.251403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181348+0000","last_change":"2023-11-27T17:48:16.178737+0000","last_active":"2023-11-27T17:48:18.181348+0000","last_peered":"2023-11-27T17:48:18.181348+0000","last_clean":"2023-11-27T17:48:18.181348+0000","last_became_active":"2023-11-27T17:48:16.178440+0000","last_became_peered":"2023-11-27T17:48:16.178440+0000","last_unstale":"2023-11-27T17:48:18.181348+0000","last_undegraded":"2023-11-27T17:48:18.181348+0000","last_fullsized":"2023-11-27T17:48:18.181348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:46:28.658758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180221+0000","last_change":"2023-11-27T17:48:17.199254+0000","last_active":"2023-11-27T17:48:18.180221+0000","last_peered":"2023-11-27T17:48:18.180221+0000","last_clean":"2023-11-27T17:48:18.180221+0000","last_became_active":"2023-11-27T17:48:17.198787+0000","last_became_peered":"2023-11-27T17:48:17.198787+0000","last_unstale":"2023-11-27T17:48:18.180221+0000","last_undegraded":"2023-11-27T17:48:18.180221+0000","last_fullsized":"2023-11-27T17:48:18.180221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760086+0000","last_change":"2023-11-27T17:48:16.178655+0000","last_active":"2023-11-27T17:48:19.760086+0000","last_peered":"2023-11-27T17:48:19.760086+0000","last_clean":"2023-11-27T17:48:19.760086+0000","last_became_active":"2023-11-27T17:48:16.178370+0000","last_became_peered":"2023-11-27T17:48:16.178370+0000","last_unstale":"2023-11-27T17:48:19.760086+0000","last_undegraded":"2023-11-27T17:48:19.760086+0000","last_fullsized":"2023-11-27T17:48:19.760086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:34.737894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450421+0000","last_change":"2023-11-27T17:48:17.194445+0000","last_active":"2023-11-27T17:48:20.450421+0000","last_peered":"2023-11-27T17:48:20.450421+0000","last_clean":"2023-11-27T17:48:20.450421+0000","last_became_active":"2023-11-27T17:48:17.194134+0000","last_became_peered":"2023-11-27T17:48:17.194134+0000","last_unstale":"2023-11-27T17:48:20.450421+0000","last_undegraded":"2023-11-27T17:48:20.450421+0000","last_fullsized":"2023-11-27T17:48:20.450421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:03.113296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767484+0000","last_change":"2023-11-27T17:48:16.182152+0000","last_active":"2023-11-27T17:48:19.767484+0000","last_peered":"2023-11-27T17:48:19.767484+0000","last_clean":"2023-11-27T17:48:19.767484+0000","last_became_active":"2023-11-27T17:48:16.181769+0000","last_became_peered":"2023-11-27T17:48:16.181769+0000","last_unstale":"2023-11-27T17:48:19.767484+0000","last_undegraded":"2023-11-27T17:48:19.767484+0000","last_fullsized":"2023-11-27T17:48:19.767484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:48.481068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.181152+0000","last_change":"2023-11-27T17:48:17.189104+0000","last_active":"2023-11-27T17:48:18.181152+0000","last_peered":"2023-11-27T17:48:18.181152+0000","last_clean":"2023-11-27T17:48:18.181152+0000","last_became_active":"2023-11-27T17:48:17.188416+0000","last_became_peered":"2023-11-27T17:48:17.188416+0000","last_unstale":"2023-11-27T17:48:18.181152+0000","last_undegraded":"2023-11-27T17:48:18.181152+0000","last_fullsized":"2023-11-27T17:48:18.181152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:01.372177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033151+0000","last_change":"2023-11-27T17:48:17.177845+0000","last_active":"2023-11-27T17:48:20.033151+0000","last_peered":"2023-11-27T17:48:20.033151+0000","last_clean":"2023-11-27T17:48:20.033151+0000","last_became_active":"2023-11-27T17:48:17.177556+0000","last_became_peered":"2023-11-27T17:48:17.177556+0000","last_unstale":"2023-11-27T17:48:20.033151+0000","last_undegraded":"2023-11-27T17:48:20.033151+0000","last_fullsized":"2023-11-27T17:48:20.033151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178490+0000","last_change":"2023-11-27T17:48:16.189008+0000","last_active":"2023-11-27T17:48:18.178490+0000","last_peered":"2023-11-27T17:48:18.178490+0000","last_clean":"2023-11-27T17:48:18.178490+0000","last_became_active":"2023-11-27T17:48:16.188800+0000","last_became_peered":"2023-11-27T17:48:16.188800+0000","last_unstale":"2023-11-27T17:48:18.178490+0000","last_undegraded":"2023-11-27T17:48:18.178490+0000","last_fullsized":"2023-11-27T17:48:18.178490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:57:00.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026519+0000","last_change":"2023-11-27T17:48:17.186845+0000","last_active":"2023-11-27T17:48:19.026519+0000","last_peered":"2023-11-27T17:48:19.026519+0000","last_clean":"2023-11-27T17:48:19.026519+0000","last_became_active":"2023-11-27T17:48:17.186071+0000","last_became_peered":"2023-11-27T17:48:17.186071+0000","last_unstale":"2023-11-27T17:48:19.026519+0000","last_undegraded":"2023-11-27T17:48:19.026519+0000","last_fullsized":"2023-11-27T17:48:19.026519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.767510+0000","last_change":"2023-11-27T17:48:16.183104+0000","last_active":"2023-11-27T17:48:19.767510+0000","last_peered":"2023-11-27T17:48:19.767510+0000","last_clean":"2023-11-27T17:48:19.767510+0000","last_became_active":"2023-11-27T17:48:16.182831+0000","last_became_peered":"2023-11-27T17:48:16.182831+0000","last_unstale":"2023-11-27T17:48:19.767510+0000","last_undegraded":"2023-11-27T17:48:19.767510+0000","last_fullsized":"2023-11-27T17:48:19.767510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:17.177763+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:48:17.177763+0000","last_peered":"2023-11-27T17:48:17.177763+0000","last_clean":"2023-11-27T17:48:17.177763+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:48:17.177763+0000","last_undegraded":"2023-11-27T17:48:17.177763+0000","last_fullsized":"2023-11-27T17:48:17.177763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.348882+0000","last_change":"2023-11-27T17:48:17.179815+0000","last_active":"2023-11-27T17:48:19.348882+0000","last_peered":"2023-11-27T17:48:19.348882+0000","last_clean":"2023-11-27T17:48:19.348882+0000","last_became_active":"2023-11-27T17:48:17.179567+0000","last_became_peered":"2023-11-27T17:48:17.179567+0000","last_unstale":"2023-11-27T17:48:19.348882+0000","last_undegraded":"2023-11-27T17:48:19.348882+0000","last_fullsized":"2023-11-27T17:48:19.348882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:49.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179912+0000","last_change":"2023-11-27T17:48:16.178695+0000","last_active":"2023-11-27T17:48:18.179912+0000","last_peered":"2023-11-27T17:48:18.179912+0000","last_clean":"2023-11-27T17:48:18.179912+0000","last_became_active":"2023-11-27T17:48:16.178387+0000","last_became_peered":"2023-11-27T17:48:16.178387+0000","last_unstale":"2023-11-27T17:48:18.179912+0000","last_undegraded":"2023-11-27T17:48:18.179912+0000","last_fullsized":"2023-11-27T17:48:18.179912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180387+0000","last_change":"2023-11-27T17:48:16.187600+0000","last_active":"2023-11-27T17:48:18.180387+0000","last_peered":"2023-11-27T17:48:18.180387+0000","last_clean":"2023-11-27T17:48:18.180387+0000","last_became_active":"2023-11-27T17:48:16.187268+0000","last_became_peered":"2023-11-27T17:48:16.187268+0000","last_unstale":"2023-11-27T17:48:18.180387+0000","last_undegraded":"2023-11-27T17:48:18.180387+0000","last_fullsized":"2023-11-27T17:48:18.180387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:17.074762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033375+0000","last_change":"2023-11-27T17:48:17.175788+0000","last_active":"2023-11-27T17:48:20.033375+0000","last_peered":"2023-11-27T17:48:20.033375+0000","last_clean":"2023-11-27T17:48:20.033375+0000","last_became_active":"2023-11-27T17:48:17.175498+0000","last_became_peered":"2023-11-27T17:48:17.175498+0000","last_unstale":"2023-11-27T17:48:20.033375+0000","last_undegraded":"2023-11-27T17:48:20.033375+0000","last_fullsized":"2023-11-27T17:48:20.033375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033406+0000","last_change":"2023-11-27T17:48:16.182683+0000","last_active":"2023-11-27T17:48:20.033406+0000","last_peered":"2023-11-27T17:48:20.033406+0000","last_clean":"2023-11-27T17:48:20.033406+0000","last_became_active":"2023-11-27T17:48:16.182410+0000","last_became_peered":"2023-11-27T17:48:16.182410+0000","last_unstale":"2023-11-27T17:48:20.033406+0000","last_undegraded":"2023-11-27T17:48:20.033406+0000","last_fullsized":"2023-11-27T17:48:20.033406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026903+0000","last_change":"2023-11-27T17:48:17.193285+0000","last_active":"2023-11-27T17:48:19.026903+0000","last_peered":"2023-11-27T17:48:19.026903+0000","last_clean":"2023-11-27T17:48:19.026903+0000","last_became_active":"2023-11-27T17:48:17.192965+0000","last_became_peered":"2023-11-27T17:48:17.192965+0000","last_unstale":"2023-11-27T17:48:19.026903+0000","last_undegraded":"2023-11-27T17:48:19.026903+0000","last_fullsized":"2023-11-27T17:48:19.026903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:53:35.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.761826+0000","last_change":"2023-11-27T17:48:16.182590+0000","last_active":"2023-11-27T17:48:19.761826+0000","last_peered":"2023-11-27T17:48:19.761826+0000","last_clean":"2023-11-27T17:48:19.761826+0000","last_became_active":"2023-11-27T17:48:16.182327+0000","last_became_peered":"2023-11-27T17:48:16.182327+0000","last_unstale":"2023-11-27T17:48:19.761826+0000","last_undegraded":"2023-11-27T17:48:19.761826+0000","last_fullsized":"2023-11-27T17:48:19.761826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349130+0000","last_change":"2023-11-27T17:48:17.182568+0000","last_active":"2023-11-27T17:48:19.349130+0000","last_peered":"2023-11-27T17:48:19.349130+0000","last_clean":"2023-11-27T17:48:19.349130+0000","last_became_active":"2023-11-27T17:48:17.182245+0000","last_became_peered":"2023-11-27T17:48:17.182245+0000","last_unstale":"2023-11-27T17:48:19.349130+0000","last_undegraded":"2023-11-27T17:48:19.349130+0000","last_fullsized":"2023-11-27T17:48:19.349130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.179561+0000","last_change":"2023-11-27T17:48:16.188084+0000","last_active":"2023-11-27T17:48:18.179561+0000","last_peered":"2023-11-27T17:48:18.179561+0000","last_clean":"2023-11-27T17:48:18.179561+0000","last_became_active":"2023-11-27T17:48:16.187806+0000","last_became_peered":"2023-11-27T17:48:16.187806+0000","last_unstale":"2023-11-27T17:48:18.179561+0000","last_undegraded":"2023-11-27T17:48:18.179561+0000","last_fullsized":"2023-11-27T17:48:18.179561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:57.362173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180842+0000","last_change":"2023-11-27T17:48:17.175327+0000","last_active":"2023-11-27T17:48:18.180842+0000","last_peered":"2023-11-27T17:48:18.180842+0000","last_clean":"2023-11-27T17:48:18.180842+0000","last_became_active":"2023-11-27T17:48:17.173427+0000","last_became_peered":"2023-11-27T17:48:17.173427+0000","last_unstale":"2023-11-27T17:48:18.180842+0000","last_undegraded":"2023-11-27T17:48:18.180842+0000","last_fullsized":"2023-11-27T17:48:18.180842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:58.369189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760038+0000","last_change":"2023-11-27T17:48:16.181314+0000","last_active":"2023-11-27T17:48:19.760038+0000","last_peered":"2023-11-27T17:48:19.760038+0000","last_clean":"2023-11-27T17:48:19.760038+0000","last_became_active":"2023-11-27T17:48:16.181069+0000","last_became_peered":"2023-11-27T17:48:16.181069+0000","last_unstale":"2023-11-27T17:48:19.760038+0000","last_undegraded":"2023-11-27T17:48:19.760038+0000","last_fullsized":"2023-11-27T17:48:19.760038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:15:47.385160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026499+0000","last_change":"2023-11-27T17:48:17.189442+0000","last_active":"2023-11-27T17:48:19.026499+0000","last_peered":"2023-11-27T17:48:19.026499+0000","last_clean":"2023-11-27T17:48:19.026499+0000","last_became_active":"2023-11-27T17:48:17.188944+0000","last_became_peered":"2023-11-27T17:48:17.188944+0000","last_unstale":"2023-11-27T17:48:19.026499+0000","last_undegraded":"2023-11-27T17:48:19.026499+0000","last_fullsized":"2023-11-27T17:48:19.026499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:37:49.488083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760065+0000","last_change":"2023-11-27T17:48:16.188610+0000","last_active":"2023-11-27T17:48:19.760065+0000","last_peered":"2023-11-27T17:48:19.760065+0000","last_clean":"2023-11-27T17:48:19.760065+0000","last_became_active":"2023-11-27T17:48:16.188323+0000","last_became_peered":"2023-11-27T17:48:16.188323+0000","last_unstale":"2023-11-27T17:48:19.760065+0000","last_undegraded":"2023-11-27T17:48:19.760065+0000","last_fullsized":"2023-11-27T17:48:19.760065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:07:09.462696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.027010+0000","last_change":"2023-11-27T17:48:17.191974+0000","last_active":"2023-11-27T17:48:19.027010+0000","last_peered":"2023-11-27T17:48:19.027010+0000","last_clean":"2023-11-27T17:48:19.027010+0000","last_became_active":"2023-11-27T17:48:17.191681+0000","last_became_peered":"2023-11-27T17:48:17.191681+0000","last_unstale":"2023-11-27T17:48:19.027010+0000","last_undegraded":"2023-11-27T17:48:19.027010+0000","last_fullsized":"2023-11-27T17:48:19.027010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:21:39.552950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180165+0000","last_change":"2023-11-27T17:48:16.186595+0000","last_active":"2023-11-27T17:48:18.180165+0000","last_peered":"2023-11-27T17:48:18.180165+0000","last_clean":"2023-11-27T17:48:18.180165+0000","last_became_active":"2023-11-27T17:48:16.186241+0000","last_became_peered":"2023-11-27T17:48:16.186241+0000","last_unstale":"2023-11-27T17:48:18.180165+0000","last_undegraded":"2023-11-27T17:48:18.180165+0000","last_fullsized":"2023-11-27T17:48:18.180165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:00:48.283552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035901+0000","last_change":"2023-11-27T17:48:17.183997+0000","last_active":"2023-11-27T17:48:20.035901+0000","last_peered":"2023-11-27T17:48:20.035901+0000","last_clean":"2023-11-27T17:48:20.035901+0000","last_became_active":"2023-11-27T17:48:17.183811+0000","last_became_peered":"2023-11-27T17:48:17.183811+0000","last_unstale":"2023-11-27T17:48:20.035901+0000","last_undegraded":"2023-11-27T17:48:20.035901+0000","last_fullsized":"2023-11-27T17:48:20.035901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178737+0000","last_change":"2023-11-27T17:48:16.181997+0000","last_active":"2023-11-27T17:48:18.178737+0000","last_peered":"2023-11-27T17:48:18.178737+0000","last_clean":"2023-11-27T17:48:18.178737+0000","last_became_active":"2023-11-27T17:48:16.181707+0000","last_became_peered":"2023-11-27T17:48:16.181707+0000","last_unstale":"2023-11-27T17:48:18.178737+0000","last_undegraded":"2023-11-27T17:48:18.178737+0000","last_fullsized":"2023-11-27T17:48:18.178737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:40:57.780308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180474+0000","last_change":"2023-11-27T17:48:17.193351+0000","last_active":"2023-11-27T17:48:18.180474+0000","last_peered":"2023-11-27T17:48:18.180474+0000","last_clean":"2023-11-27T17:48:18.180474+0000","last_became_active":"2023-11-27T17:48:17.193076+0000","last_became_peered":"2023-11-27T17:48:17.193076+0000","last_unstale":"2023-11-27T17:48:18.180474+0000","last_undegraded":"2023-11-27T17:48:18.180474+0000","last_fullsized":"2023-11-27T17:48:18.180474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:30:58.565092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.760110+0000","last_change":"2023-11-27T17:48:16.178672+0000","last_active":"2023-11-27T17:48:19.760110+0000","last_peered":"2023-11-27T17:48:19.760110+0000","last_clean":"2023-11-27T17:48:19.760110+0000","last_became_active":"2023-11-27T17:48:16.178391+0000","last_became_peered":"2023-11-27T17:48:16.178391+0000","last_unstale":"2023-11-27T17:48:19.760110+0000","last_undegraded":"2023-11-27T17:48:19.760110+0000","last_fullsized":"2023-11-27T17:48:19.760110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:08.513383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450287+0000","last_change":"2023-11-27T17:48:17.194730+0000","last_active":"2023-11-27T17:48:20.450287+0000","last_peered":"2023-11-27T17:48:20.450287+0000","last_clean":"2023-11-27T17:48:20.450287+0000","last_became_active":"2023-11-27T17:48:17.194183+0000","last_became_peered":"2023-11-27T17:48:17.194183+0000","last_unstale":"2023-11-27T17:48:20.450287+0000","last_undegraded":"2023-11-27T17:48:20.450287+0000","last_fullsized":"2023-11-27T17:48:20.450287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:03:31.321775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178784+0000","last_change":"2023-11-27T17:48:16.188442+0000","last_active":"2023-11-27T17:48:18.178784+0000","last_peered":"2023-11-27T17:48:18.178784+0000","last_clean":"2023-11-27T17:48:18.178784+0000","last_became_active":"2023-11-27T17:48:16.188146+0000","last_became_peered":"2023-11-27T17:48:16.188146+0000","last_unstale":"2023-11-27T17:48:18.178784+0000","last_undegraded":"2023-11-27T17:48:18.178784+0000","last_fullsized":"2023-11-27T17:48:18.178784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:15.150480+0000","last_clean_scrub_stamp":"2023-11-27T17:48:15.150480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:08.552823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.180553+0000","last_change":"2023-11-27T17:48:17.199070+0000","last_active":"2023-11-27T17:48:18.180553+0000","last_peered":"2023-11-27T17:48:18.180553+0000","last_clean":"2023-11-27T17:48:18.180553+0000","last_became_active":"2023-11-27T17:48:17.198789+0000","last_became_peered":"2023-11-27T17:48:17.198789+0000","last_unstale":"2023-11-27T17:48:18.180553+0000","last_undegraded":"2023-11-27T17:48:18.180553+0000","last_fullsized":"2023-11-27T17:48:18.180553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:16.621575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035721+0000","last_change":"2023-11-27T17:48:17.184790+0000","last_active":"2023-11-27T17:48:20.035721+0000","last_peered":"2023-11-27T17:48:20.035721+0000","last_clean":"2023-11-27T17:48:20.035721+0000","last_became_active":"2023-11-27T17:48:17.184506+0000","last_became_peered":"2023-11-27T17:48:17.184506+0000","last_unstale":"2023-11-27T17:48:20.035721+0000","last_undegraded":"2023-11-27T17:48:20.035721+0000","last_fullsized":"2023-11-27T17:48:20.035721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:32:35.744910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:18.178588+0000","last_change":"2023-11-27T17:48:17.178158+0000","last_active":"2023-11-27T17:48:18.178588+0000","last_peered":"2023-11-27T17:48:18.178588+0000","last_clean":"2023-11-27T17:48:18.178588+0000","last_became_active":"2023-11-27T17:48:17.176996+0000","last_became_peered":"2023-11-27T17:48:17.176996+0000","last_unstale":"2023-11-27T17:48:18.178588+0000","last_undegraded":"2023-11-27T17:48:18.178588+0000","last_fullsized":"2023-11-27T17:48:18.178588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:09.520399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450574+0000","last_change":"2023-11-27T17:48:17.194747+0000","last_active":"2023-11-27T17:48:20.450574+0000","last_peered":"2023-11-27T17:48:20.450574+0000","last_clean":"2023-11-27T17:48:20.450574+0000","last_became_active":"2023-11-27T17:48:17.194564+0000","last_became_peered":"2023-11-27T17:48:17.194564+0000","last_unstale":"2023-11-27T17:48:20.450574+0000","last_undegraded":"2023-11-27T17:48:20.450574+0000","last_fullsized":"2023-11-27T17:48:20.450574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:12:54.004348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349197+0000","last_change":"2023-11-27T17:48:17.187682+0000","last_active":"2023-11-27T17:48:19.349197+0000","last_peered":"2023-11-27T17:48:19.349197+0000","last_clean":"2023-11-27T17:48:19.349197+0000","last_became_active":"2023-11-27T17:48:17.187461+0000","last_became_peered":"2023-11-27T17:48:17.187461+0000","last_unstale":"2023-11-27T17:48:19.349197+0000","last_undegraded":"2023-11-27T17:48:19.349197+0000","last_fullsized":"2023-11-27T17:48:19.349197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026758+0000","last_change":"2023-11-27T17:48:17.186202+0000","last_active":"2023-11-27T17:48:19.026758+0000","last_peered":"2023-11-27T17:48:19.026758+0000","last_clean":"2023-11-27T17:48:19.026758+0000","last_became_active":"2023-11-27T17:48:17.185863+0000","last_became_peered":"2023-11-27T17:48:17.185863+0000","last_unstale":"2023-11-27T17:48:19.026758+0000","last_undegraded":"2023-11-27T17:48:19.026758+0000","last_fullsized":"2023-11-27T17:48:19.026758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:09:06.507572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.033360+0000","last_change":"2023-11-27T17:48:17.190715+0000","last_active":"2023-11-27T17:48:20.033360+0000","last_peered":"2023-11-27T17:48:20.033360+0000","last_clean":"2023-11-27T17:48:20.033360+0000","last_became_active":"2023-11-27T17:48:17.190445+0000","last_became_peered":"2023-11-27T17:48:17.190445+0000","last_unstale":"2023-11-27T17:48:20.033360+0000","last_undegraded":"2023-11-27T17:48:20.033360+0000","last_fullsized":"2023-11-27T17:48:20.033360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.036181+0000","last_change":"2023-11-27T17:48:17.194783+0000","last_active":"2023-11-27T17:48:20.036181+0000","last_peered":"2023-11-27T17:48:20.036181+0000","last_clean":"2023-11-27T17:48:20.036181+0000","last_became_active":"2023-11-27T17:48:17.194541+0000","last_became_peered":"2023-11-27T17:48:17.194541+0000","last_unstale":"2023-11-27T17:48:20.036181+0000","last_undegraded":"2023-11-27T17:48:20.036181+0000","last_fullsized":"2023-11-27T17:48:20.036181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:18:28.233353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026895+0000","last_change":"2023-11-27T17:48:17.185329+0000","last_active":"2023-11-27T17:48:19.026895+0000","last_peered":"2023-11-27T17:48:19.026895+0000","last_clean":"2023-11-27T17:48:19.026895+0000","last_became_active":"2023-11-27T17:48:17.185069+0000","last_became_peered":"2023-11-27T17:48:17.185069+0000","last_unstale":"2023-11-27T17:48:19.026895+0000","last_undegraded":"2023-11-27T17:48:19.026895+0000","last_fullsized":"2023-11-27T17:48:19.026895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450112+0000","last_change":"2023-11-27T17:48:17.195514+0000","last_active":"2023-11-27T17:48:20.450112+0000","last_peered":"2023-11-27T17:48:20.450112+0000","last_clean":"2023-11-27T17:48:20.450112+0000","last_became_active":"2023-11-27T17:48:17.195197+0000","last_became_peered":"2023-11-27T17:48:17.195197+0000","last_unstale":"2023-11-27T17:48:20.450112+0000","last_undegraded":"2023-11-27T17:48:20.450112+0000","last_fullsized":"2023-11-27T17:48:20.450112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:21:51.585949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.026425+0000","last_change":"2023-11-27T17:48:17.190515+0000","last_active":"2023-11-27T17:48:19.026425+0000","last_peered":"2023-11-27T17:48:19.026425+0000","last_clean":"2023-11-27T17:48:19.026425+0000","last_became_active":"2023-11-27T17:48:17.190249+0000","last_became_peered":"2023-11-27T17:48:17.190249+0000","last_unstale":"2023-11-27T17:48:19.026425+0000","last_undegraded":"2023-11-27T17:48:19.026425+0000","last_fullsized":"2023-11-27T17:48:19.026425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:56.333301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.450098+0000","last_change":"2023-11-27T17:48:17.193170+0000","last_active":"2023-11-27T17:48:20.450098+0000","last_peered":"2023-11-27T17:48:20.450098+0000","last_clean":"2023-11-27T17:48:20.450098+0000","last_became_active":"2023-11-27T17:48:17.192869+0000","last_became_peered":"2023-11-27T17:48:17.192869+0000","last_unstale":"2023-11-27T17:48:20.450098+0000","last_undegraded":"2023-11-27T17:48:20.450098+0000","last_fullsized":"2023-11-27T17:48:20.450098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:44:05.447933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:19.349111+0000","last_change":"2023-11-27T17:48:17.183735+0000","last_active":"2023-11-27T17:48:19.349111+0000","last_peered":"2023-11-27T17:48:19.349111+0000","last_clean":"2023-11-27T17:48:19.349111+0000","last_became_active":"2023-11-27T17:48:17.183424+0000","last_became_peered":"2023-11-27T17:48:17.183424+0000","last_unstale":"2023-11-27T17:48:19.349111+0000","last_undegraded":"2023-11-27T17:48:19.349111+0000","last_fullsized":"2023-11-27T17:48:19.349111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:15:25.865755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-27T17:48:20.035961+0000","last_change":"2023-11-27T17:48:17.178805+0000","last_active":"2023-11-27T17:48:20.035961+0000","last_peered":"2023-11-27T17:48:20.035961+0000","last_clean":"2023-11-27T17:48:20.035961+0000","last_became_active":"2023-11-27T17:48:17.177473+0000","last_became_peered":"2023-11-27T17:48:17.177473+0000","last_unstale":"2023-11-27T17:48:20.035961+0000","last_undegraded":"2023-11-27T17:48:20.035961+0000","last_fullsized":"2023-11-27T17:48:20.035961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:16.157495+0000","last_clean_scrub_stamp":"2023-11-27T17:48:16.157495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:13:18.081777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:48:26.335 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T17:48:26.335 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-27T17:48:26.336 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-27T17:48:26.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-27T17:48:26.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.487+0000 7fbf71c2c700 1 Processor -- start 2023-11-27T17:48:26.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.487+0000 7fbf71c2c700 1 -- start start 2023-11-27T17:48:26.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.487+0000 7fbf71c2c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf6c0cd300 0x7fbf6c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.487+0000 7fbf71c2c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf6c15c480 0x7fbf6c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.487+0000 7fbf71c2c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c15d550 con 0x7fbf6c159070 2023-11-27T17:48:26.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.487+0000 7fbf71c2c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6c15c940 con 0x7fbf6c0cd300 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.487+0000 7fbf71c2c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c15cc20 con 0x7fbf6c15c480 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.487+0000 7fbf6bfff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fbf6c159070 0x7fbf6c0cdc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46200/0 (socket says 172.21.15.177:46200) 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6bfff700 1 -- 172.21.15.177:0/3394183102 learned_addr learned my addr 172.21.15.177:0/3394183102 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6b7fe700 1 --2- 172.21.15.177:0/3394183102 >> v2:172.21.15.178:3300/0 conn(0x7fbf6c0cd300 0x7fbf6c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6affd700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf6c15c480 0x7fbf6c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480252641 0 0) 0x7fbf6c15d550 con 0x7fbf6c159070 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf580035b0 con 0x7fbf6c159070 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776804491 0 0) 0x7fbf580035b0 con 0x7fbf6c159070 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf6c15c480 msgr2=0x7fbf6c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf6c15c480 0x7fbf6c0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 >> v2:172.21.15.178:3300/0 conn(0x7fbf6c0cd300 msgr2=0x7fbf6c15bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:26.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 --2- 172.21.15.177:0/3394183102 >> v2:172.21.15.178:3300/0 conn(0x7fbf6c0cd300 0x7fbf6c15bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c15cf00 con 0x7fbf6c159070 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fbf640019f0 con 0x7fbf6c159070 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 >> v1:172.21.15.177:6789/0 conn(0x7fbf6c159070 legacy=0x7fbf6c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf58003a00 0x7fbf58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf58004850 0x7fbf58004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf6c15c480 0x7fbf58005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c15c940 con 0x7fbf58003a00 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c15cc20 con 0x7fbf58004850 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5800ba10 con 0x7fbf6c15c480 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6b7fe700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf58003a00 0x7fbf58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6affd700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf58004850 0x7fbf58004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6bfff700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf6c15c480 0x7fbf58005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6b7fe700 1 -- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf6c15c480 msgr2=0x7fbf58005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6b7fe700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf6c15c480 0x7fbf58005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6b7fe700 1 -- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf58004850 msgr2=0x7fbf58004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6b7fe700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf58004850 0x7fbf58004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.488+0000 7fbf6b7fe700 1 -- 172.21.15.177:0/3394183102 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf580035b0 con 0x7fbf58003a00 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf6b7fe700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf58003a00 0x7fbf58003e20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009b60 tx=0x7fbf58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0b36cb186325 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c00e6c0 con 0x7fbf58003a00 2023-11-27T17:48:26.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c00e820 con 0x7fbf58003a00 2023-11-27T17:48:26.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf6a7fc700 1 -- 172.21.15.177:0/3394183102 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c00eb90 con 0x7fbf58003a00 2023-11-27T17:48:26.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf71c2c700 1 -- 172.21.15.177:0/3394183102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf58003a00 msgr2=0x7fbf58003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf71c2c700 1 --2- 172.21.15.177:0/3394183102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf58003a00 0x7fbf58003e20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009b60 tx=0x7fbf58005880 comp rx=0 tx=0).stop 2023-11-27T17:48:26.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf6bfff700 1 -- 172.21.15.177:0/3394183102 reap_dead start 2023-11-27T17:48:26.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf71c2c700 1 -- 172.21.15.177:0/3394183102 shutdown_connections 2023-11-27T17:48:26.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf71c2c700 1 -- 172.21.15.177:0/3394183102 >> 172.21.15.177:0/3394183102 conn(0x7fbf6c0b1ff0 msgr2=0x7fbf6c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:26.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf71c2c700 1 -- 172.21.15.177:0/3394183102 shutdown_connections 2023-11-27T17:48:26.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.489+0000 7fbf71c2c700 1 -- 172.21.15.177:0/3394183102 wait complete. 2023-11-27T17:48:26.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.490+0000 7fbf71c2c700 1 Processor -- start 2023-11-27T17:48:26.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf71c2c700 1 -- start start 2023-11-27T17:48:26.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf71c2c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf58003a00 0x7fbf6c13a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf71c2c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf6c15e3c0 0x7fbf6c138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf71c2c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf6c15e840 0x7fbf6c138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf71c2c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c15a750 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf71c2c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c139d40 con 0x7fbf6c15e840 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf71c2c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c13a710 con 0x7fbf58003a00 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf6affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf6c15e3c0 0x7fbf6c138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf6affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf6c15e3c0 0x7fbf6c138520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51892/0 (socket says 172.21.15.177:51892) 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.491+0000 7fbf6affd700 1 -- 172.21.15.177:0/1424141089 learned_addr learned my addr 172.21.15.177:0/1424141089 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf6bfff700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf6c15e840 0x7fbf6c138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf6b7fe700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf58003a00 0x7fbf6c13a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf6affd700 1 -- 172.21.15.177:0/1424141089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf58003a00 msgr2=0x7fbf6c13a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf6affd700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf58003a00 0x7fbf6c13a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf6affd700 1 -- 172.21.15.177:0/1424141089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf6c15e840 msgr2=0x7fbf6c138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf6affd700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf6c15e840 0x7fbf6c138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf6affd700 1 -- 172.21.15.177:0/1424141089 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c139130 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf6affd700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf6c15e3c0 0x7fbf6c138520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbf54011ad0 tx=0x7fbf54011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf63fff700 1 -- 172.21.15.177:0/1424141089 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400f940 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf63fff700 1 -- 172.21.15.177:0/1424141089 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400faa0 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c139410 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf63fff700 1 -- 172.21.15.177:0/1424141089 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400fe50 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.492+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c1399d0 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.493+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c073aa0 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.493+0000 7fbf63fff700 1 -- 172.21.15.177:0/1424141089 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbf54014440 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.494+0000 7fbf63fff700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf4c06b250 0x7fbf4c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.494+0000 7fbf63fff700 1 -- 172.21.15.177:0/1424141089 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf5408a060 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.494+0000 7fbf6b7fe700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf4c06b250 0x7fbf4c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.494+0000 7fbf6b7fe700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf4c06b250 0x7fbf4c06d710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0090b0 tx=0x7fbf5c01f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.498+0000 7fbf63fff700 1 -- 172.21.15.177:0/1424141089 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbf54054e50 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.734+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbf6c069400 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.734+0000 7fbf63fff700 1 -- 172.21.15.177:0/1424141089 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbf54058470 con 0x7fbf6c15e3c0 2023-11-27T17:48:26.737 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:26.737 INFO:teuthology.orchestra.run.smithi177.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-27T17:48:26.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf4c06b250 msgr2=0x7fbf4c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf4c06b250 0x7fbf4c06d710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0090b0 tx=0x7fbf5c01f040 comp rx=0 tx=0).stop 2023-11-27T17:48:26.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf6c15e3c0 msgr2=0x7fbf6c138520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf6c15e3c0 0x7fbf6c138520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbf54011ad0 tx=0x7fbf54011de0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 shutdown_connections 2023-11-27T17:48:26.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbf4c06b250 0x7fbf4c06d710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf6c15e840 0x7fbf6c138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf58003a00 0x7fbf6c13a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 --2- 172.21.15.177:0/1424141089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf6c15e3c0 0x7fbf6c138520 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 >> 172.21.15.177:0/1424141089 conn(0x7fbf6c0b1ff0 msgr2=0x7fbf6c15d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:26.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 shutdown_connections 2023-11-27T17:48:26.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.736+0000 7fbf71c2c700 1 -- 172.21.15.177:0/1424141089 wait complete. 2023-11-27T17:48:26.751 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-27T17:48:26.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:26.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.868+0000 7fce45dcb700 1 Processor -- start 2023-11-27T17:48:26.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.868+0000 7fce45dcb700 1 -- start start 2023-11-27T17:48:26.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce45dcb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 0x7fce400cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce45dcb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce400cdc20 0x7fce4015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce45dcb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4015d550 con 0x7fce400cd300 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce45dcb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4015c940 con 0x7fce400cdc20 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce45dcb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4015cc20 con 0x7fce40159070 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3ffff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce400cdc20 0x7fce4015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3ffff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce400cdc20 0x7fce4015d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51902/0 (socket says 172.21.15.177:51902) 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3ffff700 1 -- 172.21.15.177:0/2324057238 learned_addr learned my addr 172.21.15.177:0/2324057238 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3effd700 1 --2- 172.21.15.177:0/2324057238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 0x7fce400cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3ffff700 1 -- 172.21.15.177:0/2324057238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 msgr2=0x7fce400cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3ffff700 1 --2- 172.21.15.177:0/2324057238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 0x7fce400cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3ffff700 1 -- 172.21.15.177:0/2324057238 >> v1:172.21.15.178:6789/0 conn(0x7fce400cd300 legacy=0x7fce4015bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3ffff700 1 -- 172.21.15.177:0/2324057238 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4015cf00 con 0x7fce400cdc20 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3ffff700 1 --2- 172.21.15.177:0/2324057238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce4015d9e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fce38009e50 tx=0x7fce3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b737d9c30a96847e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.869+0000 7fce3e7fc700 1 -- 172.21.15.177:0/2324057238 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3800e070 con 0x7fce400cdc20 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce3e7fc700 1 -- 172.21.15.177:0/2324057238 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3800b9c0 con 0x7fce400cdc20 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce3e7fc700 1 -- 172.21.15.177:0/2324057238 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3800bd70 con 0x7fce400cdc20 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce45dcb700 1 -- 172.21.15.177:0/2324057238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 msgr2=0x7fce4015d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce45dcb700 1 --2- 172.21.15.177:0/2324057238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce4015d9e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fce38009e50 tx=0x7fce3800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce45dcb700 1 -- 172.21.15.177:0/2324057238 shutdown_connections 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce45dcb700 1 --2- 172.21.15.177:0/2324057238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce4015d9e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce45dcb700 1 --2- 172.21.15.177:0/2324057238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 0x7fce400cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce45dcb700 1 -- 172.21.15.177:0/2324057238 >> 172.21.15.177:0/2324057238 conn(0x7fce400b1ff0 msgr2=0x7fce400b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:26.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce45dcb700 1 -- 172.21.15.177:0/2324057238 shutdown_connections 2023-11-27T17:48:26.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.870+0000 7fce45dcb700 1 -- 172.21.15.177:0/2324057238 wait complete. 2023-11-27T17:48:26.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.871+0000 7fce45dcb700 1 Processor -- start 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce45dcb700 1 -- start start 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce45dcb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce400cd300 0x7fce401f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce45dcb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce40156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce45dcb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 0x7fce400ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce45dcb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce401586e0 con 0x7fce400cdc20 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce45dcb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce40157640 con 0x7fce400cd300 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce45dcb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce40157920 con 0x7fce40159070 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce3effd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce40156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce3effd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce40156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51906/0 (socket says 172.21.15.177:51906) 2023-11-27T17:48:26.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.872+0000 7fce3effd700 1 -- 172.21.15.177:0/3355734831 learned_addr learned my addr 172.21.15.177:0/3355734831 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce3f7fe700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce400cd300 0x7fce401f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce3ffff700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 0x7fce400ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce3effd700 1 -- 172.21.15.177:0/3355734831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 msgr2=0x7fce400ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce3effd700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 0x7fce400ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce3effd700 1 -- 172.21.15.177:0/3355734831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce400cd300 msgr2=0x7fce401f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce3effd700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce400cd300 0x7fce401f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce3effd700 1 -- 172.21.15.177:0/3355734831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce38009b30 con 0x7fce400cdc20 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce3effd700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce40156b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fce3000d800 tx=0x7fce3000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce27fff700 1 -- 172.21.15.177:0/3355734831 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce300125f0 con 0x7fce400cdc20 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce27fff700 1 -- 172.21.15.177:0/3355734831 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce30012750 con 0x7fce400cdc20 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce27fff700 1 -- 172.21.15.177:0/3355734831 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30012ae0 con 0x7fce400cdc20 2023-11-27T17:48:26.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce40157c00 con 0x7fce400cdc20 2023-11-27T17:48:26.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.873+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce401581c0 con 0x7fce400cdc20 2023-11-27T17:48:26.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.874+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce40158380 con 0x7fce400cdc20 2023-11-27T17:48:26.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.874+0000 7fce27fff700 1 -- 172.21.15.177:0/3355734831 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fce30012c40 con 0x7fce400cdc20 2023-11-27T17:48:26.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.875+0000 7fce27fff700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fce2c06b250 0x7fce2c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:26.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.875+0000 7fce27fff700 1 -- 172.21.15.177:0/3355734831 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce30089d00 con 0x7fce400cdc20 2023-11-27T17:48:26.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.875+0000 7fce3f7fe700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fce2c06b250 0x7fce2c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:26.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.875+0000 7fce3f7fe700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fce2c06b250 0x7fce2c06d710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fce34000f60 tx=0x7fce34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:26.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:26.879+0000 7fce27fff700 1 -- 172.21.15.177:0/3355734831 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fce30054ac0 con 0x7fce400cdc20 2023-11-27T17:48:27.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.071+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce40073aa0 con 0x7fce400cdc20 2023-11-27T17:48:27.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.072+0000 7fce27fff700 1 -- 172.21.15.177:0/3355734831 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fce30081e60 con 0x7fce400cdc20 2023-11-27T17:48:27.074 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:27.074 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:27.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fce2c06b250 msgr2=0x7fce2c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fce2c06b250 0x7fce2c06d710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fce34000f60 tx=0x7fce34009040 comp rx=0 tx=0).stop 2023-11-27T17:48:27.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 msgr2=0x7fce40156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce40156b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fce3000d800 tx=0x7fce3000dbc0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 shutdown_connections 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fce2c06b250 0x7fce2c06d710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce40159070 0x7fce400ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce400cd300 0x7fce401f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 --2- 172.21.15.177:0/3355734831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce400cdc20 0x7fce40156b40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 >> 172.21.15.177:0/3355734831 conn(0x7fce400b1ff0 msgr2=0x7fce4015e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 shutdown_connections 2023-11-27T17:48:27.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.074+0000 7fce45dcb700 1 -- 172.21.15.177:0/3355734831 wait complete. 2023-11-27T17:48:27.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:27.089 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:27.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.211+0000 7f7e23406700 1 Processor -- start 2023-11-27T17:48:27.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.211+0000 7f7e23406700 1 -- start start 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e23406700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e1c146f00 0x7f7e1c162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e23406700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c0afc30 0x7f7e1c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e23406700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c162bc0 con 0x7f7e1c0cde20 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e23406700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c1472e0 con 0x7f7e1c146f00 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e23406700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0ce2a0 con 0x7f7e1c0afc30 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e209a1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c0afc30 0x7f7e1c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e219a3700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f7e1c0cde20 0x7f7e1c0ad860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45210/0 (socket says 172.21.15.177:45210) 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e211a2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e1c146f00 0x7f7e1c162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.212+0000 7f7e219a3700 1 -- 172.21.15.177:0/3696094406 learned_addr learned my addr 172.21.15.177:0/3696094406 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e211a2700 1 -- 172.21.15.177:0/3696094406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c0afc30 msgr2=0x7f7e1c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e211a2700 1 --2- 172.21.15.177:0/3696094406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c0afc30 0x7f7e1c0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e211a2700 1 -- 172.21.15.177:0/3696094406 >> v1:172.21.15.178:6789/0 conn(0x7f7e1c0cde20 legacy=0x7f7e1c0ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e211a2700 1 -- 172.21.15.177:0/3696094406 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0b0110 con 0x7f7e1c146f00 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e211a2700 1 --2- 172.21.15.177:0/3696094406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c146f00 0x7f7e1c162680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009840 tx=0x7f7e0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed61d96fb0a3a86 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e13fff700 1 -- 172.21.15.177:0/3696094406 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c011830 con 0x7f7e1c146f00 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e13fff700 1 -- 172.21.15.177:0/3696094406 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c011990 con 0x7f7e1c146f00 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e13fff700 1 -- 172.21.15.177:0/3696094406 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c011d20 con 0x7f7e1c146f00 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e23406700 1 -- 172.21.15.177:0/3696094406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c146f00 msgr2=0x7f7e1c162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e23406700 1 --2- 172.21.15.177:0/3696094406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c146f00 0x7f7e1c162680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009840 tx=0x7f7e0c009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:27.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e23406700 1 -- 172.21.15.177:0/3696094406 shutdown_connections 2023-11-27T17:48:27.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e23406700 1 --2- 172.21.15.177:0/3696094406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c146f00 0x7f7e1c162680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e23406700 1 --2- 172.21.15.177:0/3696094406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c0afc30 0x7f7e1c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.213+0000 7f7e23406700 1 -- 172.21.15.177:0/3696094406 >> 172.21.15.177:0/3696094406 conn(0x7f7e1c0b38b0 msgr2=0x7f7e1c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:27.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.214+0000 7f7e23406700 1 -- 172.21.15.177:0/3696094406 shutdown_connections 2023-11-27T17:48:27.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.214+0000 7f7e23406700 1 -- 172.21.15.177:0/3696094406 wait complete. 2023-11-27T17:48:27.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.215+0000 7f7e23406700 1 Processor -- start 2023-11-27T17:48:27.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.215+0000 7f7e23406700 1 -- start start 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.215+0000 7f7e23406700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c0afc30 0x7f7e1c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.215+0000 7f7e23406700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c0cde20 0x7f7e1c153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.215+0000 7f7e23406700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c146f00 0x7f7e1c13e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.215+0000 7f7e23406700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c153f70 con 0x7f7e1c0cde20 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.215+0000 7f7e23406700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c161350 con 0x7f7e1c0afc30 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.215+0000 7f7e23406700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c070920 con 0x7f7e1c146f00 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c0cde20 0x7f7e1c153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e211a2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c0afc30 0x7f7e1c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c0cde20 0x7f7e1c153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51918/0 (socket says 172.21.15.177:51918) 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 -- 172.21.15.177:0/3047719104 learned_addr learned my addr 172.21.15.177:0/3047719104 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:27.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e219a3700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c146f00 0x7f7e1c13e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 -- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c146f00 msgr2=0x7f7e1c13e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c146f00 0x7f7e1c13e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 -- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c0afc30 msgr2=0x7f7e1c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c0afc30 0x7f7e1c0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 -- 172.21.15.177:0/3047719104 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0094a0 con 0x7f7e1c0cde20 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e219a3700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c146f00 0x7f7e1c13e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e211a2700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c0afc30 0x7f7e1c0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e209a1700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c0cde20 0x7f7e1c153a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800e870 tx=0x7f7e1800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e11ffb700 1 -- 172.21.15.177:0/3047719104 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18009590 con 0x7f7e1c0cde20 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e11ffb700 1 -- 172.21.15.177:0/3047719104 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18013680 con 0x7f7e1c0cde20 2023-11-27T17:48:27.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c070c00 con 0x7f7e1c0cde20 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e11ffb700 1 -- 172.21.15.177:0/3047719104 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180139f0 con 0x7f7e1c0cde20 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.216+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c0711c0 con 0x7f7e1c0cde20 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.217+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c0d07c0 con 0x7f7e1c0cde20 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.218+0000 7f7e11ffb700 1 -- 172.21.15.177:0/3047719104 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7e18013b50 con 0x7f7e1c0cde20 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.218+0000 7f7e11ffb700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7e0006b250 0x7f7e0006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.218+0000 7f7e11ffb700 1 -- 172.21.15.177:0/3047719104 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e18089860 con 0x7f7e1c0cde20 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.218+0000 7f7e211a2700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7e0006b250 0x7f7e0006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.219+0000 7f7e211a2700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7e0006b250 0x7f7e0006d710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c000c00 tx=0x7f7e0c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.223+0000 7f7e11ffb700 1 -- 172.21.15.177:0/3047719104 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7e18054590 con 0x7f7e1c0cde20 2023-11-27T17:48:27.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.412+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e1c0af590 con 0x7f7e1c0cde20 2023-11-27T17:48:27.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.412+0000 7f7e11ffb700 1 -- 172.21.15.177:0/3047719104 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e180210a0 con 0x7f7e1c0cde20 2023-11-27T17:48:27.415 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7e0006b250 msgr2=0x7f7e0006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7e0006b250 0x7f7e0006d710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c000c00 tx=0x7f7e0c008030 comp rx=0 tx=0).stop 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c0cde20 msgr2=0x7f7e1c153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c0cde20 0x7f7e1c153a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800e870 tx=0x7f7e1800eb80 comp rx=0 tx=0).stop 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 shutdown_connections 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7e0006b250 0x7f7e0006d710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e1c146f00 0x7f7e1c13e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e1c0afc30 0x7f7e1c0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 --2- 172.21.15.177:0/3047719104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e1c0cde20 0x7f7e1c153a30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 >> 172.21.15.177:0/3047719104 conn(0x7f7e1c0b38b0 msgr2=0x7f7e1c141640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:27.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 shutdown_connections 2023-11-27T17:48:27.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.414+0000 7f7e23406700 1 -- 172.21.15.177:0/3047719104 wait complete. 2023-11-27T17:48:27.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:27.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.549+0000 7f4a45c1a700 1 Processor -- start 2023-11-27T17:48:27.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.549+0000 7f4a45c1a700 1 -- start start 2023-11-27T17:48:27.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a45c1a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4a4013eb80 0x7f4a400cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a45c1a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4a4013ef60 0x7f4a401414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a45c1a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a40141e60 con 0x7f4a401419f0 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a45c1a700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4015d420 con 0x7f4a4013eb80 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a45c1a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a400cf720 con 0x7f4a4013ef60 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3f7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4a4013eb80 0x7f4a400cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3f7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4a4013eb80 0x7f4a400cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51924/0 (socket says 172.21.15.177:51924) 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3f7fe700 1 -- 172.21.15.177:0/2176245774 learned_addr learned my addr 172.21.15.177:0/2176245774 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3effd700 1 --2- 172.21.15.177:0/2176245774 >> v2:172.21.15.178:3300/0 conn(0x7f4a4013ef60 0x7f4a401414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3f7fe700 1 -- 172.21.15.177:0/2176245774 >> v2:172.21.15.178:3300/0 conn(0x7f4a4013ef60 msgr2=0x7f4a401414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3f7fe700 1 --2- 172.21.15.177:0/2176245774 >> v2:172.21.15.178:3300/0 conn(0x7f4a4013ef60 0x7f4a401414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3f7fe700 1 -- 172.21.15.177:0/2176245774 >> v1:172.21.15.178:6789/0 conn(0x7f4a401419f0 legacy=0x7f4a4015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3f7fe700 1 -- 172.21.15.177:0/2176245774 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4015d140 con 0x7f4a4013eb80 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.550+0000 7f4a3effd700 1 --2- 172.21.15.177:0/2176245774 >> v2:172.21.15.178:3300/0 conn(0x7f4a4013ef60 0x7f4a401414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:27.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a3f7fe700 1 --2- 172.21.15.177:0/2176245774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a400cf1e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4a400b3180 tx=0x7f4a3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a207f38e67f0c470 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a3e7fc700 1 -- 172.21.15.177:0/2176245774 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800e070 con 0x7f4a4013eb80 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a3e7fc700 1 -- 172.21.15.177:0/2176245774 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38003a20 con 0x7f4a4013eb80 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a3e7fc700 1 -- 172.21.15.177:0/2176245774 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38003dd0 con 0x7f4a4013eb80 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a45c1a700 1 -- 172.21.15.177:0/2176245774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 msgr2=0x7f4a400cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/2176245774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a400cf1e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4a400b3180 tx=0x7f4a3800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a45c1a700 1 -- 172.21.15.177:0/2176245774 shutdown_connections 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/2176245774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a400cf1e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/2176245774 >> v2:172.21.15.178:3300/0 conn(0x7f4a4013ef60 0x7f4a401414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a45c1a700 1 -- 172.21.15.177:0/2176245774 >> 172.21.15.177:0/2176245774 conn(0x7f4a400b31d0 msgr2=0x7f4a400b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a45c1a700 1 -- 172.21.15.177:0/2176245774 shutdown_connections 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.551+0000 7f4a45c1a700 1 -- 172.21.15.177:0/2176245774 wait complete. 2023-11-27T17:48:27.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.552+0000 7f4a45c1a700 1 Processor -- start 2023-11-27T17:48:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a45c1a700 1 -- start start 2023-11-27T17:48:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a45c1a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a40155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a45c1a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a401419f0 0x7f4a4013d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a45c1a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a401e7400 0x7f4a401e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a45c1a700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40159910 con 0x7f4a4013eb80 2023-11-27T17:48:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a45c1a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401e7dd0 con 0x7f4a401419f0 2023-11-27T17:48:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a45c1a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401f4fa0 con 0x7f4a401e7400 2023-11-27T17:48:27.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a3f7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a40155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a3f7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a40155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51928/0 (socket says 172.21.15.177:51928) 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.553+0000 7f4a3f7fe700 1 -- 172.21.15.177:0/1514443130 learned_addr learned my addr 172.21.15.177:0/1514443130 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3effd700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a401419f0 0x7f4a4013d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3ffff700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a401e7400 0x7f4a401e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3f7fe700 1 -- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a401e7400 msgr2=0x7f4a401e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3f7fe700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a401e7400 0x7f4a401e7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3f7fe700 1 -- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a401419f0 msgr2=0x7f4a4013d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3f7fe700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a401419f0 0x7f4a4013d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3f7fe700 1 -- 172.21.15.177:0/1514443130 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38009b30 con 0x7f4a4013eb80 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3effd700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a401419f0 0x7f4a4013d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3ffff700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a401e7400 0x7f4a401e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:27.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a3f7fe700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a40155770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800b730 tx=0x7f4a38004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a37fff700 1 -- 172.21.15.177:0/1514443130 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38004440 con 0x7f4a4013eb80 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a37fff700 1 -- 172.21.15.177:0/1514443130 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a380045a0 con 0x7f4a4013eb80 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a40155cb0 con 0x7f4a4013eb80 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a37fff700 1 -- 172.21.15.177:0/1514443130 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38004950 con 0x7f4a4013eb80 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.554+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a401f54d0 con 0x7f4a4013eb80 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.555+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a40069400 con 0x7f4a4013eb80 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.555+0000 7f4a37fff700 1 -- 172.21.15.177:0/1514443130 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4a38012430 con 0x7f4a4013eb80 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.556+0000 7f4a37fff700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a2006b250 0x7f4a2006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.556+0000 7f4a37fff700 1 -- 172.21.15.177:0/1514443130 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a3808b070 con 0x7f4a4013eb80 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.556+0000 7f4a3effd700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a2006b250 0x7f4a2006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.556+0000 7f4a3effd700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a2006b250 0x7f4a2006d710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a400ce110 tx=0x7f4a28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.560+0000 7f4a37fff700 1 -- 172.21.15.177:0/1514443130 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4a38059840 con 0x7f4a4013eb80 2023-11-27T17:48:27.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.749+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a4015ce80 con 0x7f4a4013eb80 2023-11-27T17:48:27.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.749+0000 7f4a37fff700 1 -- 172.21.15.177:0/1514443130 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a380593d0 con 0x7f4a4013eb80 2023-11-27T17:48:27.751 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a2006b250 msgr2=0x7f4a2006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a2006b250 0x7f4a2006d710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a400ce110 tx=0x7f4a28008040 comp rx=0 tx=0).stop 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 msgr2=0x7f4a40155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a40155770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800b730 tx=0x7f4a38004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 shutdown_connections 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a2006b250 0x7f4a2006d710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a401e7400 0x7f4a401e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a4013eb80 0x7f4a40155770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 --2- 172.21.15.177:0/1514443130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a401419f0 0x7f4a4013d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 >> 172.21.15.177:0/1514443130 conn(0x7f4a400b31d0 msgr2=0x7f4a400d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:27.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 shutdown_connections 2023-11-27T17:48:27.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.751+0000 7f4a45c1a700 1 -- 172.21.15.177:0/1514443130 wait complete. 2023-11-27T17:48:27.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:27.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.887+0000 7f5cb4cdb700 1 Processor -- start 2023-11-27T17:48:27.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.887+0000 7f5cb4cdb700 1 -- start start 2023-11-27T17:48:27.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cb4cdb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5cb013ef60 0x7f5cb01414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cb4cdb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb0141e80 con 0x7f5cb013eb80 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cb4cdb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb015d140 con 0x7f5cb01419f0 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cb4cdb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb015d420 con 0x7f5cb013ef60 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cadd9b700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5cb013ef60 0x7f5cb01414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cadd9b700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5cb013ef60 0x7f5cb01414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51938/0 (socket says 172.21.15.177:51938) 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cae59c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5cb013eb80 0x7f5cb00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46254/0 (socket says 172.21.15.177:46254) 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cadd9b700 1 -- 172.21.15.177:0/2547799546 learned_addr learned my addr 172.21.15.177:0/2547799546 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cadd9b700 1 -- 172.21.15.177:0/2547799546 >> v1:172.21.15.178:6789/0 conn(0x7f5cb01419f0 legacy=0x7f5cb015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cadd9b700 1 -- 172.21.15.177:0/2547799546 >> v1:172.21.15.177:6789/0 conn(0x7f5cb013eb80 legacy=0x7f5cb00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cadd9b700 1 -- 172.21.15.177:0/2547799546 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb00ce700 con 0x7f5cb013ef60 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cad59a700 1 -- 172.21.15.177:0/2547799546 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726943129 0 0) 0x7f5cb0141e80 con 0x7f5cb013eb80 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cadd9b700 1 --2- 172.21.15.177:0/2547799546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb013ef60 0x7f5cb01414b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00098f0 tx=0x7f5ca0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd4048dfd9f517a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cad59a700 1 -- 172.21.15.177:0/2547799546 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca000b8a0 con 0x7f5cb013ef60 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cad59a700 1 -- 172.21.15.177:0/2547799546 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca000ba00 con 0x7f5cb013ef60 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.888+0000 7f5cad59a700 1 -- 172.21.15.177:0/2547799546 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca000bd90 con 0x7f5cb013ef60 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.889+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/2547799546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb013ef60 msgr2=0x7f5cb01414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.889+0000 7f5cb4cdb700 1 --2- 172.21.15.177:0/2547799546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb013ef60 0x7f5cb01414b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00098f0 tx=0x7f5ca0009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.889+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/2547799546 shutdown_connections 2023-11-27T17:48:27.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.889+0000 7f5cb4cdb700 1 --2- 172.21.15.177:0/2547799546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb013ef60 0x7f5cb01414b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.889+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/2547799546 >> 172.21.15.177:0/2547799546 conn(0x7f5cb00b31d0 msgr2=0x7f5cb00b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.889+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/2547799546 shutdown_connections 2023-11-27T17:48:27.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.889+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/2547799546 wait complete. 2023-11-27T17:48:27.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.890+0000 7f5cb4cdb700 1 Processor -- start 2023-11-27T17:48:27.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.890+0000 7f5cb4cdb700 1 -- start start 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cb4cdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cb013eb80 0x7f5cb0130e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cb4cdb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb01419f0 0x7f5cb00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cb4cdb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb0153650 0x7f5cb012b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cb4cdb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0156d20 con 0x7f5cb0153650 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cb4cdb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0129e30 con 0x7f5cb01419f0 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cb4cdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb012a110 con 0x7f5cb013eb80 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5caed9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb0153650 0x7f5cb012b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5caed9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb0153650 0x7f5cb012b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51946/0 (socket says 172.21.15.177:51946) 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5caed9d700 1 -- 172.21.15.177:0/3386309884 learned_addr learned my addr 172.21.15.177:0/3386309884 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cae59c700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cb013eb80 0x7f5cb0130e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cadd9b700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb01419f0 0x7f5cb00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5caed9d700 1 -- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cb013eb80 msgr2=0x7f5cb0130e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5caed9d700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cb013eb80 0x7f5cb0130e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5caed9d700 1 -- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb01419f0 msgr2=0x7f5cb00b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5caed9d700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb01419f0 0x7f5cb00b7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5caed9d700 1 -- 172.21.15.177:0/3386309884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0009550 con 0x7f5cb0153650 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cadd9b700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb01419f0 0x7f5cb00b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.891+0000 7f5cae59c700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cb013eb80 0x7f5cb0130e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.892+0000 7f5caed9d700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb0153650 0x7f5cb012b320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800cb80 tx=0x7f5ca800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.892+0000 7f5c9effd700 1 -- 172.21.15.177:0/3386309884 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8003c00 con 0x7f5cb0153650 2023-11-27T17:48:27.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.892+0000 7f5c9effd700 1 -- 172.21.15.177:0/3386309884 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8003d60 con 0x7f5cb0153650 2023-11-27T17:48:27.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.892+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb0155d60 con 0x7f5cb0153650 2023-11-27T17:48:27.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.892+0000 7f5c9effd700 1 -- 172.21.15.177:0/3386309884 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800ab50 con 0x7f5cb0153650 2023-11-27T17:48:27.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.892+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb0156320 con 0x7f5cb0153650 2023-11-27T17:48:27.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.893+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb0069400 con 0x7f5cb0153650 2023-11-27T17:48:27.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.893+0000 7f5c9effd700 1 -- 172.21.15.177:0/3386309884 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5ca800acb0 con 0x7f5cb0153650 2023-11-27T17:48:27.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.893+0000 7f5c9effd700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c9006b250 0x7f5c9006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:27.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.894+0000 7f5c9effd700 1 -- 172.21.15.177:0/3386309884 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ca8089a50 con 0x7f5cb0153650 2023-11-27T17:48:27.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.894+0000 7f5cae59c700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c9006b250 0x7f5c9006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:27.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.894+0000 7f5cae59c700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c9006b250 0x7f5c9006d710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4000f60 tx=0x7f5ca4007ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:27.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:27.898+0000 7f5c9effd700 1 -- 172.21.15.177:0/3386309884 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5ca8054770 con 0x7f5cb0153650 2023-11-27T17:48:28.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.088+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5cb00b5c90 con 0x7f5cb0153650 2023-11-27T17:48:28.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.089+0000 7f5c9effd700 1 -- 172.21.15.177:0/3386309884 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ca8057d90 con 0x7f5cb0153650 2023-11-27T17:48:28.092 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:28.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c9006b250 msgr2=0x7f5c9006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c9006b250 0x7f5c9006d710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4000f60 tx=0x7f5ca4007ce0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb0153650 msgr2=0x7f5cb012b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb0153650 0x7f5cb012b320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800cb80 tx=0x7f5ca800cf40 comp rx=0 tx=0).stop 2023-11-27T17:48:28.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 shutdown_connections 2023-11-27T17:48:28.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c9006b250 0x7f5c9006d710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cb0153650 0x7f5cb012b320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cb013eb80 0x7f5cb0130e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 --2- 172.21.15.177:0/3386309884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb01419f0 0x7f5cb00b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 >> 172.21.15.177:0/3386309884 conn(0x7f5cb00b31d0 msgr2=0x7f5cb015c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:28.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 shutdown_connections 2023-11-27T17:48:28.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.091+0000 7f5cb4cdb700 1 -- 172.21.15.177:0/3386309884 wait complete. 2023-11-27T17:48:28.106 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:28.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.223+0000 7f15abbcb700 1 Processor -- start 2023-11-27T17:48:28.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.223+0000 7f15abbcb700 1 -- start start 2023-11-27T17:48:28.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15abbcb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15a406d910 0x7f15a406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15abbcb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f15a415e880 0x7f15a40b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15abbcb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a406e520 con 0x7f15a406dcf0 2023-11-27T17:48:28.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15abbcb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a406efc0 con 0x7f15a406d910 2023-11-27T17:48:28.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15abbcb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a406f2a0 con 0x7f15a415e880 2023-11-27T17:48:28.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9967700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15a406d910 0x7f15a406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9967700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15a406d910 0x7f15a406e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51950/0 (socket says 172.21.15.177:51950) 2023-11-27T17:48:28.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9967700 1 -- 172.21.15.177:0/1295160979 learned_addr learned my addr 172.21.15.177:0/1295160979 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:28.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9166700 1 --2- 172.21.15.177:0/1295160979 >> v2:172.21.15.178:3300/0 conn(0x7f15a415e880 0x7f15a40b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9967700 1 -- 172.21.15.177:0/1295160979 >> v2:172.21.15.178:3300/0 conn(0x7f15a415e880 msgr2=0x7f15a40b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9967700 1 --2- 172.21.15.177:0/1295160979 >> v2:172.21.15.178:3300/0 conn(0x7f15a415e880 0x7f15a40b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9967700 1 -- 172.21.15.177:0/1295160979 >> v1:172.21.15.178:6789/0 conn(0x7f15a406dcf0 legacy=0x7f15a40b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9967700 1 -- 172.21.15.177:0/1295160979 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a406f580 con 0x7f15a406d910 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a9967700 1 --2- 172.21.15.177:0/1295160979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a406d910 0x7f15a406e8c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f15a40b5530 tx=0x7f15a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858ba60c9058b9a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.224+0000 7f15a8965700 1 -- 172.21.15.177:0/1295160979 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000b870 con 0x7f15a406d910 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15a8965700 1 -- 172.21.15.177:0/1295160979 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a000b9d0 con 0x7f15a406d910 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15a8965700 1 -- 172.21.15.177:0/1295160979 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000bd60 con 0x7f15a406d910 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15abbcb700 1 -- 172.21.15.177:0/1295160979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a406d910 msgr2=0x7f15a406e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15abbcb700 1 --2- 172.21.15.177:0/1295160979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a406d910 0x7f15a406e8c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f15a40b5530 tx=0x7f15a0009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15abbcb700 1 -- 172.21.15.177:0/1295160979 shutdown_connections 2023-11-27T17:48:28.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15abbcb700 1 --2- 172.21.15.177:0/1295160979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a406d910 0x7f15a406e8c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15abbcb700 1 --2- 172.21.15.177:0/1295160979 >> v2:172.21.15.178:3300/0 conn(0x7f15a415e880 0x7f15a40b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15abbcb700 1 -- 172.21.15.177:0/1295160979 >> 172.21.15.177:0/1295160979 conn(0x7f15a40b2130 msgr2=0x7f15a40b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:28.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15abbcb700 1 -- 172.21.15.177:0/1295160979 shutdown_connections 2023-11-27T17:48:28.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.225+0000 7f15abbcb700 1 -- 172.21.15.177:0/1295160979 wait complete. 2023-11-27T17:48:28.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.226+0000 7f15abbcb700 1 Processor -- start 2023-11-27T17:48:28.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.226+0000 7f15abbcb700 1 -- start start 2023-11-27T17:48:28.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15abbcb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a406d910 0x7f15a40728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15abbcb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15a406dcf0 0x7f15a40a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15abbcb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a415e880 0x7f15a41558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15abbcb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4152b90 con 0x7f15a415e880 2023-11-27T17:48:28.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15abbcb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4152e70 con 0x7f15a406d910 2023-11-27T17:48:28.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15abbcb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4153150 con 0x7f15a406dcf0 2023-11-27T17:48:28.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15aa168700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a415e880 0x7f15a41558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15aa168700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a415e880 0x7f15a41558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51960/0 (socket says 172.21.15.177:51960) 2023-11-27T17:48:28.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15aa168700 1 -- 172.21.15.177:0/2787643662 learned_addr learned my addr 172.21.15.177:0/2787643662 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:28.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15a9166700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15a406dcf0 0x7f15a40a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15a9967700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a406d910 0x7f15a40728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15aa168700 1 -- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15a406dcf0 msgr2=0x7f15a40a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15aa168700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15a406dcf0 0x7f15a40a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15aa168700 1 -- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a406d910 msgr2=0x7f15a40728f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.227+0000 7f15aa168700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a406d910 0x7f15a40728f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.228+0000 7f15aa168700 1 -- 172.21.15.177:0/2787643662 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0009550 con 0x7f15a415e880 2023-11-27T17:48:28.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.228+0000 7f15a9967700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a406d910 0x7f15a40728f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:28.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.228+0000 7f15aa168700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a415e880 0x7f15a41558c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f159c00cc50 tx=0x7f159c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.228+0000 7f159a7fc700 1 -- 172.21.15.177:0/2787643662 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00ad80 con 0x7f15a415e880 2023-11-27T17:48:28.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.228+0000 7f159a7fc700 1 -- 172.21.15.177:0/2787643662 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00ce50 con 0x7f15a415e880 2023-11-27T17:48:28.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.228+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a4153430 con 0x7f15a415e880 2023-11-27T17:48:28.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.228+0000 7f159a7fc700 1 -- 172.21.15.177:0/2787643662 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c003c40 con 0x7f15a415e880 2023-11-27T17:48:28.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.228+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a4153c30 con 0x7f15a415e880 2023-11-27T17:48:28.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.229+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a4073aa0 con 0x7f15a415e880 2023-11-27T17:48:28.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.229+0000 7f159a7fc700 1 -- 172.21.15.177:0/2787643662 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f159c0050d0 con 0x7f15a415e880 2023-11-27T17:48:28.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.229+0000 7f159a7fc700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f158806b250 0x7f158806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.230+0000 7f159a7fc700 1 -- 172.21.15.177:0/2787643662 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f159c089a30 con 0x7f15a415e880 2023-11-27T17:48:28.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.230+0000 7f15a9967700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f158806b250 0x7f158806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.230+0000 7f15a9967700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f158806b250 0x7f158806d710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009130 tx=0x7f15a0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.234+0000 7f159a7fc700 1 -- 172.21.15.177:0/2787643662 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f159c0547f0 con 0x7f15a415e880 2023-11-27T17:48:28.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.469+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15a4069400 con 0x7f15a415e880 2023-11-27T17:48:28.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.470+0000 7f159a7fc700 1 -- 172.21.15.177:0/2787643662 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f159c057e10 con 0x7f15a415e880 2023-11-27T17:48:28.472 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:28.472 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:48:16.563848+0000","modified":"2023-11-27T17:48:19.576268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:48:28.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f158806b250 msgr2=0x7f158806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f158806b250 0x7f158806d710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009130 tx=0x7f15a0008030 comp rx=0 tx=0).stop 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a415e880 msgr2=0x7f15a41558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a415e880 0x7f15a41558c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f159c00cc50 tx=0x7f159c00a340 comp rx=0 tx=0).stop 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 shutdown_connections 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f158806b250 0x7f158806d710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15a415e880 0x7f15a41558c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a406d910 0x7f15a40728f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 --2- 172.21.15.177:0/2787643662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15a406dcf0 0x7f15a40a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 >> 172.21.15.177:0/2787643662 conn(0x7f15a40b2130 msgr2=0x7f15a415a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 shutdown_connections 2023-11-27T17:48:28.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.472+0000 7f15abbcb700 1 -- 172.21.15.177:0/2787643662 wait complete. 2023-11-27T17:48:28.476 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-27T17:48:28.486 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:28.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.604+0000 7fb067aac700 1 Processor -- start 2023-11-27T17:48:28.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.605+0000 7fb067aac700 1 -- start start 2023-11-27T17:48:28.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.605+0000 7fb067aac700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb06015df10 0x7fb0600d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.605+0000 7fb067aac700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb06015e2f0 0x7fb0600d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.605+0000 7fb067aac700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0600b21c0 0x7fb0600b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.605+0000 7fb067aac700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb060161e00 con 0x7fb06015e2f0 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.605+0000 7fb067aac700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0601620e0 con 0x7fb06015df10 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.605+0000 7fb067aac700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0601623c0 con 0x7fb0600b21c0 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb06015e2f0 0x7fb0600d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb06015e2f0 0x7fb0600d17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51966/0 (socket says 172.21.15.177:51966) 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 -- 172.21.15.177:0/3148519252 learned_addr learned my addr 172.21.15.177:0/3148519252 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:28.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb066049700 1 --2- 172.21.15.177:0/3148519252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0600b21c0 0x7fb0600b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065848700 1 --2- 172.21.15.177:0/3148519252 >> v2:172.21.15.178:3300/0 conn(0x7fb06015df10 0x7fb0600d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 -- 172.21.15.177:0/3148519252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0600b21c0 msgr2=0x7fb0600b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 --2- 172.21.15.177:0/3148519252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0600b21c0 0x7fb0600b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 -- 172.21.15.177:0/3148519252 >> v2:172.21.15.178:3300/0 conn(0x7fb06015df10 msgr2=0x7fb0600d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 --2- 172.21.15.177:0/3148519252 >> v2:172.21.15.178:3300/0 conn(0x7fb06015df10 0x7fb0600d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 -- 172.21.15.177:0/3148519252 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0601626a0 con 0x7fb06015e2f0 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb066049700 1 --2- 172.21.15.177:0/3148519252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0600b21c0 0x7fb0600b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065848700 1 --2- 172.21.15.177:0/3148519252 >> v2:172.21.15.178:3300/0 conn(0x7fb06015df10 0x7fb0600d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb065047700 1 --2- 172.21.15.177:0/3148519252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb06015e2f0 0x7fb0600d17c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0600b4ae0 tx=0x7fb054009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d41d40d24c2fec server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb064846700 1 -- 172.21.15.177:0/3148519252 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05400b870 con 0x7fb06015e2f0 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb064846700 1 -- 172.21.15.177:0/3148519252 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05400b9d0 con 0x7fb06015e2f0 2023-11-27T17:48:28.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.606+0000 7fb064846700 1 -- 172.21.15.177:0/3148519252 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05400bd60 con 0x7fb06015e2f0 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 -- 172.21.15.177:0/3148519252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb06015e2f0 msgr2=0x7fb0600d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 --2- 172.21.15.177:0/3148519252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb06015e2f0 0x7fb0600d17c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0600b4ae0 tx=0x7fb054009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 -- 172.21.15.177:0/3148519252 shutdown_connections 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 --2- 172.21.15.177:0/3148519252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0600b21c0 0x7fb0600b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 --2- 172.21.15.177:0/3148519252 >> v2:172.21.15.178:3300/0 conn(0x7fb06015df10 0x7fb0600d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 --2- 172.21.15.177:0/3148519252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb06015e2f0 0x7fb0600d17c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 -- 172.21.15.177:0/3148519252 >> 172.21.15.177:0/3148519252 conn(0x7fb060072190 msgr2=0x7fb0600725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 -- 172.21.15.177:0/3148519252 shutdown_connections 2023-11-27T17:48:28.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.607+0000 7fb067aac700 1 -- 172.21.15.177:0/3148519252 wait complete. 2023-11-27T17:48:28.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.608+0000 7fb067aac700 1 Processor -- start 2023-11-27T17:48:28.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.608+0000 7fb067aac700 1 -- start start 2023-11-27T17:48:28.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb067aac700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0600b21c0 0x7fb06015e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb067aac700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06015df10 0x7fb060159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb067aac700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06015e2f0 0x7fb0600cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb067aac700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06015f880 con 0x7fb0600b21c0 2023-11-27T17:48:28.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb067aac700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0601f39e0 con 0x7fb06015df10 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb067aac700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06015efe0 con 0x7fb06015e2f0 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0600b21c0 0x7fb06015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0600b21c0 0x7fb06015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51970/0 (socket says 172.21.15.177:51970) 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 -- 172.21.15.177:0/3292235187 learned_addr learned my addr 172.21.15.177:0/3292235187 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb066049700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06015e2f0 0x7fb0600cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 -- 172.21.15.177:0/3292235187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06015e2f0 msgr2=0x7fb0600cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065047700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06015df10 0x7fb060159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06015e2f0 0x7fb0600cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 -- 172.21.15.177:0/3292235187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06015df10 msgr2=0x7fb060159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06015df10 0x7fb060159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 -- 172.21.15.177:0/3292235187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb054009550 con 0x7fb0600b21c0 2023-11-27T17:48:28.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb065848700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0600b21c0 0x7fb06015e790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00c750 tx=0x7fb05c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb0527fc700 1 -- 172.21.15.177:0/3292235187 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011800 con 0x7fb0600b21c0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb0527fc700 1 -- 172.21.15.177:0/3292235187 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c011960 con 0x7fb0600b21c0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06015f2c0 con 0x7fb0600b21c0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb0527fc700 1 -- 172.21.15.177:0/3292235187 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011cd0 con 0x7fb0600b21c0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.609+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06014f570 con 0x7fb0600b21c0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.610+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06014f8e0 con 0x7fb0600b21c0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.611+0000 7fb0527fc700 1 -- 172.21.15.177:0/3292235187 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb05c021350 con 0x7fb0600b21c0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.611+0000 7fb0527fc700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb04406b250 0x7fb04406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.611+0000 7fb065047700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb04406b250 0x7fb04406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.611+0000 7fb0527fc700 1 -- 172.21.15.177:0/3292235187 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb05c089960 con 0x7fb0600b21c0 2023-11-27T17:48:28.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.612+0000 7fb065047700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb04406b250 0x7fb04406d710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb06015e760 tx=0x7fb054008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.616+0000 7fb0527fc700 1 -- 172.21.15.177:0/3292235187 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb05c054720 con 0x7fb0600b21c0 2023-11-27T17:48:28.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.806+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb060073aa0 con 0x7fb0600b21c0 2023-11-27T17:48:28.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.807+0000 7fb0527fc700 1 -- 172.21.15.177:0/3292235187 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fb05c01e090 con 0x7fb0600b21c0 2023-11-27T17:48:28.809 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:28.810 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:28.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb04406b250 msgr2=0x7fb04406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb04406b250 0x7fb04406d710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb06015e760 tx=0x7fb054008030 comp rx=0 tx=0).stop 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0600b21c0 msgr2=0x7fb06015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0600b21c0 0x7fb06015e790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00c750 tx=0x7fb05c00cb10 comp rx=0 tx=0).stop 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 shutdown_connections 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb04406b250 0x7fb04406d710 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06015e2f0 0x7fb0600cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0600b21c0 0x7fb06015e790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 --2- 172.21.15.177:0/3292235187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06015df10 0x7fb060159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 >> 172.21.15.177:0/3292235187 conn(0x7fb060072190 msgr2=0x7fb0600ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 shutdown_connections 2023-11-27T17:48:28.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.809+0000 7fb067aac700 1 -- 172.21.15.177:0/3292235187 wait complete. 2023-11-27T17:48:28.824 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:28.824 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:28.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.944+0000 7fd478169700 1 Processor -- start 2023-11-27T17:48:28.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.944+0000 7fd478169700 1 -- start start 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd478169700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd470146f00 0x7fd470162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd478169700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4700afc30 0x7fd4700cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd478169700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd470162bc0 con 0x7fd4700cde20 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd478169700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4701472e0 con 0x7fd470146f00 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd478169700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700ce2a0 con 0x7fd4700afc30 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd476706700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd4700cde20 0x7fd4700ad860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46298/0 (socket says 172.21.15.177:46298) 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd476706700 1 -- 172.21.15.177:0/1375229113 learned_addr learned my addr 172.21.15.177:0/1375229113 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd475f05700 1 --2- 172.21.15.177:0/1375229113 >> v2:172.21.15.178:3300/0 conn(0x7fd470146f00 0x7fd470162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd475704700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4700afc30 0x7fd4700cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969207623 0 0) 0x7fd470162bc0 con 0x7fd4700cde20 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.945+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd45c0035b0 con 0x7fd4700cde20 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 86473212 0 0) 0x7fd45c0035b0 con 0x7fd4700cde20 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4700afc30 msgr2=0x7fd4700cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4700afc30 0x7fd4700cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 >> v2:172.21.15.178:3300/0 conn(0x7fd470146f00 msgr2=0x7fd470162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 --2- 172.21.15.177:0/1375229113 >> v2:172.21.15.178:3300/0 conn(0x7fd470146f00 0x7fd470162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4700b0110 con 0x7fd4700cde20 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fd4680019f0 con 0x7fd4700cde20 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 >> v1:172.21.15.177:6789/0 conn(0x7fd4700cde20 legacy=0x7fd4700ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd45c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4700afc30 0x7fd45c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd45c004d90 0x7fd45c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4701472e0 con 0x7fd45c003a00 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700ce2a0 con 0x7fd45c004d90 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c00ba10 con 0x7fd4700afc30 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd475f05700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd45c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd476706700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd45c004d90 0x7fd45c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd475704700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4700afc30 0x7fd45c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd475f05700 1 -- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4700afc30 msgr2=0x7fd45c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd475f05700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4700afc30 0x7fd45c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd475f05700 1 -- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd45c004d90 msgr2=0x7fd45c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd475f05700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd45c004d90 0x7fd45c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd475f05700 1 -- 172.21.15.177:0/1375229113 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c0035b0 con 0x7fd45c003a00 2023-11-27T17:48:28.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd475f05700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd45c003e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd460009b60 tx=0x7fd45c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2ab934c1237d1e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000e6c0 con 0x7fd45c003a00 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46000e820 con 0x7fd45c003a00 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.946+0000 7fd474f03700 1 -- 172.21.15.177:0/1375229113 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000eb90 con 0x7fd45c003a00 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.947+0000 7fd478169700 1 -- 172.21.15.177:0/1375229113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 msgr2=0x7fd45c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.947+0000 7fd478169700 1 --2- 172.21.15.177:0/1375229113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd45c003e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd460009b60 tx=0x7fd45c005880 comp rx=0 tx=0).stop 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.947+0000 7fd476706700 1 -- 172.21.15.177:0/1375229113 reap_dead start 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.947+0000 7fd478169700 1 -- 172.21.15.177:0/1375229113 shutdown_connections 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.947+0000 7fd478169700 1 -- 172.21.15.177:0/1375229113 >> 172.21.15.177:0/1375229113 conn(0x7fd4700b38b0 msgr2=0x7fd4700b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.947+0000 7fd478169700 1 -- 172.21.15.177:0/1375229113 shutdown_connections 2023-11-27T17:48:28.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.947+0000 7fd478169700 1 -- 172.21.15.177:0/1375229113 wait complete. 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.948+0000 7fd478169700 1 Processor -- start 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.948+0000 7fd478169700 1 -- start start 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd478169700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd470145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd478169700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd470161c30 0x7fd4701620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd478169700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4700704f0 0x7fd4700709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd478169700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4701625f0 con 0x7fd45c003a00 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd478169700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700711e0 con 0x7fd4700704f0 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd478169700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700714c0 con 0x7fd470161c30 2023-11-27T17:48:28.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd470145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd470145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51992/0 (socket says 172.21.15.177:51992) 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 -- 172.21.15.177:0/2511371636 learned_addr learned my addr 172.21.15.177:0/2511371636 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475704700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd470161c30 0x7fd4701620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd476706700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4700704f0 0x7fd4700709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 -- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd470161c30 msgr2=0x7fd4701620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd470161c30 0x7fd4701620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 -- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4700704f0 msgr2=0x7fd4700709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4700704f0 0x7fd4700709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 -- 172.21.15.177:0/2511371636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4700717a0 con 0x7fd45c003a00 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd476706700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4700704f0 0x7fd4700709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475704700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd470161c30 0x7fd4701620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:28.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.949+0000 7fd475f05700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd470145150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0046e0 tx=0x7fd4600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.950+0000 7fd4667fc700 1 -- 172.21.15.177:0/2511371636 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460021070 con 0x7fd45c003a00 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.950+0000 7fd4667fc700 1 -- 172.21.15.177:0/2511371636 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4600045d0 con 0x7fd45c003a00 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.950+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd470071a80 con 0x7fd45c003a00 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.950+0000 7fd4667fc700 1 -- 172.21.15.177:0/2511371636 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000e6c0 con 0x7fd45c003a00 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.950+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd470070ee0 con 0x7fd45c003a00 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.950+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd470069400 con 0x7fd45c003a00 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.951+0000 7fd4667fc700 1 -- 172.21.15.177:0/2511371636 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd460025070 con 0x7fd45c003a00 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.951+0000 7fd4667fc700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd45406b250 0x7fd45406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.952+0000 7fd475704700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd45406b250 0x7fd45406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.952+0000 7fd4667fc700 1 -- 172.21.15.177:0/2511371636 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd46008aa60 con 0x7fd45c003a00 2023-11-27T17:48:28.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.952+0000 7fd475704700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd45406b250 0x7fd45406d710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd4701f7090 tx=0x7fd46c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:28.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:28.956+0000 7fd4667fc700 1 -- 172.21.15.177:0/2511371636 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd460055820 con 0x7fd45c003a00 2023-11-27T17:48:29.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.145+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd47006f4a0 con 0x7fd45c003a00 2023-11-27T17:48:29.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.146+0000 7fd4667fc700 1 -- 172.21.15.177:0/2511371636 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd46002c0a0 con 0x7fd45c003a00 2023-11-27T17:48:29.148 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:29.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd45406b250 msgr2=0x7fd45406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd45406b250 0x7fd45406d710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd4701f7090 tx=0x7fd46c008040 comp rx=0 tx=0).stop 2023-11-27T17:48:29.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 msgr2=0x7fd470145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd470145150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0046e0 tx=0x7fd4600047c0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 shutdown_connections 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fd45406b250 0x7fd45406d710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4700704f0 0x7fd4700709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45c003a00 0x7fd470145150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 --2- 172.21.15.177:0/2511371636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd470161c30 0x7fd4701620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 >> 172.21.15.177:0/2511371636 conn(0x7fd4700b38b0 msgr2=0x7fd4700ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 shutdown_connections 2023-11-27T17:48:29.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.148+0000 7fd478169700 1 -- 172.21.15.177:0/2511371636 wait complete. 2023-11-27T17:48:29.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:29.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.283+0000 7fcba09c9700 1 Processor -- start 2023-11-27T17:48:29.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.283+0000 7fcba09c9700 1 -- start start 2023-11-27T17:48:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcba09c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c146f00 0x7fcb9c162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcba09c9700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c162bc0 con 0x7fcb9c0cdff0 2023-11-27T17:48:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcba09c9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c0b0110 con 0x7fcb9c0afc30 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcba09c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c1472e0 con 0x7fcb9c146f00 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9ad9d700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fcb9c0cdff0 0x7fcb9c0cef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46320/0 (socket says 172.21.15.177:46320) 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9ad9d700 1 -- 172.21.15.177:0/1522616552 learned_addr learned my addr 172.21.15.177:0/1522616552 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9a59c700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c146f00 0x7fcb9c162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222439023 0 0) 0x7fcb9c162bc0 con 0x7fcb9c0cdff0 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb840035b0 con 0x7fcb9c0cdff0 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 135514232 0 0) 0x7fcb840035b0 con 0x7fcb9c0cdff0 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c146f00 msgr2=0x7fcb9c162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c146f00 0x7fcb9c162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 >> v1:172.21.15.178:6789/0 conn(0x7fcb9c0afc30 legacy=0x7fcb9c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c0b03f0 con 0x7fcb9c0cdff0 2023-11-27T17:48:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fcb940019f0 con 0x7fcb9c0cdff0 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.284+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 >> v1:172.21.15.177:6789/0 conn(0x7fcb9c0cdff0 legacy=0x7fcb9c0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb84003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c146f00 0x7fcb84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb84004d90 0x7fcb84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c1472e0 con 0x7fcb84003a30 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8400bac0 con 0x7fcb84004d90 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8400bc30 con 0x7fcb9c146f00 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9a59c700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb84003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb99d9b700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c146f00 0x7fcb84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9ad9d700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb84004d90 0x7fcb84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9a59c700 1 -- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c146f00 msgr2=0x7fcb84004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9a59c700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c146f00 0x7fcb84004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9a59c700 1 -- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb84004d90 msgr2=0x7fcb84005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9a59c700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb84004d90 0x7fcb84005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9a59c700 1 -- 172.21.15.177:0/1522616552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb840035b0 con 0x7fcb84003a30 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9a59c700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb84003e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009b60 tx=0x7fcb84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176ae7eff997350c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00e6c0 con 0x7fcb84003a30 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00e820 con 0x7fcb84003a30 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.285+0000 7fcb9959a700 1 -- 172.21.15.177:0/1522616552 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00eb90 con 0x7fcb84003a30 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.286+0000 7fcba09c9700 1 -- 172.21.15.177:0/1522616552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 msgr2=0x7fcb84003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.286+0000 7fcba09c9700 1 --2- 172.21.15.177:0/1522616552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb84003e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009b60 tx=0x7fcb84005880 comp rx=0 tx=0).stop 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.286+0000 7fcb9ad9d700 1 -- 172.21.15.177:0/1522616552 reap_dead start 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.286+0000 7fcba09c9700 1 -- 172.21.15.177:0/1522616552 shutdown_connections 2023-11-27T17:48:29.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.286+0000 7fcba09c9700 1 -- 172.21.15.177:0/1522616552 >> 172.21.15.177:0/1522616552 conn(0x7fcb9c0b38b0 msgr2=0x7fcb9c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.286+0000 7fcba09c9700 1 -- 172.21.15.177:0/1522616552 shutdown_connections 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.286+0000 7fcba09c9700 1 -- 172.21.15.177:0/1522616552 wait complete. 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.287+0000 7fcba09c9700 1 Processor -- start 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.287+0000 7fcba09c9700 1 -- start start 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcba09c9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb9c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcba09c9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c0c8b40 0x7fcb9c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcba09c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c144c90 0x7fcb9c145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcba09c9700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0cd6f0 con 0x7fcb84003a30 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcba09c9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0c94e0 con 0x7fcb9c0c8b40 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcba09c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c145680 con 0x7fcb9c144c90 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb9c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb9c0cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52010/0 (socket says 172.21.15.177:52010) 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9a59c700 1 -- 172.21.15.177:0/963749420 learned_addr learned my addr 172.21.15.177:0/963749420 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb99d9b700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c0c8b40 0x7fcb9c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9ad9d700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c144c90 0x7fcb9c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9a59c700 1 -- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c144c90 msgr2=0x7fcb9c145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9a59c700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c144c90 0x7fcb9c145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9a59c700 1 -- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c0c8b40 msgr2=0x7fcb9c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9a59c700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c0c8b40 0x7fcb9c0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9a59c700 1 -- 172.21.15.177:0/963749420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c132070 con 0x7fcb84003a30 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.288+0000 7fcb9ad9d700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c144c90 0x7fcb9c145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.289+0000 7fcb9a59c700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb9c0cd1b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb84005830 tx=0x7fcb8c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.289+0000 7fcb8affd700 1 -- 172.21.15.177:0/963749420 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00e6c0 con 0x7fcb84003a30 2023-11-27T17:48:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.289+0000 7fcb8affd700 1 -- 172.21.15.177:0/963749420 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c003ab0 con 0x7fcb84003a30 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.289+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9c145930 con 0x7fcb84003a30 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.289+0000 7fcb8affd700 1 -- 172.21.15.177:0/963749420 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c003e60 con 0x7fcb84003a30 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.289+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c132330 con 0x7fcb84003a30 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.290+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c069400 con 0x7fcb84003a30 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.290+0000 7fcb8affd700 1 -- 172.21.15.177:0/963749420 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcb8c013470 con 0x7fcb84003a30 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.290+0000 7fcb8affd700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcb7c06b250 0x7fcb7c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.291+0000 7fcb8affd700 1 -- 172.21.15.177:0/963749420 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb8c08b280 con 0x7fcb84003a30 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.291+0000 7fcb99d9b700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcb7c06b250 0x7fcb7c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.291+0000 7fcb99d9b700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcb7c06b250 0x7fcb7c06d710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb90000c00 tx=0x7fcb90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.295+0000 7fcb8affd700 1 -- 172.21.15.177:0/963749420 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcb8c0560c0 con 0x7fcb84003a30 2023-11-27T17:48:29.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.485+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb9c0b1b70 con 0x7fcb84003a30 2023-11-27T17:48:29.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.486+0000 7fcb8affd700 1 -- 172.21.15.177:0/963749420 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb8c0596e0 con 0x7fcb84003a30 2023-11-27T17:48:29.488 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:29.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcb7c06b250 msgr2=0x7fcb7c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcb7c06b250 0x7fcb7c06d710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb90000c00 tx=0x7fcb90009040 comp rx=0 tx=0).stop 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 msgr2=0x7fcb9c0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb9c0cd1b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb84005830 tx=0x7fcb8c0047c0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 shutdown_connections 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcb7c06b250 0x7fcb7c06d710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb9c144c90 0x7fcb9c145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84003a30 0x7fcb9c0cd1b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 --2- 172.21.15.177:0/963749420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c0c8b40 0x7fcb9c0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 >> 172.21.15.177:0/963749420 conn(0x7fcb9c0b38b0 msgr2=0x7fcb9c0ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 shutdown_connections 2023-11-27T17:48:29.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.488+0000 7fcba09c9700 1 -- 172.21.15.177:0/963749420 wait complete. 2023-11-27T17:48:29.502 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:29.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.622+0000 7fc1f687d700 1 Processor -- start 2023-11-27T17:48:29.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.622+0000 7fc1f687d700 1 -- start start 2023-11-27T17:48:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.623+0000 7fc1f687d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc1f00afa50 0x7fc1f00b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.623+0000 7fc1f687d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f015b870 con 0x7fc1f00cd850 2023-11-27T17:48:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.623+0000 7fc1f687d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f015bb50 con 0x7fc1f015b3d0 2023-11-27T17:48:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.623+0000 7fc1f687d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f00afe30 con 0x7fc1f00afa50 2023-11-27T17:48:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.623+0000 7fc1f4e1a700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc1f00cd850 0x7fc1f00cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46340/0 (socket says 172.21.15.177:46340) 2023-11-27T17:48:29.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.623+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/575501074 learned_addr learned my addr 172.21.15.177:0/575501074 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.623+0000 7fc1effff700 1 --2- 172.21.15.177:0/575501074 >> v2:172.21.15.178:3300/0 conn(0x7fc1f00afa50 0x7fc1f00b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.623+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672566599 0 0) 0x7fc1f015b870 con 0x7fc1f00cd850 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1dc0035b0 con 0x7fc1f00cd850 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 347792193 0 0) 0x7fc1dc0035b0 con 0x7fc1f00cd850 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 >> v2:172.21.15.178:3300/0 conn(0x7fc1f00afa50 msgr2=0x7fc1f00b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 --2- 172.21.15.177:0/575501074 >> v2:172.21.15.178:3300/0 conn(0x7fc1f00afa50 0x7fc1f00b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 >> v1:172.21.15.178:6789/0 conn(0x7fc1f015b3d0 legacy=0x7fc1f015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f015be30 con 0x7fc1f00cd850 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fc1e80019f0 con 0x7fc1f00cd850 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 >> v1:172.21.15.177:6789/0 conn(0x7fc1f00cd850 legacy=0x7fc1f00cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc003a00 0x7fc1dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1dc004850 0x7fc1dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1dc005210 0x7fc1dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00afe30 con 0x7fc1dc005210 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc00c0b0 con 0x7fc1dc004850 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc00c270 con 0x7fc1dc003a00 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1f4e1a700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1dc005210 0x7fc1dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1effff700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc003a00 0x7fc1dc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1ef7fe700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1dc004850 0x7fc1dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/575501074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc003a00 msgr2=0x7fc1dc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1f4e1a700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc003a00 0x7fc1dc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/575501074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1dc004850 msgr2=0x7fc1dc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:29.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1f4e1a700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1dc004850 0x7fc1dc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/575501074 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc0035b0 con 0x7fc1dc005210 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/575501074 reap_dead start 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1f4e1a700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1dc005210 0x7fc1dc00ba10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800a830 tx=0x7fc1dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc26b052cf8da5f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e800a2f0 con 0x7fc1dc005210 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.624+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8012620 con 0x7fc1dc005210 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.625+0000 7fc1eeffd700 1 -- 172.21.15.177:0/575501074 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80129d0 con 0x7fc1dc005210 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.625+0000 7fc1f687d700 1 -- 172.21.15.177:0/575501074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1dc005210 msgr2=0x7fc1dc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.625+0000 7fc1f687d700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1dc005210 0x7fc1dc00ba10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800a830 tx=0x7fc1dc005880 comp rx=0 tx=0).stop 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.625+0000 7fc1f687d700 1 -- 172.21.15.177:0/575501074 shutdown_connections 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.625+0000 7fc1f687d700 1 --2- 172.21.15.177:0/575501074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1dc005210 0x7fc1dc00ba10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.625+0000 7fc1f687d700 1 -- 172.21.15.177:0/575501074 >> 172.21.15.177:0/575501074 conn(0x7fc1f00b38b0 msgr2=0x7fc1f00b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:29.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.625+0000 7fc1f687d700 1 -- 172.21.15.177:0/575501074 shutdown_connections 2023-11-27T17:48:29.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.625+0000 7fc1f687d700 1 -- 172.21.15.177:0/575501074 wait complete. 2023-11-27T17:48:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.626+0000 7fc1f687d700 1 Processor -- start 2023-11-27T17:48:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f687d700 1 -- start start 2023-11-27T17:48:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f687d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc005210 0x7fc1f014d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f687d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f00c6810 0x7fc1f014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f687d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1f0150180 0x7fc1f00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f687d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0150be0 con 0x7fc1f0150180 2023-11-27T17:48:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f687d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00c6380 con 0x7fc1f00c6810 2023-11-27T17:48:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f687d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f014d8f0 con 0x7fc1dc005210 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f4e1a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1f0150180 0x7fc1f00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f4e1a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1f0150180 0x7fc1f00b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52032/0 (socket says 172.21.15.177:52032) 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/1476936908 learned_addr learned my addr 172.21.15.177:0/1476936908 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1effff700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc005210 0x7fc1f014d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.627+0000 7fc1ef7fe700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f00c6810 0x7fc1f014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc005210 msgr2=0x7fc1f014d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1f4e1a700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc005210 0x7fc1f014d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f00c6810 msgr2=0x7fc1f014fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1f4e1a700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f00c6810 0x7fc1f014fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1f4e1a700 1 -- 172.21.15.177:0/1476936908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0150620 con 0x7fc1f0150180 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1ef7fe700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f00c6810 0x7fc1f014fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1f4e1a700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1f0150180 0x7fc1f00b6120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00b3440 tx=0x7fc1e8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1ecff9700 1 -- 172.21.15.177:0/1476936908 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8024070 con 0x7fc1f0150180 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1ecff9700 1 -- 172.21.15.177:0/1476936908 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e800a210 con 0x7fc1f0150180 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f0150900 con 0x7fc1f0150180 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1ecff9700 1 -- 172.21.15.177:0/1476936908 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80019f0 con 0x7fc1f0150180 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.628+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f0159d90 con 0x7fc1f0150180 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.629+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f00c5e70 con 0x7fc1f0150180 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.629+0000 7fc1ecff9700 1 -- 172.21.15.177:0/1476936908 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc1e801d630 con 0x7fc1f0150180 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.630+0000 7fc1ecff9700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc1d006b250 0x7fc1d006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.630+0000 7fc1ecff9700 1 -- 172.21.15.177:0/1476936908 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1e808ae10 con 0x7fc1f0150180 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.630+0000 7fc1effff700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc1d006b250 0x7fc1d006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.630+0000 7fc1effff700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc1d006b250 0x7fc1d006d710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009be0 tx=0x7fc1d8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.634+0000 7fc1ecff9700 1 -- 172.21.15.177:0/1476936908 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc1f00c5e70 con 0x7fc1f0150180 2023-11-27T17:48:29.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.824+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1f00c5e70 con 0x7fc1f0150180 2023-11-27T17:48:29.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.825+0000 7fc1ecff9700 1 -- 172.21.15.177:0/1476936908 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1f00c5e70 con 0x7fc1f0150180 2023-11-27T17:48:29.827 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc1d006b250 msgr2=0x7fc1d006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc1d006b250 0x7fc1d006d710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009be0 tx=0x7fc1d8009210 comp rx=0 tx=0).stop 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1f0150180 msgr2=0x7fc1f00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1f0150180 0x7fc1f00b6120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00b3440 tx=0x7fc1e8001d80 comp rx=0 tx=0).stop 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 shutdown_connections 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc1d006b250 0x7fc1d006d710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1f0150180 0x7fc1f00b6120 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1dc005210 0x7fc1f014d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 --2- 172.21.15.177:0/1476936908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f00c6810 0x7fc1f014fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 >> 172.21.15.177:0/1476936908 conn(0x7fc1f00b38b0 msgr2=0x7fc1f00ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:29.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 shutdown_connections 2023-11-27T17:48:29.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.827+0000 7fc1f687d700 1 -- 172.21.15.177:0/1476936908 wait complete. 2023-11-27T17:48:29.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:29.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.959+0000 7fe536d7e700 1 Processor -- start 2023-11-27T17:48:29.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.959+0000 7fe536d7e700 1 -- start start 2023-11-27T17:48:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.960+0000 7fe536d7e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe530147880 0x7fe53006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.960+0000 7fe536d7e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5300b5ce0 con 0x7fe5300b6170 2023-11-27T17:48:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.960+0000 7fe536d7e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5300b5700 con 0x7fe530070c00 2023-11-27T17:48:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.960+0000 7fe536d7e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53006e230 con 0x7fe530147880 2023-11-27T17:48:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.960+0000 7fe534b1a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe530147880 0x7fe53006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.960+0000 7fe534b1a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe530147880 0x7fe53006d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52038/0 (socket says 172.21.15.177:52038) 2023-11-27T17:48:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.960+0000 7fe52ffff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe5300b6170 0x7fe5300704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46358/0 (socket says 172.21.15.177:46358) 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.960+0000 7fe534b1a700 1 -- 172.21.15.177:0/3149522292 learned_addr learned my addr 172.21.15.177:0/3149522292 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe534b1a700 1 -- 172.21.15.177:0/3149522292 >> v1:172.21.15.178:6789/0 conn(0x7fe530070c00 legacy=0x7fe53015f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe534b1a700 1 -- 172.21.15.177:0/3149522292 >> v1:172.21.15.177:6789/0 conn(0x7fe5300b6170 legacy=0x7fe5300704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe52f7fe700 1 -- 172.21.15.177:0/3149522292 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965580042 0 0) 0x7fe5300b5ce0 con 0x7fe5300b6170 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe534b1a700 1 -- 172.21.15.177:0/3149522292 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300b5970 con 0x7fe530147880 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe534b1a700 1 --2- 172.21.15.177:0/3149522292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe53006d910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5240098f0 tx=0x7fe524009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a927e9ba540cae server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe52f7fe700 1 -- 172.21.15.177:0/3149522292 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524004230 con 0x7fe530147880 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe52f7fe700 1 -- 172.21.15.177:0/3149522292 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524004390 con 0x7fe530147880 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe52f7fe700 1 -- 172.21.15.177:0/3149522292 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5240036a0 con 0x7fe530147880 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.961+0000 7fe536d7e700 1 -- 172.21.15.177:0/3149522292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 msgr2=0x7fe53006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.962+0000 7fe536d7e700 1 --2- 172.21.15.177:0/3149522292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe53006d910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5240098f0 tx=0x7fe524009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.962+0000 7fe536d7e700 1 -- 172.21.15.177:0/3149522292 shutdown_connections 2023-11-27T17:48:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.962+0000 7fe536d7e700 1 --2- 172.21.15.177:0/3149522292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe53006d910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.962+0000 7fe536d7e700 1 -- 172.21.15.177:0/3149522292 >> 172.21.15.177:0/3149522292 conn(0x7fe5300b2130 msgr2=0x7fe5300b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.962+0000 7fe536d7e700 1 -- 172.21.15.177:0/3149522292 shutdown_connections 2023-11-27T17:48:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.962+0000 7fe536d7e700 1 -- 172.21.15.177:0/3149522292 wait complete. 2023-11-27T17:48:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.963+0000 7fe536d7e700 1 Processor -- start 2023-11-27T17:48:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.963+0000 7fe536d7e700 1 -- start start 2023-11-27T17:48:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe536d7e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe530070c00 0x7fe53015d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe536d7e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300b6170 0x7fe530137370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe536d7e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe530133ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe536d7e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe530137e10 con 0x7fe530147880 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe536d7e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5301380f0 con 0x7fe530070c00 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe536d7e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5301383d0 con 0x7fe5300b6170 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe53531b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe530133ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe53531b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe530133ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52048/0 (socket says 172.21.15.177:52048) 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe53531b700 1 -- 172.21.15.177:0/2495927786 learned_addr learned my addr 172.21.15.177:0/2495927786 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe534b1a700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe530070c00 0x7fe53015d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.964+0000 7fe52ffff700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300b6170 0x7fe530137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe53531b700 1 -- 172.21.15.177:0/2495927786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300b6170 msgr2=0x7fe530137370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe53531b700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300b6170 0x7fe530137370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe53531b700 1 -- 172.21.15.177:0/2495927786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe530070c00 msgr2=0x7fe53015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe53531b700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe530070c00 0x7fe53015d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe53531b700 1 -- 172.21.15.177:0/2495927786 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524009550 con 0x7fe530147880 2023-11-27T17:48:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe53531b700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe530133ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe52800b970 tx=0x7fe52800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe52d7fa700 1 -- 172.21.15.177:0/2495927786 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800d860 con 0x7fe530147880 2023-11-27T17:48:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe52d7fa700 1 -- 172.21.15.177:0/2495927786 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800d9c0 con 0x7fe530147880 2023-11-27T17:48:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5301386b0 con 0x7fe530147880 2023-11-27T17:48:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe52d7fa700 1 -- 172.21.15.177:0/2495927786 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800dd70 con 0x7fe530147880 2023-11-27T17:48:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.965+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53013a140 con 0x7fe530147880 2023-11-27T17:48:29.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.966+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe530073aa0 con 0x7fe530147880 2023-11-27T17:48:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.966+0000 7fe52d7fa700 1 -- 172.21.15.177:0/2495927786 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe52800e430 con 0x7fe530147880 2023-11-27T17:48:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.967+0000 7fe52d7fa700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe51406b250 0x7fe51406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.967+0000 7fe52d7fa700 1 -- 172.21.15.177:0/2495927786 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe528089b00 con 0x7fe530147880 2023-11-27T17:48:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.967+0000 7fe534b1a700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe51406b250 0x7fe51406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:29.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.967+0000 7fe534b1a700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe51406b250 0x7fe51406d710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe524009130 tx=0x7fe524008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:29.971+0000 7fe52d7fa700 1 -- 172.21.15.177:0/2495927786 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe528054830 con 0x7fe530147880 2023-11-27T17:48:30.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.205+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe530069400 con 0x7fe530147880 2023-11-27T17:48:30.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.206+0000 7fe52d7fa700 1 -- 172.21.15.177:0/2495927786 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fe52800ded0 con 0x7fe530147880 2023-11-27T17:48:30.208 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:30.209 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:48:16.563848+0000","modified":"2023-11-27T17:48:19.576268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:48:30.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe51406b250 msgr2=0x7fe51406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe51406b250 0x7fe51406d710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe524009130 tx=0x7fe524008030 comp rx=0 tx=0).stop 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 msgr2=0x7fe530133ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe530133ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe52800b970 tx=0x7fe52800bc80 comp rx=0 tx=0).stop 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 shutdown_connections 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe51406b250 0x7fe51406d710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe530147880 0x7fe530133ef0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe530070c00 0x7fe53015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 --2- 172.21.15.177:0/2495927786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300b6170 0x7fe530137370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 >> 172.21.15.177:0/2495927786 conn(0x7fe5300b2130 msgr2=0x7fe5300b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 shutdown_connections 2023-11-27T17:48:30.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.208+0000 7fe536d7e700 1 -- 172.21.15.177:0/2495927786 wait complete. 2023-11-27T17:48:30.212 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-27T17:48:30.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:30.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.340+0000 7f1a11c95700 1 Processor -- start 2023-11-27T17:48:30.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.340+0000 7f1a11c95700 1 -- start start 2023-11-27T17:48:30.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.340+0000 7f1a11c95700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a0c147880 0x7f1a0c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.340+0000 7f1a11c95700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.340+0000 7f1a11c95700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c0b5ce0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.340+0000 7f1a11c95700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0b5700 con 0x7f1a0c147880 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.340+0000 7f1a11c95700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c06e230 con 0x7f1a0c0b6170 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0bfff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1a0c0b65d0 0x7f1a0c161c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46374/0 (socket says 172.21.15.177:46374) 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0bfff700 1 -- 172.21.15.177:0/1168275293 learned_addr learned my addr 172.21.15.177:0/1168275293 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0affd700 1 --2- 172.21.15.177:0/1168275293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0b7fe700 1 --2- 172.21.15.177:0/1168275293 >> v2:172.21.15.178:3300/0 conn(0x7f1a0c147880 0x7f1a0c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0a7fc700 1 -- 172.21.15.177:0/1168275293 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482667121 0 0) 0x7f1a0c0b5ce0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0a7fc700 1 -- 172.21.15.177:0/1168275293 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f80035b0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0affd700 1 -- 172.21.15.177:0/1168275293 >> v2:172.21.15.178:3300/0 conn(0x7f1a0c147880 msgr2=0x7f1a0c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0affd700 1 --2- 172.21.15.177:0/1168275293 >> v2:172.21.15.178:3300/0 conn(0x7f1a0c147880 0x7f1a0c06d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0affd700 1 -- 172.21.15.177:0/1168275293 >> v1:172.21.15.177:6789/0 conn(0x7f1a0c0b65d0 legacy=0x7f1a0c161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0affd700 1 -- 172.21.15.177:0/1168275293 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0b5970 con 0x7f1a0c0b6170 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0b7fe700 1 --2- 172.21.15.177:0/1168275293 >> v2:172.21.15.178:3300/0 conn(0x7f1a0c147880 0x7f1a0c06d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0affd700 1 --2- 172.21.15.177:0/1168275293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0704f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009840 tx=0x7f19f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2a0a9c8598ddc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0a7fc700 1 -- 172.21.15.177:0/1168275293 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4011830 con 0x7f1a0c0b6170 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0a7fc700 1 -- 172.21.15.177:0/1168275293 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4011990 con 0x7f1a0c0b6170 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.341+0000 7f1a0a7fc700 1 -- 172.21.15.177:0/1168275293 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4011d00 con 0x7f1a0c0b6170 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.342+0000 7f1a11c95700 1 -- 172.21.15.177:0/1168275293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 msgr2=0x7f1a0c0704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.342+0000 7f1a11c95700 1 --2- 172.21.15.177:0/1168275293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0704f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009840 tx=0x7f19f4009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.342+0000 7f1a11c95700 1 -- 172.21.15.177:0/1168275293 shutdown_connections 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.342+0000 7f1a11c95700 1 --2- 172.21.15.177:0/1168275293 >> v2:172.21.15.178:3300/0 conn(0x7f1a0c147880 0x7f1a0c06d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.342+0000 7f1a11c95700 1 --2- 172.21.15.177:0/1168275293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0704f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.342+0000 7f1a11c95700 1 -- 172.21.15.177:0/1168275293 >> 172.21.15.177:0/1168275293 conn(0x7f1a0c0b2130 msgr2=0x7f1a0c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:30.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.342+0000 7f1a11c95700 1 -- 172.21.15.177:0/1168275293 shutdown_connections 2023-11-27T17:48:30.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.342+0000 7f1a11c95700 1 -- 172.21.15.177:0/1168275293 wait complete. 2023-11-27T17:48:30.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.343+0000 7f1a11c95700 1 Processor -- start 2023-11-27T17:48:30.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.343+0000 7f1a11c95700 1 -- start start 2023-11-27T17:48:30.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a11c95700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a11c95700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0c0b65d0 0x7f1a0c0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a11c95700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a0c147880 0x7f1a0c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a11c95700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c8fd0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a11c95700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c5ee0 con 0x7f1a0c147880 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a11c95700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c61c0 con 0x7f1a0c0b6170 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0c0b65d0 0x7f1a0c0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0c0b65d0 0x7f1a0c0c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52060/0 (socket says 172.21.15.177:52060) 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0affd700 1 -- 172.21.15.177:0/814570509 learned_addr learned my addr 172.21.15.177:0/814570509 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0b7fe700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0bfff700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a0c147880 0x7f1a0c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0affd700 1 -- 172.21.15.177:0/814570509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 msgr2=0x7f1a0c0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0affd700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0affd700 1 -- 172.21.15.177:0/814570509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a0c147880 msgr2=0x7f1a0c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0affd700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a0c147880 0x7f1a0c0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.344+0000 7f1a0affd700 1 -- 172.21.15.177:0/814570509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0094a0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.345+0000 7f1a0affd700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0c0b65d0 0x7f1a0c0c7260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009fd0 tx=0x7f19f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.345+0000 7f1a03fff700 1 -- 172.21.15.177:0/814570509 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40045d0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.345+0000 7f1a03fff700 1 -- 172.21.15.177:0/814570509 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f401e070 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.345+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f40094a0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.345+0000 7f1a03fff700 1 -- 172.21.15.177:0/814570509 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40038a0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.345+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c0c6780 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.346+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c073aa0 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.347+0000 7f1a03fff700 1 -- 172.21.15.177:0/814570509 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f19f4003a00 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.347+0000 7f1a03fff700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f19ec06b250 0x7f19ec06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.347+0000 7f1a0b7fe700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f19ec06b250 0x7f19ec06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.347+0000 7f1a0b7fe700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f19ec06b250 0x7f19ec06d710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009c60 tx=0x7f19fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.348+0000 7f1a03fff700 1 -- 172.21.15.177:0/814570509 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19f402ce90 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.352+0000 7f1a03fff700 1 -- 172.21.15.177:0/814570509 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f19f4055680 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.544+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a0c069400 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.545+0000 7f1a03fff700 1 -- 172.21.15.177:0/814570509 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f19f4015020 con 0x7f1a0c0b65d0 2023-11-27T17:48:30.548 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:30.548 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:30.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f19ec06b250 msgr2=0x7f19ec06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f19ec06b250 0x7f19ec06d710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009c60 tx=0x7f19fc008040 comp rx=0 tx=0).stop 2023-11-27T17:48:30.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0c0b65d0 msgr2=0x7f1a0c0c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0c0b65d0 0x7f1a0c0c7260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009fd0 tx=0x7f19f4004750 comp rx=0 tx=0).stop 2023-11-27T17:48:30.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 shutdown_connections 2023-11-27T17:48:30.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f19ec06b250 0x7f19ec06d710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a0c147880 0x7f1a0c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a0c0b6170 0x7f1a0c0c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 --2- 172.21.15.177:0/814570509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0c0b65d0 0x7f1a0c0c7260 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 >> 172.21.15.177:0/814570509 conn(0x7f1a0c0b2130 msgr2=0x7f1a0c15e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:30.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.547+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 shutdown_connections 2023-11-27T17:48:30.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.548+0000 7f1a11c95700 1 -- 172.21.15.177:0/814570509 wait complete. 2023-11-27T17:48:30.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:30.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.680+0000 7ff10bb99700 1 Processor -- start 2023-11-27T17:48:30.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.680+0000 7ff10bb99700 1 -- start start 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff10bb99700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff104147880 0x7ff10406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff10bb99700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104070c00 0x7ff10415f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff10bb99700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1040b5ce0 con 0x7ff1040b6170 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff10bb99700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1040b5700 con 0x7ff104147880 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff10bb99700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10406e230 con 0x7ff104070c00 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff109935700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff104147880 0x7ff10406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff109935700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff104147880 0x7ff10406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52066/0 (socket says 172.21.15.177:52066) 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff109935700 1 -- 172.21.15.177:0/1118849487 learned_addr learned my addr 172.21.15.177:0/1118849487 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff10a136700 1 --2- 172.21.15.177:0/1118849487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104070c00 0x7ff10415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff109935700 1 -- 172.21.15.177:0/1118849487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104070c00 msgr2=0x7ff10415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:30.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff109935700 1 --2- 172.21.15.177:0/1118849487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104070c00 0x7ff10415f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff109935700 1 -- 172.21.15.177:0/1118849487 >> v1:172.21.15.178:6789/0 conn(0x7ff1040b6170 legacy=0x7ff1040704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff109935700 1 -- 172.21.15.177:0/1118849487 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1040b5970 con 0x7ff104147880 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff109935700 1 --2- 172.21.15.177:0/1118849487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff104147880 0x7ff10406d910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1000098f0 tx=0x7ff100009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e309d10fa822fb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff108933700 1 -- 172.21.15.177:0/1118849487 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100011830 con 0x7ff104147880 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff108933700 1 -- 172.21.15.177:0/1118849487 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff100011990 con 0x7ff104147880 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.681+0000 7ff108933700 1 -- 172.21.15.177:0/1118849487 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100011d20 con 0x7ff104147880 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.682+0000 7ff10bb99700 1 -- 172.21.15.177:0/1118849487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff104147880 msgr2=0x7ff10406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.682+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1118849487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff104147880 0x7ff10406d910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1000098f0 tx=0x7ff100009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.682+0000 7ff10bb99700 1 -- 172.21.15.177:0/1118849487 shutdown_connections 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.682+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1118849487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff104147880 0x7ff10406d910 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.682+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1118849487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104070c00 0x7ff10415f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.682+0000 7ff10bb99700 1 -- 172.21.15.177:0/1118849487 >> 172.21.15.177:0/1118849487 conn(0x7ff1040b2130 msgr2=0x7ff1040b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:30.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.682+0000 7ff10bb99700 1 -- 172.21.15.177:0/1118849487 shutdown_connections 2023-11-27T17:48:30.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.682+0000 7ff10bb99700 1 -- 172.21.15.177:0/1118849487 wait complete. 2023-11-27T17:48:30.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.683+0000 7ff10bb99700 1 Processor -- start 2023-11-27T17:48:30.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.683+0000 7ff10bb99700 1 -- start start 2023-11-27T17:48:30.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff10bb99700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff104070c00 0x7ff1041f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff10bb99700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1040b6170 0x7ff1040af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff10bb99700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104147880 0x7ff104145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff10bb99700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040c6dd0 con 0x7ff1040b6170 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff10bb99700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040c5ee0 con 0x7ff104070c00 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff10bb99700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040c61c0 con 0x7ff104147880 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1040b6170 0x7ff1040af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1040b6170 0x7ff1040af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52074/0 (socket says 172.21.15.177:52074) 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 -- 172.21.15.177:0/1194708333 learned_addr learned my addr 172.21.15.177:0/1194708333 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:30.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff10a136700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104147880 0x7ff104145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109935700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff104070c00 0x7ff1041f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 -- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104147880 msgr2=0x7ff104145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104147880 0x7ff104145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 -- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff104070c00 msgr2=0x7ff1041f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff104070c00 0x7ff1041f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 -- 172.21.15.177:0/1194708333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100009550 con 0x7ff1040b6170 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109935700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff104070c00 0x7ff1041f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.684+0000 7ff109134700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1040b6170 0x7ff1040af270 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400c450 tx=0x7ff0f400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.685+0000 7ff0fa7fc700 1 -- 172.21.15.177:0/1194708333 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40052d0 con 0x7ff1040b6170 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.685+0000 7ff0fa7fc700 1 -- 172.21.15.177:0/1194708333 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f4005430 con 0x7ff1040b6170 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.685+0000 7ff0fa7fc700 1 -- 172.21.15.177:0/1194708333 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40038c0 con 0x7ff1040b6170 2023-11-27T17:48:30.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.685+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1040c64a0 con 0x7ff1040b6170 2023-11-27T17:48:30.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.685+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1040c6a60 con 0x7ff1040b6170 2023-11-27T17:48:30.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.685+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff104073aa0 con 0x7ff1040b6170 2023-11-27T17:48:30.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.686+0000 7ff0fa7fc700 1 -- 172.21.15.177:0/1194708333 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff0f4003a20 con 0x7ff1040b6170 2023-11-27T17:48:30.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.686+0000 7ff0fa7fc700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0e806b250 0x7ff0e806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:30.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.686+0000 7ff0fa7fc700 1 -- 172.21.15.177:0/1194708333 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0f4088cf0 con 0x7ff1040b6170 2023-11-27T17:48:30.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.686+0000 7ff109935700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0e806b250 0x7ff0e806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:30.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.687+0000 7ff109935700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0e806b250 0x7ff0e806d710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff1000098f0 tx=0x7ff100008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:30.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.691+0000 7ff0fa7fc700 1 -- 172.21.15.177:0/1194708333 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff0f408d070 con 0x7ff1040b6170 2023-11-27T17:48:30.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.923+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1040c6bf0 con 0x7ff1040b6170 2023-11-27T17:48:30.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.923+0000 7ff0fa7fc700 1 -- 172.21.15.177:0/1194708333 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7ff0f4053a20 con 0x7ff1040b6170 2023-11-27T17:48:30.926 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:30.926 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:48:16.563848+0000","modified":"2023-11-27T17:48:19.576268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:48:30.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0e806b250 msgr2=0x7ff0e806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0e806b250 0x7ff0e806d710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff1000098f0 tx=0x7ff100008030 comp rx=0 tx=0).stop 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1040b6170 msgr2=0x7ff1040af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1040b6170 0x7ff1040af270 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400c450 tx=0x7ff0f400c810 comp rx=0 tx=0).stop 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 shutdown_connections 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0e806b250 0x7ff0e806d710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff104147880 0x7ff104145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff104070c00 0x7ff1041f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 --2- 172.21.15.177:0/1194708333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1040b6170 0x7ff1040af270 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 >> 172.21.15.177:0/1194708333 conn(0x7ff1040b2130 msgr2=0x7ff10415f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 shutdown_connections 2023-11-27T17:48:30.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:30.926+0000 7ff10bb99700 1 -- 172.21.15.177:0/1194708333 wait complete. 2023-11-27T17:48:30.930 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-27T17:48:31.343 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T17:48:16.563848+0000', 'modified': '2023-11-27T17:48:19.576268+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/1631332189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6833', 'nonce': 1631332189}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 1631332189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T17:48:31.343 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T17:48:31.343 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-27T17:48:31.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.463+0000 7f5b20945700 1 Processor -- start 2023-11-27T17:48:31.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.463+0000 7f5b20945700 1 -- start start 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b20945700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b1c1566d0 0x7f5b1c160660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b20945700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b1c072e10 0x7f5b1c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b20945700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c156ab0 con 0x7f5b1c15c660 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b20945700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c160ba0 con 0x7f5b1c1566d0 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b20945700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c06df10 con 0x7f5b1c072e10 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b1a59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b1c1566d0 0x7f5b1c160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b19d9b700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5b1c15c660 0x7f5b1c072700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46398/0 (socket says 172.21.15.177:46398) 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b19d9b700 1 -- 172.21.15.177:0/621737982 learned_addr learned my addr 172.21.15.177:0/621737982 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/621737982 >> v2:172.21.15.178:3300/0 conn(0x7f5b1c072e10 0x7f5b1c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b1a59c700 1 -- 172.21.15.177:0/621737982 >> v2:172.21.15.178:3300/0 conn(0x7f5b1c072e10 msgr2=0x7f5b1c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/621737982 >> v2:172.21.15.178:3300/0 conn(0x7f5b1c072e10 0x7f5b1c06e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b1a59c700 1 -- 172.21.15.177:0/621737982 >> v1:172.21.15.177:6789/0 conn(0x7f5b1c15c660 legacy=0x7f5b1c072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b1959a700 1 -- 172.21.15.177:0/621737982 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774070996 0 0) 0x7f5b1c156ab0 con 0x7f5b1c15c660 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b1a59c700 1 -- 172.21.15.177:0/621737982 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c15cbb0 con 0x7f5b1c1566d0 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.464+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/621737982 >> v2:172.21.15.178:3300/0 conn(0x7f5b1c072e10 0x7f5b1c06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/621737982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c160660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0670f0 tx=0x7f5b10009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952e5aac57cedfee server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b1959a700 1 -- 172.21.15.177:0/621737982 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10011830 con 0x7f5b1c1566d0 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b1959a700 1 -- 172.21.15.177:0/621737982 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b10011990 con 0x7f5b1c1566d0 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b1959a700 1 -- 172.21.15.177:0/621737982 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10011d20 con 0x7f5b1c1566d0 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b20945700 1 -- 172.21.15.177:0/621737982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 msgr2=0x7f5b1c160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b20945700 1 --2- 172.21.15.177:0/621737982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c160660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0670f0 tx=0x7f5b10009b20 comp rx=0 tx=0).stop 2023-11-27T17:48:31.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b20945700 1 -- 172.21.15.177:0/621737982 shutdown_connections 2023-11-27T17:48:31.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b20945700 1 --2- 172.21.15.177:0/621737982 >> v2:172.21.15.178:3300/0 conn(0x7f5b1c072e10 0x7f5b1c06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b20945700 1 --2- 172.21.15.177:0/621737982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c160660 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b20945700 1 -- 172.21.15.177:0/621737982 >> 172.21.15.177:0/621737982 conn(0x7f5b1c0b1ff0 msgr2=0x7f5b1c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:31.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b20945700 1 -- 172.21.15.177:0/621737982 shutdown_connections 2023-11-27T17:48:31.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.465+0000 7f5b20945700 1 -- 172.21.15.177:0/621737982 wait complete. 2023-11-27T17:48:31.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 Processor -- start 2023-11-27T17:48:31.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 -- start start 2023-11-27T17:48:31.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c072e10 0x7f5b1c1f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c15c660 0x7f5b1c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c156c90 con 0x7f5b1c1566d0 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c13d6c0 con 0x7f5b1c072e10 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c156f30 con 0x7f5b1c15c660 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c1591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52088/0 (socket says 172.21.15.177:52088) 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 -- 172.21.15.177:0/3503673822 learned_addr learned my addr 172.21.15.177:0/3503673822 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c072e10 0x7f5b1c1f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c15c660 0x7f5b1c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 -- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c15c660 msgr2=0x7f5b1c155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c15c660 0x7f5b1c155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 -- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c072e10 msgr2=0x7f5b1c1f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c072e10 0x7f5b1c1f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 -- 172.21.15.177:0/3503673822 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100094a0 con 0x7f5b1c1566d0 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c15c660 0x7f5b1c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c072e10 0x7f5b1c1f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c1591e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0011e0 tx=0x7f5b0c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b0affd700 1 -- 172.21.15.177:0/3503673822 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c004c80 con 0x7f5b1c1566d0 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b0affd700 1 -- 172.21.15.177:0/3503673822 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c004e00 con 0x7f5b1c1566d0 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b0affd700 1 -- 172.21.15.177:0/3503673822 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c007310 con 0x7f5b1c1566d0 2023-11-27T17:48:31.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 -- 172.21.15.177:0/3503673822 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c157210 con 0x7f5b1c1566d0 2023-11-27T17:48:31.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.468+0000 7f5b20945700 1 -- 172.21.15.177:0/3503673822 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c159720 con 0x7f5b1c1566d0 2023-11-27T17:48:31.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.469+0000 7f5b0affd700 1 -- 172.21.15.177:0/3503673822 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5b0c007470 con 0x7f5b1c1566d0 2023-11-27T17:48:31.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.470+0000 7f5b0affd700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5afc06b250 0x7f5afc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.470+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5afc06b250 0x7f5afc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.470+0000 7f5b0affd700 1 -- 172.21.15.177:0/3503673822 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b0c089790 con 0x7f5b1c1566d0 2023-11-27T17:48:31.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.470+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5afc06b250 0x7f5afc06d710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5b100090b0 tx=0x7f5b10008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:31.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.472+0000 7f5b2cb3eb80 1 Processor -- start 2023-11-27T17:48:31.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.472+0000 7f5b2cb3eb80 1 -- start start 2023-11-27T17:48:31.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c968840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c968d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c94be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be9c895770 con 0x55be9c922080 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be9c87c750 con 0x55be9c937ed0 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be9c87a070 con 0x55be9c91f490 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c968840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c968840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52094/0 (socket says 172.21.15.177:52094) 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 -- 172.21.15.177:0/2774475252 learned_addr learned my addr 172.21.15.177:0/2774475252 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c94be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c968d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 -- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 msgr2=0x55be9c94be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c94be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 -- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 msgr2=0x55be9c968d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c968d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 -- 172.21.15.177:0/2774475252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9c6f25e0 con 0x55be9c922080 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c94be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c968d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c968840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009f20 tx=0x7f5b10010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463ada7c6ad22c20 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5afbfff700 1 -- 172.21.15.177:0/2774475252 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1002b070 con 0x55be9c922080 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5afbfff700 1 -- 172.21.15.177:0/2774475252 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b100037a0 con 0x55be9c922080 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5afbfff700 1 -- 172.21.15.177:0/2774475252 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1001f070 con 0x55be9c922080 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/2774475252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 msgr2=0x55be9c968840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c968840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009f20 tx=0x7f5b10010000 comp rx=0 tx=0).stop 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/2774475252 shutdown_connections 2023-11-27T17:48:31.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c94be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c968840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/2774475252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c968d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/2774475252 >> 172.21.15.177:0/2774475252 conn(0x55be9c850310 msgr2=0x55be9c966e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/2774475252 shutdown_connections 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.474+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/2774475252 wait complete. 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.475+0000 7f5b2cb3eb80 1 -- start start 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.475+0000 7f5b2cb3eb80 1 Processor -- start 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c91f490 0x55be9c916730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c922080 0x55be9c979770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c9607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be9c875960 con 0x55be9c91f490 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be9c82f510 con 0x55be9c937ed0 2023-11-27T17:48:31.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be9c82f1b0 con 0x55be9c922080 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 10 client.0 _ll_register_callbacks cb 0x55be9c75aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c91f490 0x55be9c916730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c91f490 0x55be9c916730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52100/0 (socket says 172.21.15.177:52100) 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 -- 172.21.15.177:0/3478753549 learned_addr learned my addr 172.21.15.177:0/3478753549 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c922080 0x55be9c979770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c9607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 -- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c922080 msgr2=0x55be9c979770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c922080 0x55be9c979770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 -- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 msgr2=0x55be9c9607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c9607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 -- 172.21.15.177:0/3478753549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c15cbb0 con 0x55be9c91f490 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c91f490 0x55be9c916730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b10011e50 tx=0x7f5b100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40620e69c9b96fa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:31.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5af97fa700 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5af97fa700 1 -- 172.21.15.177:0/3478753549 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1002b070 con 0x55be9c91f490 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5af97fa700 1 -- 172.21.15.177:0/3478753549 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b10030470 con 0x55be9c91f490 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/3478753549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be9c914a40 con 0x55be9c91f490 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5af97fa700 1 -- 172.21.15.177:0/3478753549 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b10003ec0 con 0x55be9c91f490 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 10 client.4623 fetch_fsmap learned FSMap version 8 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.476+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/3478753549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55be9c69ed90 con 0x55be9c91f490 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5af97fa700 1 -- 172.21.15.177:0/3478753549 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be9c914a40 con 0x55be9c91f490 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5af97fa700 1 -- 172.21.15.177:0/3478753549 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5b10037030 con 0x55be9c91f490 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5b2cb3eb80 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5b2cb3eb80 10 client.4623 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5b2cb3eb80 20 client.4623 populate_metadata read hostname 'smithi177' 2023-11-27T17:48:31.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] conn(0x55be9c960d10 0x55be9c94e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5b2cb3eb80 4 client.4623 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/3478753549 --> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be9c8f0840 con 0x55be9c960d10 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.477+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] conn(0x55be9c960d10 0x55be9c94e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.478+0000 7f5af97fa700 10 client.4623 ms_handle_connect on v2:172.21.15.178:6833/1631332189 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.478+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] conn(0x55be9c960d10 0x55be9c94e630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3769dd6330e6710 server_cookie=66e8f10af2affffc in_seq=0 out_seq=0 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.478+0000 7f5af97fa700 1 -- 172.21.15.177:0/3478753549 <== mds.0 v2:172.21.15.178:6833/1631332189 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55be9c8f0840 con 0x55be9c960d10 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.478+0000 7f5af97fa700 10 client.4623 handle_command_reply: tid=0 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.478+0000 7f5b2cb3eb80 1 client.4623 shutdown 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.478+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/3478753549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c91f490 msgr2=0x55be9c916730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.478+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c91f490 0x55be9c916730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b10011e50 tx=0x7f5b100047c0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/3478753549 shutdown_connections 2023-11-27T17:48:31.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c9607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c91f490 0x55be9c916730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] conn(0x55be9c960d10 0x55be9c94e630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/3478753549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c922080 0x55be9c979770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5af97fa700 0 client.4623 ms_handle_reset on v2:172.21.15.178:6833/1631332189 2023-11-27T17:48:31.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/3478753549 >> 172.21.15.177:0/3478753549 conn(0x55be9c850310 msgr2=0x55be9c96ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:31.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/3478753549 shutdown_connections 2023-11-27T17:48:31.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/3478753549 wait complete. 2023-11-27T17:48:31.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.479+0000 7f5b2cb3eb80 20 client.4623 trim_cache size 0 max 16384 2023-11-27T17:48:31.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.497+0000 7f5b2cb3eb80 1 Processor -- start 2023-11-27T17:48:31.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.497+0000 7f5b2cb3eb80 1 -- start start 2023-11-27T17:48:31.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c9663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c922080 0x55be9c975620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c937ed0 0x55be9c975b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be9c6f48d0 con 0x55be9c937ed0 2023-11-27T17:48:31.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be9c918af0 con 0x55be9c922080 2023-11-27T17:48:31.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be9c917240 con 0x55be9c91f490 2023-11-27T17:48:31.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c937ed0 0x55be9c975b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c937ed0 0x55be9c975b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52112/0 (socket says 172.21.15.177:52112) 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 -- 172.21.15.177:0/347884717 learned_addr learned my addr 172.21.15.177:0/347884717 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 -- 172.21.15.177:0/347884717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 msgr2=0x55be9c9663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/347884717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c9663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/347884717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c9663c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 -- 172.21.15.177:0/347884717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c922080 msgr2=0x55be9c975620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/347884717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c922080 0x55be9c975620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 -- 172.21.15.177:0/347884717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9c92c130 con 0x55be9c937ed0 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/347884717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c937ed0 0x55be9c975b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b14007ef0 tx=0x7f5b140106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a1e7d25a7081d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b08ff9700 1 -- 172.21.15.177:0/347884717 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400e870 con 0x55be9c937ed0 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b08ff9700 1 -- 172.21.15.177:0/347884717 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1400e9d0 con 0x55be9c937ed0 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.498+0000 7f5b08ff9700 1 -- 172.21.15.177:0/347884717 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400ed80 con 0x55be9c937ed0 2023-11-27T17:48:31.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/347884717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c937ed0 msgr2=0x55be9c975b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/347884717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c937ed0 0x55be9c975b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b14007ef0 tx=0x7f5b140106e0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/347884717 shutdown_connections 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/347884717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c937ed0 0x55be9c975b60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/347884717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c9663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/347884717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c922080 0x55be9c975620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/347884717 >> 172.21.15.177:0/347884717 conn(0x55be9c850310 msgr2=0x55be9c916640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/347884717 shutdown_connections 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.499+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/347884717 wait complete. 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.500+0000 7f5b2cb3eb80 1 -- start start 2023-11-27T17:48:31.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.500+0000 7f5b2cb3eb80 1 Processor -- start 2023-11-27T17:48:31.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.500+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c95d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.500+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c966c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.500+0000 7f5b2cb3eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c967180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be9c9654c0 con 0x55be9c922080 2023-11-27T17:48:31.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be9c9b93c0 con 0x55be9c937ed0 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b2cb3eb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be9c9b8c50 con 0x55be9c91f490 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b2cb3eb80 10 client.0 _ll_register_callbacks cb 0x55be9c75aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c966c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c966c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52116/0 (socket says 172.21.15.177:52116) 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 -- 172.21.15.177:0/4074820906 learned_addr learned my addr 172.21.15.177:0/4074820906 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c95d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c967180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 -- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 msgr2=0x55be9c95d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c95d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 -- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 msgr2=0x55be9c967180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c967180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 -- 172.21.15.177:0/4074820906 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b14007ac0 con 0x55be9c922080 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b1ad9d700 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c967180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b19d9b700 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c966c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c058110 tx=0x7f5b0c05c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7789d7b018c6e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5af97fa700 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5af97fa700 1 -- 172.21.15.177:0/4074820906 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c058180 con 0x55be9c922080 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5af97fa700 1 -- 172.21.15.177:0/4074820906 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b0c05c2d0 con 0x55be9c922080 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/4074820906 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b100037a0 con 0x55be9c922080 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5af97fa700 1 -- 172.21.15.177:0/4074820906 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b0c060480 con 0x55be9c922080 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b2cb3eb80 10 client.4629 fetch_fsmap learned FSMap version 8 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/4074820906 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55be9c687c10 con 0x55be9c922080 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5af97fa700 1 -- 172.21.15.177:0/4074820906 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b100037a0 con 0x55be9c922080 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5af97fa700 1 -- 172.21.15.177:0/4074820906 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5b0c0583e0 con 0x55be9c922080 2023-11-27T17:48:31.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.501+0000 7f5b2cb3eb80 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 10 client.4629 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 20 client.4629 populate_metadata read hostname 'smithi177' 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] conn(0x55be9c9b5ea0 0x55be9c95fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 4 client.4629 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/4074820906 --> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be9c83bf80 con 0x55be9c9b5ea0 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] conn(0x55be9c9b5ea0 0x55be9c95fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5af97fa700 10 client.4629 ms_handle_connect on v2:172.21.15.178:6833/1631332189 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b1a59c700 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] conn(0x55be9c9b5ea0 0x55be9c95fcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=844ce10d956549a7 server_cookie=6bd24739453c7851 in_seq=0 out_seq=0 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5af97fa700 1 -- 172.21.15.177:0/4074820906 <== mds.0 v2:172.21.15.178:6833/1631332189 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55be9c83bf80 con 0x55be9c9b5ea0 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5af97fa700 10 client.4629 handle_command_reply: tid=0 2023-11-27T17:48:31.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 1 client.4629 shutdown 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/4074820906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 msgr2=0x55be9c966c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c966c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c058110 tx=0x7f5b0c05c200 comp rx=0 tx=0).stop 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/4074820906 shutdown_connections 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.502+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be9c937ed0 0x55be9c967180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:6833/1631332189,v1:172.21.15.178:6835/1631332189] conn(0x55be9c9b5ea0 0x55be9c95fcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be9c91f490 0x55be9c95d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b2cb3eb80 1 --2- 172.21.15.177:0/4074820906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55be9c922080 0x55be9c966c40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5af97fa700 0 client.4629 ms_handle_reset on v2:172.21.15.178:6833/1631332189 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/4074820906 >> 172.21.15.177:0/4074820906 conn(0x55be9c850310 msgr2=0x55be9c975620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/4074820906 shutdown_connections 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b2cb3eb80 1 -- 172.21.15.177:0/4074820906 wait complete. 2023-11-27T17:48:31.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b2cb3eb80 20 client.4629 trim_cache size 0 max 16384 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "9352b089-d7fa-4b22-a837-e414c87a0ebc", 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4285, 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 14.32778693, 2023-11-27T17:48:31.513 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 8, 2023-11-27T17:48:31.514 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 21, 2023-11-27T17:48:31.514 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 21, 2023-11-27T17:48:31.514 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 21.475232088999999 2023-11-27T17:48:31.514 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 -- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5afc06b250 msgr2=0x7f5afc06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5afc06b250 0x7f5afc06d710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5b100090b0 tx=0x7f5b10008030 comp rx=0 tx=0).stop 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 -- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 msgr2=0x7f5b1c1591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c1591e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0011e0 tx=0x7f5b0c00cae0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 -- 172.21.15.177:0/3503673822 shutdown_connections 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5afc06b250 0x7f5afc06d710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1c15c660 0x7f5b1c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1c072e10 0x7f5b1c1f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 --2- 172.21.15.177:0/3503673822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c1566d0 0x7f5b1c1591e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:31.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 -- 172.21.15.177:0/3503673822 >> 172.21.15.177:0/3503673822 conn(0x7f5b1c0b1ff0 msgr2=0x7f5b1c0cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:31.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 -- 172.21.15.177:0/3503673822 shutdown_connections 2023-11-27T17:48:31.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:31.503+0000 7f5b20945700 1 -- 172.21.15.177:0/3503673822 wait complete. 2023-11-27T17:48:31.518 INFO:teuthology.run_tasks:Running task kclient... 2023-11-27T17:48:31.539 INFO:tasks.kclient:Mounting kernel clients... 2023-11-27T17:48:31.539 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-27T17:48:31.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:31.539 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-27T17:48:31.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:31.557 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2023-11-27T17:48:31.625 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2023-11-27T17:48:31.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:48:31.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:31.627 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-27T17:48:31.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:31.685 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2023-11-27T17:48:31.752 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2023-11-27T17:48:31.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:48:31.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:31.753 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-11-27T17:48:31.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:31.774 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2023-11-27T17:48:31.847 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2023-11-27T17:48:31.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:48:31.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:31.849 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-11-27T17:48:31.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:31.908 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2023-11-27T17:48:31.978 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2023-11-27T17:48:31.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:48:31.980 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-11-27T17:48:31.980 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T17:48:31.980 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T17:48:31.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T17:48:32.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.100+0000 7fe3238f2700 1 Processor -- start 2023-11-27T17:48:32.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.100+0000 7fe3238f2700 1 -- start start 2023-11-27T17:48:32.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe3238f2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:32.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe3238f2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe31c0b65d0 0x7fe31c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:32.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe3238f2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c0b5ce0 con 0x7fe31c147880 2023-11-27T17:48:32.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe3238f2700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c06e020 con 0x7fe31c0b65d0 2023-11-27T17:48:32.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe3238f2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0b5700 con 0x7fe31c0b6170 2023-11-27T17:48:32.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe320e8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:32.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe321e8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe31c0b65d0 0x7fe31c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:32.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe32168e700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe31c147880 0x7fe31c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45418/0 (socket says 172.21.15.177:45418) 2023-11-27T17:48:32.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe32168e700 1 -- 172.21.15.177:0/3859635635 learned_addr learned my addr 172.21.15.177:0/3859635635 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:32.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe320e8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c0704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39590/0 (socket says 172.21.15.177:39590) 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe313fff700 1 -- 172.21.15.177:0/3859635635 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557022184 0 0) 0x7fe31c0b5ce0 con 0x7fe31c147880 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe313fff700 1 -- 172.21.15.177:0/3859635635 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3080035b0 con 0x7fe31c147880 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe320e8d700 1 -- 172.21.15.177:0/3859635635 >> v2:172.21.15.178:3300/0 conn(0x7fe31c0b65d0 msgr2=0x7fe31c070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe320e8d700 1 --2- 172.21.15.177:0/3859635635 >> v2:172.21.15.178:3300/0 conn(0x7fe31c0b65d0 0x7fe31c070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe320e8d700 1 -- 172.21.15.177:0/3859635635 >> v1:172.21.15.178:6789/0 conn(0x7fe31c147880 legacy=0x7fe31c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe320e8d700 1 -- 172.21.15.177:0/3859635635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c06e230 con 0x7fe31c0b6170 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.101+0000 7fe321e8f700 1 --2- 172.21.15.177:0/3859635635 >> v2:172.21.15.178:3300/0 conn(0x7fe31c0b65d0 0x7fe31c070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe320e8d700 1 --2- 172.21.15.177:0/3859635635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c0704f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009840 tx=0x7fe30c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9ac18e3bc7fb025 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe313fff700 1 -- 172.21.15.177:0/3859635635 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c011830 con 0x7fe31c0b6170 2023-11-27T17:48:32.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe313fff700 1 -- 172.21.15.177:0/3859635635 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c011990 con 0x7fe31c0b6170 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe313fff700 1 -- 172.21.15.177:0/3859635635 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c011d00 con 0x7fe31c0b6170 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe3238f2700 1 -- 172.21.15.177:0/3859635635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 msgr2=0x7fe31c0704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe3238f2700 1 --2- 172.21.15.177:0/3859635635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c0704f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009840 tx=0x7fe30c009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe3238f2700 1 -- 172.21.15.177:0/3859635635 shutdown_connections 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe3238f2700 1 --2- 172.21.15.177:0/3859635635 >> v2:172.21.15.178:3300/0 conn(0x7fe31c0b65d0 0x7fe31c070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe3238f2700 1 --2- 172.21.15.177:0/3859635635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c0704f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe3238f2700 1 -- 172.21.15.177:0/3859635635 >> 172.21.15.177:0/3859635635 conn(0x7fe31c0b2130 msgr2=0x7fe31c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe3238f2700 1 -- 172.21.15.177:0/3859635635 shutdown_connections 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.102+0000 7fe3238f2700 1 -- 172.21.15.177:0/3859635635 wait complete. 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe3238f2700 1 Processor -- start 2023-11-27T17:48:32.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe3238f2700 1 -- start start 2023-11-27T17:48:32.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe3238f2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c1f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:32.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe3238f2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe31c0b65d0 0x7fe31c13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:32.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe3238f2700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c147880 0x7fe31c144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:32.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe3238f2700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c13e930 con 0x7fe31c147880 2023-11-27T17:48:32.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe3238f2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c140ef0 con 0x7fe31c0b65d0 2023-11-27T17:48:32.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe3238f2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c1411d0 con 0x7fe31c0b6170 2023-11-27T17:48:32.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe32168e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c1f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:32.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe321e8f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c147880 0x7fe31c144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.104+0000 7fe320e8d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe31c0b65d0 0x7fe31c13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe32168e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c1f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39594/0 (socket says 172.21.15.177:39594) 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe320e8d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe31c0b65d0 0x7fe31c13e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:60152/0 (socket says 172.21.15.177:60152) 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe32168e700 1 -- 172.21.15.177:0/1010735119 learned_addr learned my addr 172.21.15.177:0/1010735119 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe321e8f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c147880 0x7fe31c144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52132/0 (socket says 172.21.15.177:52132) 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe320e8d700 1 -- 172.21.15.177:0/1010735119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 msgr2=0x7fe31c1f3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe320e8d700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c1f3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe320e8d700 1 -- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c147880 msgr2=0x7fe31c144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe320e8d700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c147880 0x7fe31c144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe320e8d700 1 -- 172.21.15.177:0/1010735119 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009a70 con 0x7fe31c0b65d0 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe32168e700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c1f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe321e8f700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c147880 0x7fe31c144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:32.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe320e8d700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe31c0b65d0 0x7fe31c13e100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe30c016000 tx=0x7fe30c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe311ffb700 1 -- 172.21.15.177:0/1010735119 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c004550 con 0x7fe31c0b65d0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe311ffb700 1 -- 172.21.15.177:0/1010735119 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c01e070 con 0x7fe31c0b65d0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c0094a0 con 0x7fe31c0b65d0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe311ffb700 1 -- 172.21.15.177:0/1010735119 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0038a0 con 0x7fe31c0b65d0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.105+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c13ebf0 con 0x7fe31c0b65d0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.106+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c13ef60 con 0x7fe31c0b65d0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.107+0000 7fe311ffb700 1 -- 172.21.15.177:0/1010735119 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe30c003a00 con 0x7fe31c0b65d0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.107+0000 7fe311ffb700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe30006b250 0x7fe30006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.107+0000 7fe311ffb700 1 -- 172.21.15.177:0/1010735119 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe30c08a8a0 con 0x7fe31c0b65d0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.107+0000 7fe32168e700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe30006b250 0x7fe30006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:32.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.108+0000 7fe32168e700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe30006b250 0x7fe30006d710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe318005910 tx=0x7fe318009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:32.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.112+0000 7fe311ffb700 1 -- 172.21.15.177:0/1010735119 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe30c0555e0 con 0x7fe31c0b65d0 2023-11-27T17:48:32.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.346+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe31c073aa0 con 0x7fe31c0b65d0 2023-11-27T17:48:32.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.347+0000 7fe311ffb700 1 -- 172.21.15.177:0/1010735119 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe30c020060 con 0x7fe31c0b65d0 2023-11-27T17:48:32.348 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T17:48:32.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe30006b250 msgr2=0x7fe30006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:32.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe30006b250 0x7fe30006d710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe318005910 tx=0x7fe318009040 comp rx=0 tx=0).stop 2023-11-27T17:48:32.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe31c0b65d0 msgr2=0x7fe31c13e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:32.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe31c0b65d0 0x7fe31c13e100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe30c016000 tx=0x7fe30c004750 comp rx=0 tx=0).stop 2023-11-27T17:48:32.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 shutdown_connections 2023-11-27T17:48:32.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe30006b250 0x7fe30006d710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c147880 0x7fe31c144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe31c0b6170 0x7fe31c1f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 --2- 172.21.15.177:0/1010735119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe31c0b65d0 0x7fe31c13e100 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:32.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 >> 172.21.15.177:0/1010735119 conn(0x7fe31c0b2130 msgr2=0x7fe31c06d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:32.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 shutdown_connections 2023-11-27T17:48:32.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:32.349+0000 7fe3238f2700 1 -- 172.21.15.177:0/1010735119 wait complete. 2023-11-27T17:48:32.363 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T17:48:32.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T17:48:32.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-27T17:48:32.363 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T17:48:32.363 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T17:48:32.363 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T17:48:32.364 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T17:48:32.364 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T17:48:32.364 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:48:32.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:32.364 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-27T17:48:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:48:32.381 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:48:32.381 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:48:32.381 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:32.381 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-27T17:48:32.381 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 41567sec preferred_lft 41567sec 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c8c9:8ccb:1861:d7ec/64 scope link noprefixroute 2023-11-27T17:48:32.382 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:32.383 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T17:48:32.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:32.383 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:32.383 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:32.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2023-11-27T17:48:32.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2023-11-27T17:48:32.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2023-11-27T17:48:32.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T17:48:32.383 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:32.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:32.541 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T17:48:32.568 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-27T17:48:32.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:32.569 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-27T17:48:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-27T17:48:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T17:48:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T17:48:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T17:48:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T17:48:32.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:32.645 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:32.645 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:32.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T17:48:32.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T17:48:32.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T17:48:32.645 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:32.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:32.907 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-27T17:48:32.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:32.924 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2023-11-27T17:48:32.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:32.981 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:32.981 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:32.981 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T17:48:32.981 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-27T17:48:32.981 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:33.075 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-27T17:48:33.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:33.075 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:33.075 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:33.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-27T17:48:33.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T17:48:33.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-27T17:48:33.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-27T17:48:33.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-27T17:48:33.076 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:33.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:33.282 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:33.282 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:33.282 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-27T17:48:33.282 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T17:48:33.282 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:33.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:48:33.382 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T17:48:33.403 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:48:33.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:48:33.403 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T17:48:33.460 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-27T17:48:33.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:33.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:33.555 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:33.555 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:48:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 0@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:48:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:48:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:48:33.681 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:48:33.681 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:48:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:48:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 0@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:48:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:48:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:48:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:48:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:48:33.760 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790" 2023-11-27T17:48:33.760 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2023-11-27T17:48:33.760 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=9352b089-d7fa-4b22-a837-e414c87a0ebc" will pass to kernel 2023-11-27T17:48:33.761 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T17:48:33.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:33.762 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T17:48:33.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:33.788 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:33.877 INFO:teuthology.orchestra.run.smithi177.stdout:client4582 2023-11-27T17:48:33.878 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:48:33.878 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:33.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:33.896 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:33.984 INFO:teuthology.orchestra.run.smithi177.stdout:client4582 2023-11-27T17:48:33.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:33.984 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:34.031 INFO:teuthology.orchestra.run.smithi177.stdout:client4582 2023-11-27T17:48:34.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.031 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9352b089-d7fa-4b22-a837-e414c87a0ebc.client4582/status') 2023-11-27T17:48:34.084 INFO:teuthology.orchestra.run.smithi177.stdout:instance: client.4582 (3)172.21.15.177:0/1292513295 2023-11-27T17:48:34.084 INFO:teuthology.orchestra.run.smithi177.stdout:blocklisted: false 2023-11-27T17:48:34.085 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records in 2023-11-27T17:48:34.085 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records out 2023-11-27T17:48:34.085 INFO:teuthology.orchestra.run.smithi177.stderr:71 bytes copied, 2.1409e-05 s, 3.3 MB/s 2023-11-27T17:48:34.086 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-11-27T17:48:34.086 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T17:48:34.086 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-27T17:48:34.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T17:48:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.205+0000 7ff813960700 1 Processor -- start 2023-11-27T17:48:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.205+0000 7ff813960700 1 -- start start 2023-11-27T17:48:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff813960700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff80c0b6170 0x7ff80c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff813960700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c0b5ce0 con 0x7ff80c147880 2023-11-27T17:48:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff813960700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c0b5700 con 0x7ff80c0b6600 2023-11-27T17:48:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff813960700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c06e020 con 0x7ff80c0b6170 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff8116fc700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff80c147880 0x7ff80c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46466/0 (socket says 172.21.15.177:46466) 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff8116fc700 1 -- 172.21.15.177:0/175049123 learned_addr learned my addr 172.21.15.177:0/175049123 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852497556 0 0) 0x7ff80c0b5ce0 con 0x7ff80c147880 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7f80035b0 con 0x7ff80c147880 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff810efb700 1 --2- 172.21.15.177:0/175049123 >> v2:172.21.15.178:3300/0 conn(0x7ff80c0b6170 0x7ff80c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2872627322 0 0) 0x7ff7f80035b0 con 0x7ff80c147880 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 >> v2:172.21.15.178:3300/0 conn(0x7ff80c0b6170 msgr2=0x7ff80c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 --2- 172.21.15.177:0/175049123 >> v2:172.21.15.178:3300/0 conn(0x7ff80c0b6170 0x7ff80c0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 >> v1:172.21.15.178:6789/0 conn(0x7ff80c0b6600 legacy=0x7ff80c15f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c06e230 con 0x7ff80c147880 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7ff808001670 con 0x7ff80c147880 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 >> v1:172.21.15.177:6789/0 conn(0x7ff80c147880 legacy=0x7ff80c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f8003a00 0x7ff7f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff7f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f8005210 0x7ff7f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.206+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c06e020 con 0x7ff7f8004850 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f800c0b0 con 0x7ff7f8005210 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f800c270 con 0x7ff7f8003a00 2023-11-27T17:48:34.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff810efb700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff7f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff811efd700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f8005210 0x7ff7f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff8116fc700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f8003a00 0x7ff7f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff810efb700 1 -- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f8003a00 msgr2=0x7ff7f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff810efb700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f8003a00 0x7ff7f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff810efb700 1 -- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f8005210 msgr2=0x7ff7f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff810efb700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f8005210 0x7ff7f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff810efb700 1 -- 172.21.15.177:0/175049123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f80035b0 con 0x7ff7f8004850 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff811efd700 1 -- 172.21.15.177:0/175049123 reap_dead start 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff8116fc700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f8003a00 0x7ff7f8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:34.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff810efb700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff7f8004cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009b60 tx=0x7ff7f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba613943a0766e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00e6c0 con 0x7ff7f8004850 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc00e820 con 0x7ff7f8004850 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.207+0000 7ff803fff700 1 -- 172.21.15.177:0/175049123 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00eb90 con 0x7ff7f8004850 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.208+0000 7ff813960700 1 -- 172.21.15.177:0/175049123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 msgr2=0x7ff7f8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.208+0000 7ff813960700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff7f8004cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009b60 tx=0x7ff7f8005880 comp rx=0 tx=0).stop 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.208+0000 7ff813960700 1 -- 172.21.15.177:0/175049123 shutdown_connections 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.208+0000 7ff813960700 1 --2- 172.21.15.177:0/175049123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff7f8004cd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.208+0000 7ff813960700 1 -- 172.21.15.177:0/175049123 >> 172.21.15.177:0/175049123 conn(0x7ff80c0b2130 msgr2=0x7ff80c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:34.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.208+0000 7ff813960700 1 -- 172.21.15.177:0/175049123 shutdown_connections 2023-11-27T17:48:34.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.208+0000 7ff813960700 1 -- 172.21.15.177:0/175049123 wait complete. 2023-11-27T17:48:34.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.209+0000 7ff813960700 1 Processor -- start 2023-11-27T17:48:34.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.209+0000 7ff813960700 1 -- start start 2023-11-27T17:48:34.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff813960700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff80c0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:34.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff813960700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c1331a0 0x7ff80c0c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:34.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff813960700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff80c0c6760 0x7ff80c134740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:34.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff813960700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1342b0 con 0x7ff7f8004850 2023-11-27T17:48:34.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff813960700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1336a0 con 0x7ff80c1331a0 2023-11-27T17:48:34.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff813960700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c133980 con 0x7ff80c0c6760 2023-11-27T17:48:34.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff8116fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff80c0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:34.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff8116fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff80c0aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52158/0 (socket says 172.21.15.177:52158) 2023-11-27T17:48:34.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.210+0000 7ff8116fc700 1 -- 172.21.15.177:0/1016108438 learned_addr learned my addr 172.21.15.177:0/1016108438 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:34.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff810efb700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c1331a0 0x7ff80c0c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff811efd700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff80c0c6760 0x7ff80c134740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff8116fc700 1 -- 172.21.15.177:0/1016108438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff80c0c6760 msgr2=0x7ff80c134740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff8116fc700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff80c0c6760 0x7ff80c134740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff8116fc700 1 -- 172.21.15.177:0/1016108438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c1331a0 msgr2=0x7ff80c0c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff8116fc700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c1331a0 0x7ff80c0c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff8116fc700 1 -- 172.21.15.177:0/1016108438 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c133c60 con 0x7ff7f8004850 2023-11-27T17:48:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff8116fc700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff80c0aeb40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff80800eaa0 tx=0x7ff80800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff801ffb700 1 -- 172.21.15.177:0/1016108438 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800c5d0 con 0x7ff7f8004850 2023-11-27T17:48:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff801ffb700 1 -- 172.21.15.177:0/1016108438 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800c730 con 0x7ff7f8004850 2023-11-27T17:48:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff801ffb700 1 -- 172.21.15.177:0/1016108438 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800cac0 con 0x7ff7f8004850 2023-11-27T17:48:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c133f40 con 0x7ff7f8004850 2023-11-27T17:48:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.211+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c134c80 con 0x7ff7f8004850 2023-11-27T17:48:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.212+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c073aa0 con 0x7ff7f8004850 2023-11-27T17:48:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.212+0000 7ff801ffb700 1 -- 172.21.15.177:0/1016108438 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff80800cc20 con 0x7ff7f8004850 2023-11-27T17:48:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.213+0000 7ff801ffb700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff7f006b250 0x7ff7f006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.213+0000 7ff801ffb700 1 -- 172.21.15.177:0/1016108438 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff808089620 con 0x7ff7f8004850 2023-11-27T17:48:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.213+0000 7ff810efb700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff7f006b250 0x7ff7f006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.213+0000 7ff810efb700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff7f006b250 0x7ff7f006d710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0090b0 tx=0x7ff7fc01f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.217+0000 7ff801ffb700 1 -- 172.21.15.177:0/1016108438 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff808054350 con 0x7ff7f8004850 2023-11-27T17:48:34.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.451+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff80c069400 con 0x7ff7f8004850 2023-11-27T17:48:34.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.451+0000 7ff801ffb700 1 -- 172.21.15.177:0/1016108438 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff808057970 con 0x7ff7f8004850 2023-11-27T17:48:34.453 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T17:48:34.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff7f006b250 msgr2=0x7ff7f006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:34.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff7f006b250 0x7ff7f006d710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0090b0 tx=0x7ff7fc01f040 comp rx=0 tx=0).stop 2023-11-27T17:48:34.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 msgr2=0x7ff80c0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:34.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff80c0aeb40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff80800eaa0 tx=0x7ff80800edb0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 shutdown_connections 2023-11-27T17:48:34.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff7f006b250 0x7ff7f006d710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff80c0c6760 0x7ff80c134740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7f8004850 0x7ff80c0aeb40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 --2- 172.21.15.177:0/1016108438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c1331a0 0x7ff80c0c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:34.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 >> 172.21.15.177:0/1016108438 conn(0x7ff80c0b2130 msgr2=0x7ff80c0d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:34.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 shutdown_connections 2023-11-27T17:48:34.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:34.453+0000 7ff813960700 1 -- 172.21.15.177:0/1016108438 wait complete. 2023-11-27T17:48:34.467 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T17:48:34.467 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T17:48:34.467 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-27T17:48:34.467 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-27T17:48:34.467 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-27T17:48:34.467 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T17:48:34.467 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T17:48:34.468 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T17:48:34.468 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-27T17:48:34.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.468 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-27T17:48:34.486 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:48:34.486 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:48:34.486 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:48:34.486 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.486 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-27T17:48:34.486 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.486 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:34.487 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:34.487 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:34.487 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:34.487 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:34.487 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:34.487 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T17:48:34.487 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:34.488 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T17:48:34.488 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 41565sec preferred_lft 41565sec 2023-11-27T17:48:34.488 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c8c9:8ccb:1861:d7ec/64 scope link noprefixroute 2023-11-27T17:48:34.488 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.488 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T17:48:34.488 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether ba:82:c5:a8:13:99 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:34.488 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T17:48:34.489 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.489 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e8eb:2eff:fee2:92e6/64 scope link 2023-11-27T17:48:34.489 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.489 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T17:48:34.489 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether ba:82:c5:a8:13:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T17:48:34.489 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::b882:c5ff:fea8:1399/64 scope link tentative 2023-11-27T17:48:34.489 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.490 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T17:48:34.551 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-27T17:48:34.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.553 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-27T17:48:34.611 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-27T17:48:34.611 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T17:48:34.612 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T17:48:34.612 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T17:48:34.612 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T17:48:34.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.612 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:34.612 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:34.612 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T17:48:34.612 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T17:48:34.612 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T17:48:34.612 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:34.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.716 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-27T17:48:34.732 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T17:48:34.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.733 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2023-11-27T17:48:34.790 INFO:teuthology.orchestra.run.smithi177.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-27T17:48:34.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.791 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:34.792 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:34.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T17:48:34.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-27T17:48:34.792 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:34.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:56:e0:59:07:2f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-27T17:48:34.919 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-27T17:48:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c456:e0ff:fe59:72f/64 scope link tentative 2023-11-27T17:48:34.920 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:34.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:34.932 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-27T17:48:35.009 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:48:35.009 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:48:35.009 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:48:35.009 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:35.009 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-27T17:48:35.009 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:35.009 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T17:48:35.010 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:56:e0:59:07:2f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-27T17:48:35.010 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-27T17:48:35.010 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:35.010 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c456:e0ff:fe59:72f/64 scope link tentative 2023-11-27T17:48:35.010 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:35.022 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-27T17:48:35.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:35.022 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:35.022 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:35.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-27T17:48:35.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-27T17:48:35.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-27T17:48:35.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-27T17:48:35.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-27T17:48:35.023 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:35.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:35.271 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:48:35.271 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:48:35.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.1 up 2023-11-27T17:48:35.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.1 master ceph-brx 2023-11-27T17:48:35.271 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:48:35.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:48:35.377 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-27T17:48:35.397 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-27T17:48:35.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:48:35.398 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-27T17:48:35.454 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-11-27T17:48:35.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:35.454 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:35.538 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:35.539 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:35.565 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:35.565 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:35.565 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:48:35.565 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 2@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:48:35.565 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:48:35.565 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:48:35.565 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:48:35.565 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:48:35.643 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 2@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790" 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2023-11-27T17:48:35.644 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=9352b089-d7fa-4b22-a837-e414c87a0ebc" will pass to kernel 2023-11-27T17:48:35.646 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T17:48:35.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:35.646 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-27T17:48:35.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:35.673 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:35.746 INFO:teuthology.orchestra.run.smithi177.stdout:client4594 2023-11-27T17:48:35.746 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:48:35.747 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:35.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:35.805 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:35.877 INFO:teuthology.orchestra.run.smithi177.stdout:client4594 2023-11-27T17:48:35.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:35.878 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:35.950 INFO:teuthology.orchestra.run.smithi177.stdout:client4594 2023-11-27T17:48:35.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:35.951 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9352b089-d7fa-4b22-a837-e414c87a0ebc.client4594/status') 2023-11-27T17:48:36.030 INFO:teuthology.orchestra.run.smithi177.stdout:instance: client.4594 (3)172.21.15.177:0/3117796435 2023-11-27T17:48:36.030 INFO:teuthology.orchestra.run.smithi177.stdout:blocklisted: false 2023-11-27T17:48:36.030 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records in 2023-11-27T17:48:36.030 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records out 2023-11-27T17:48:36.030 INFO:teuthology.orchestra.run.smithi177.stderr:71 bytes copied, 2.1909e-05 s, 3.2 MB/s 2023-11-27T17:48:36.031 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-11-27T17:48:36.031 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T17:48:36.032 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T17:48:36.032 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T17:48:36.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.191+0000 7fed7164c700 1 Processor -- start 2023-11-27T17:48:36.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.191+0000 7fed7164c700 1 -- start start 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed7164c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed6c0cf830 0x7fed6c0b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed7164c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fed6c15b7b0 0x7fed6c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed7164c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c0cfc10 con 0x7fed6c0cb080 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed7164c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c0aef90 con 0x7fed6c15b7b0 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed7164c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c0b3af0 con 0x7fed6c0cf830 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6a7fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fed6c15b7b0 0x7fed6c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6a7fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fed6c15b7b0 0x7fed6c0ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52172/0 (socket says 172.21.15.177:52172) 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6a7fc700 1 -- 172.21.15.177:0/1201450752 learned_addr learned my addr 172.21.15.177:0/1201450752 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:36.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6affd700 1 --2- 172.21.15.177:0/1201450752 >> v2:172.21.15.178:3300/0 conn(0x7fed6c0cf830 0x7fed6c0b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6a7fc700 1 -- 172.21.15.177:0/1201450752 >> v2:172.21.15.178:3300/0 conn(0x7fed6c0cf830 msgr2=0x7fed6c0b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6a7fc700 1 --2- 172.21.15.177:0/1201450752 >> v2:172.21.15.178:3300/0 conn(0x7fed6c0cf830 0x7fed6c0b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6a7fc700 1 -- 172.21.15.177:0/1201450752 >> v1:172.21.15.178:6789/0 conn(0x7fed6c0cb080 legacy=0x7fed6c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6a7fc700 1 -- 172.21.15.177:0/1201450752 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c0b2eb0 con 0x7fed6c15b7b0 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6affd700 1 --2- 172.21.15.177:0/1201450752 >> v2:172.21.15.178:3300/0 conn(0x7fed6c0cf830 0x7fed6c0b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.192+0000 7fed6a7fc700 1 --2- 172.21.15.177:0/1201450752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c15b7b0 0x7fed6c0ae6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fed6c073250 tx=0x7fed60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972c3ba8d5532076 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed69ffb700 1 -- 172.21.15.177:0/1201450752 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60004230 con 0x7fed6c15b7b0 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed69ffb700 1 -- 172.21.15.177:0/1201450752 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed60004390 con 0x7fed6c15b7b0 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed69ffb700 1 -- 172.21.15.177:0/1201450752 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed600036a0 con 0x7fed6c15b7b0 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed7164c700 1 -- 172.21.15.177:0/1201450752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c15b7b0 msgr2=0x7fed6c0ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed7164c700 1 --2- 172.21.15.177:0/1201450752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c15b7b0 0x7fed6c0ae6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fed6c073250 tx=0x7fed60009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed7164c700 1 -- 172.21.15.177:0/1201450752 shutdown_connections 2023-11-27T17:48:36.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed7164c700 1 --2- 172.21.15.177:0/1201450752 >> v2:172.21.15.178:3300/0 conn(0x7fed6c0cf830 0x7fed6c0b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed7164c700 1 --2- 172.21.15.177:0/1201450752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c15b7b0 0x7fed6c0ae6b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed7164c700 1 -- 172.21.15.177:0/1201450752 >> 172.21.15.177:0/1201450752 conn(0x7fed6c0b15d0 msgr2=0x7fed6c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:36.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed7164c700 1 -- 172.21.15.177:0/1201450752 shutdown_connections 2023-11-27T17:48:36.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.193+0000 7fed7164c700 1 -- 172.21.15.177:0/1201450752 wait complete. 2023-11-27T17:48:36.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.195+0000 7fed7164c700 1 Processor -- start 2023-11-27T17:48:36.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.195+0000 7fed7164c700 1 -- start start 2023-11-27T17:48:36.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed7164c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c0cb080 0x7fed6c14d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed7164c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed6c0cf830 0x7fed6c070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed7164c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed6c15b7b0 0x7fed6c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed7164c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c1509c0 con 0x7fed6c0cb080 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed7164c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c14d980 con 0x7fed6c0cf830 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed7164c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c06edc0 con 0x7fed6c15b7b0 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c0cb080 0x7fed6c14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c0cb080 0x7fed6c14d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52176/0 (socket says 172.21.15.177:52176) 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 -- 172.21.15.177:0/1644923229 learned_addr learned my addr 172.21.15.177:0/1644923229 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 -- 172.21.15.177:0/1644923229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed6c15b7b0 msgr2=0x7fed6c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed6c15b7b0 0x7fed6c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 -- 172.21.15.177:0/1644923229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed6c0cf830 msgr2=0x7fed6c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed6c0cf830 0x7fed6c070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 -- 172.21.15.177:0/1644923229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed60009550 con 0x7fed6c0cb080 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed6affd700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c0cb080 0x7fed6c14d440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00c750 tx=0x7fed5c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.196+0000 7fed537fe700 1 -- 172.21.15.177:0/1644923229 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c011800 con 0x7fed6c0cb080 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.197+0000 7fed537fe700 1 -- 172.21.15.177:0/1644923229 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c011960 con 0x7fed6c0cb080 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.197+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c06f090 con 0x7fed6c0cb080 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.197+0000 7fed537fe700 1 -- 172.21.15.177:0/1644923229 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c011cd0 con 0x7fed6c0cb080 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.197+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c150ba0 con 0x7fed6c0cb080 2023-11-27T17:48:36.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.197+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c069400 con 0x7fed6c0cb080 2023-11-27T17:48:36.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.198+0000 7fed537fe700 1 -- 172.21.15.177:0/1644923229 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fed5c021350 con 0x7fed6c0cb080 2023-11-27T17:48:36.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.198+0000 7fed537fe700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed5806b250 0x7fed5806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:36.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.198+0000 7fed537fe700 1 -- 172.21.15.177:0/1644923229 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed5c0899e0 con 0x7fed6c0cb080 2023-11-27T17:48:36.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.198+0000 7fed6a7fc700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed5806b250 0x7fed5806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:36.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.199+0000 7fed6a7fc700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed5806b250 0x7fed5806d710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed6c071710 tx=0x7fed60010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:36.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.203+0000 7fed537fe700 1 -- 172.21.15.177:0/1644923229 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fed5c054710 con 0x7fed6c0cb080 2023-11-27T17:48:36.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.435+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fed6c0cdf60 con 0x7fed6c0cb080 2023-11-27T17:48:36.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.436+0000 7fed537fe700 1 -- 172.21.15.177:0/1644923229 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fed5c01e070 con 0x7fed6c0cb080 2023-11-27T17:48:36.438 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed5806b250 msgr2=0x7fed5806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed5806b250 0x7fed5806d710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed6c071710 tx=0x7fed60010000 comp rx=0 tx=0).stop 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c0cb080 msgr2=0x7fed6c14d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c0cb080 0x7fed6c14d440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00c750 tx=0x7fed5c00cb10 comp rx=0 tx=0).stop 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 shutdown_connections 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed5806b250 0x7fed5806d710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed6c15b7b0 0x7fed6c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed6c0cb080 0x7fed6c14d440 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 --2- 172.21.15.177:0/1644923229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed6c0cf830 0x7fed6c070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:36.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 >> 172.21.15.177:0/1644923229 conn(0x7fed6c0b15d0 msgr2=0x7fed6c0af810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:36.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 shutdown_connections 2023-11-27T17:48:36.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:36.438+0000 7fed7164c700 1 -- 172.21.15.177:0/1644923229 wait complete. 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T17:48:36.452 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T17:48:36.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:36.452 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2023-11-27T17:48:36.473 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:48:36.473 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:48:36.473 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:48:36.473 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:36.474 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T17:48:36.475 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 41869sec preferred_lft 41869sec 2023-11-27T17:48:36.475 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::87db:1857:8406:c287/64 scope link noprefixroute 2023-11-27T17:48:36.475 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:36.475 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T17:48:36.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:36.475 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:36.476 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:36.476 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add name ceph-brx type bridge 2023-11-27T17:48:36.476 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr flush dev ceph-brx 2023-11-27T17:48:36.476 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set ceph-brx up 2023-11-27T17:48:36.476 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T17:48:36.476 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:36.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:36.655 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T17:48:36.682 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-11-27T17:48:36.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:36.683 DEBUG:teuthology.orchestra.run.smithi178:> route 2023-11-27T17:48:36.751 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2023-11-27T17:48:36.751 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T17:48:36.752 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T17:48:36.752 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T17:48:36.752 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T17:48:36.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:36.753 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:36.753 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:36.753 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T17:48:36.753 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T17:48:36.753 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T17:48:36.753 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:36.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:36.990 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-11-27T17:48:37.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:37.007 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2023-11-27T17:48:37.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:37.063 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:37.063 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:37.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T17:48:37.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-27T17:48:37.063 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:37.157 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-27T17:48:37.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:37.157 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:37.157 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:37.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-27T17:48:37.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T17:48:37.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-27T17:48:37.158 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-27T17:48:37.158 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-27T17:48:37.158 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:37.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:37.366 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:37.366 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:37.366 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.0 up 2023-11-27T17:48:37.366 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T17:48:37.366 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:37.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:48:37.467 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T17:48:37.486 INFO:teuthology.orchestra.run.smithi178.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T17:48:37.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:48:37.486 DEBUG:teuthology.orchestra.run.smithi178:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T17:48:37.542 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-27T17:48:37.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:37.542 DEBUG:teuthology.orchestra.run.smithi178:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:37.639 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:37.639 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:37.758 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:37.758 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:37.759 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:48:37.759 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with new device syntax: 1@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:48:37.759 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:48:37.759 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:48:37.759 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:48:37.759 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:48:37.783 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with new device syntax: 1@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790" 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2023-11-27T17:48:37.784 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=9352b089-d7fa-4b22-a837-e414c87a0ebc" will pass to kernel 2023-11-27T17:48:37.787 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T17:48:37.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:37.788 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T17:48:37.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:37.820 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:37.892 INFO:teuthology.orchestra.run.smithi178.stdout:client4597 2023-11-27T17:48:37.892 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:48:37.893 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:37.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:37.950 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:38.022 INFO:teuthology.orchestra.run.smithi178.stdout:client4597 2023-11-27T17:48:38.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.023 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:38.095 INFO:teuthology.orchestra.run.smithi178.stdout:client4597 2023-11-27T17:48:38.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.096 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9352b089-d7fa-4b22-a837-e414c87a0ebc.client4597/status') 2023-11-27T17:48:38.175 INFO:teuthology.orchestra.run.smithi178.stdout:instance: client.4597 (3)192.168.0.1:0/1238081869 2023-11-27T17:48:38.175 INFO:teuthology.orchestra.run.smithi178.stdout:blocklisted: false 2023-11-27T17:48:38.176 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records in 2023-11-27T17:48:38.176 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records out 2023-11-27T17:48:38.177 INFO:teuthology.orchestra.run.smithi178.stderr:69 bytes copied, 2.6396e-05 s, 2.6 MB/s 2023-11-27T17:48:38.177 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-11-27T17:48:38.177 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T17:48:38.177 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-27T17:48:38.177 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T17:48:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.309+0000 7f567a3fb700 1 Processor -- start 2023-11-27T17:48:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.309+0000 7f567a3fb700 1 -- start start 2023-11-27T17:48:38.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f567a3fb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f56741477f0 0x7f56740b5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f567a3fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5674070c00 0x7f56740adee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f567a3fb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56740b68e0 con 0x7f56740b5b80 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f567a3fb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56740ada00 con 0x7f56741477f0 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f567a3fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740b6040 con 0x7f5674070c00 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f5673fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f56741477f0 0x7f56740b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f5673fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f56741477f0 0x7f56740b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52184/0 (socket says 172.21.15.177:52184) 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f56737fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f56740b5b80 0x7f56740704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46502/0 (socket says 172.21.15.177:46502) 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.310+0000 7f5673fff700 1 -- 172.21.15.177:0/2411929473 learned_addr learned my addr 172.21.15.177:0/2411929473 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5678998700 1 --2- 172.21.15.177:0/2411929473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5674070c00 0x7f56740adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5673fff700 1 -- 172.21.15.177:0/2411929473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5674070c00 msgr2=0x7f56740adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5673fff700 1 --2- 172.21.15.177:0/2411929473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5674070c00 0x7f56740adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5673fff700 1 -- 172.21.15.177:0/2411929473 >> v1:172.21.15.177:6789/0 conn(0x7f56740b5b80 legacy=0x7f56740704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5673fff700 1 -- 172.21.15.177:0/2411929473 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740b6320 con 0x7f56741477f0 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5672ffd700 1 -- 172.21.15.177:0/2411929473 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407708433 0 0) 0x7f56740b68e0 con 0x7f56740b5b80 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5673fff700 1 --2- 172.21.15.177:0/2411929473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740b5640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f565c0098f0 tx=0x7f565c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b81720e30d510b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5672ffd700 1 -- 172.21.15.177:0/2411929473 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00b8a0 con 0x7f56741477f0 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5672ffd700 1 -- 172.21.15.177:0/2411929473 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c00ba00 con 0x7f56741477f0 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f5672ffd700 1 -- 172.21.15.177:0/2411929473 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00bd90 con 0x7f56741477f0 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f567a3fb700 1 -- 172.21.15.177:0/2411929473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 msgr2=0x7f56740b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.311+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2411929473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740b5640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f565c0098f0 tx=0x7f565c009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.312+0000 7f567a3fb700 1 -- 172.21.15.177:0/2411929473 shutdown_connections 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.312+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2411929473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5674070c00 0x7f56740adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.312+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2411929473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740b5640 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.312+0000 7f567a3fb700 1 -- 172.21.15.177:0/2411929473 >> 172.21.15.177:0/2411929473 conn(0x7f56740b2130 msgr2=0x7f56740b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.312+0000 7f567a3fb700 1 -- 172.21.15.177:0/2411929473 shutdown_connections 2023-11-27T17:48:38.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.312+0000 7f567a3fb700 1 -- 172.21.15.177:0/2411929473 wait complete. 2023-11-27T17:48:38.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.313+0000 7f567a3fb700 1 Processor -- start 2023-11-27T17:48:38.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.313+0000 7f567a3fb700 1 -- start start 2023-11-27T17:48:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f567a3fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5674070c00 0x7f56741f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f567a3fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56740b5b80 0x7f56741e68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f567a3fb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f567a3fb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741e7a80 con 0x7f56741477f0 2023-11-27T17:48:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f567a3fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567415e440 con 0x7f5674070c00 2023-11-27T17:48:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f567a3fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56741f3a70 con 0x7f56740b5b80 2023-11-27T17:48:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52192/0 (socket says 172.21.15.177:52192) 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 -- 172.21.15.177:0/2103217972 learned_addr learned my addr 172.21.15.177:0/2103217972 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f56737fe700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56740b5b80 0x7f56741e68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5673fff700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5674070c00 0x7f56741f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 -- 172.21.15.177:0/2103217972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56740b5b80 msgr2=0x7f56741e68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56740b5b80 0x7f56741e68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 -- 172.21.15.177:0/2103217972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5674070c00 msgr2=0x7f56741f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5674070c00 0x7f56741f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 -- 172.21.15.177:0/2103217972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c009550 con 0x7f56741477f0 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5678998700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740c6850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f566c007e40 tx=0x7f566c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5670ff9700 1 -- 172.21.15.177:0/2103217972 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c00ed30 con 0x7f56741477f0 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5670ff9700 1 -- 172.21.15.177:0/2103217972 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c014420 con 0x7f56741477f0 2023-11-27T17:48:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56741e7360 con 0x7f56741477f0 2023-11-27T17:48:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.314+0000 7f5670ff9700 1 -- 172.21.15.177:0/2103217972 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0147d0 con 0x7f56741477f0 2023-11-27T17:48:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.315+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56741e7c90 con 0x7f56741477f0 2023-11-27T17:48:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.315+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56741e82e0 con 0x7f56741477f0 2023-11-27T17:48:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.316+0000 7f5670ff9700 1 -- 172.21.15.177:0/2103217972 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f566c014930 con 0x7f56741477f0 2023-11-27T17:48:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.316+0000 7f5670ff9700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f565406b250 0x7f565406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.316+0000 7f5670ff9700 1 -- 172.21.15.177:0/2103217972 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f566c08a060 con 0x7f56741477f0 2023-11-27T17:48:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.316+0000 7f5673fff700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f565406b250 0x7f565406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.317+0000 7f5673fff700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f565406b250 0x7f565406d710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f565c014040 tx=0x7f565c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.321+0000 7f5670ff9700 1 -- 172.21.15.177:0/2103217972 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f566c054d90 con 0x7f56741477f0 2023-11-27T17:48:38.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.556+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5674073aa0 con 0x7f56741477f0 2023-11-27T17:48:38.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.556+0000 7f5670ff9700 1 -- 172.21.15.177:0/2103217972 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f566c0583b0 con 0x7f56741477f0 2023-11-27T17:48:38.559 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T17:48:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f565406b250 msgr2=0x7f565406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f565406b250 0x7f565406d710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f565c014040 tx=0x7f565c008030 comp rx=0 tx=0).stop 2023-11-27T17:48:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 msgr2=0x7f56740c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740c6850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f566c007e40 tx=0x7f566c00e3c0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 shutdown_connections 2023-11-27T17:48:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f565406b250 0x7f565406d710 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56741477f0 0x7f56740c6850 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5674070c00 0x7f56741f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 --2- 172.21.15.177:0/2103217972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56740b5b80 0x7f56741e68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 >> 172.21.15.177:0/2103217972 conn(0x7f56740b2130 msgr2=0x7f567406d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 shutdown_connections 2023-11-27T17:48:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:38.558+0000 7f567a3fb700 1 -- 172.21.15.177:0/2103217972 wait complete. 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T17:48:38.573 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-27T17:48:38.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.574 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2023-11-27T17:48:38.591 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:48:38.591 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:38.592 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 41867sec preferred_lft 41867sec 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::87db:1857:8406:c287/64 scope link noprefixroute 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether a6:8e:e3:7d:1d:a8 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::8db:f1ff:fe1d:46e7/64 scope link 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether a6:8e:e3:7d:1d:a8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::a48e:e3ff:fe7d:1da8/64 scope link tentative 2023-11-27T17:48:38.593 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:38.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.594 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T17:48:38.657 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-11-27T17:48:38.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.659 DEBUG:teuthology.orchestra.run.smithi178:> route 2023-11-27T17:48:38.717 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2023-11-27T17:48:38.718 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T17:48:38.718 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T17:48:38.718 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T17:48:38.718 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T17:48:38.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.718 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:38.718 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:38.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T17:48:38.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T17:48:38.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T17:48:38.719 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:38.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.823 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-11-27T17:48:38.840 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T17:48:38.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.840 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2023-11-27T17:48:38.896 INFO:teuthology.orchestra.run.smithi178.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-27T17:48:38.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.896 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:38.897 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:38.897 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-27T17:48:38.897 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-27T17:48:38.897 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:38.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:38.989 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-27T17:48:39.032 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:48:39.032 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:48:39.032 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:48:39.032 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:39.033 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-11-27T17:48:39.033 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:39.033 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T17:48:39.033 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 32:b7:63:ed:7f:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-27T17:48:39.033 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-27T17:48:39.033 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:39.033 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::30b7:63ff:feed:7fb6/64 scope link tentative 2023-11-27T17:48:39.033 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:39.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:39.046 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-27T17:48:39.121 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:48:39.121 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:48:39.121 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:48:39.121 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:39.121 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-11-27T17:48:39.122 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:39.122 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T17:48:39.122 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 32:b7:63:ed:7f:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-27T17:48:39.122 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-27T17:48:39.122 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:39.122 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::30b7:63ff:feed:7fb6/64 scope link 2023-11-27T17:48:39.122 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:48:39.137 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-27T17:48:39.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:39.137 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:39.137 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:39.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-27T17:48:39.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-27T17:48:39.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-27T17:48:39.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-27T17:48:39.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-27T17:48:39.138 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:39.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:39.404 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-11-27T17:48:39.404 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-11-27T17:48:39.404 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.1 up 2023-11-27T17:48:39.404 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.1 master ceph-brx 2023-11-27T17:48:39.404 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-11-27T17:48:39.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:48:39.510 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-27T17:48:39.532 INFO:teuthology.orchestra.run.smithi178.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-27T17:48:39.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:48:39.533 DEBUG:teuthology.orchestra.run.smithi178:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-27T17:48:39.589 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-11-27T17:48:39.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:39.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:39.674 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:39.674 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:39.699 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:39.699 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:39.699 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:48:39.699 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with new device syntax: 3@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:48:39.699 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:48:39.699 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:48:39.699 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:48:39.699 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:48:39.733 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:48:39.733 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with new device syntax: 3@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790" 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2023-11-27T17:48:39.734 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=9352b089-d7fa-4b22-a837-e414c87a0ebc" will pass to kernel 2023-11-27T17:48:39.736 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T17:48:39.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:39.736 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-27T17:48:39.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:39.770 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:39.841 INFO:teuthology.orchestra.run.smithi178.stdout:client4603 2023-11-27T17:48:39.842 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:48:39.842 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:39.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:39.899 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:39.970 INFO:teuthology.orchestra.run.smithi178.stdout:client4603 2023-11-27T17:48:39.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:39.971 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:48:40.042 INFO:teuthology.orchestra.run.smithi178.stdout:client4603 2023-11-27T17:48:40.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:40.043 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9352b089-d7fa-4b22-a837-e414c87a0ebc.client4603/status') 2023-11-27T17:48:40.122 INFO:teuthology.orchestra.run.smithi178.stdout:instance: client.4603 (3)192.168.0.2:0/1097636645 2023-11-27T17:48:40.123 INFO:teuthology.orchestra.run.smithi178.stdout:blocklisted: false 2023-11-27T17:48:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records in 2023-11-27T17:48:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records out 2023-11-27T17:48:40.123 INFO:teuthology.orchestra.run.smithi178.stderr:69 bytes copied, 2.1749e-05 s, 3.2 MB/s 2023-11-27T17:48:40.124 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-27T17:48:40.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.270+0000 7ff71d3fc700 1 Processor -- start 2023-11-27T17:48:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.270+0000 7ff71d3fc700 1 -- start start 2023-11-27T17:48:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff71d3fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff7181586c0 0x7ff718161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff71d3fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff71815ee80 0x7ff718072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff71d3fc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff718141230 con 0x7ff718072ad0 2023-11-27T17:48:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff71d3fc700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff718070550 con 0x7ff71815ee80 2023-11-27T17:48:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff71d3fc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff718072ee0 con 0x7ff7181586c0 2023-11-27T17:48:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff7167fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff71815ee80 0x7ff718072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff7167fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff71815ee80 0x7ff718072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52202/0 (socket says 172.21.15.177:52202) 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff7167fc700 1 -- 172.21.15.177:0/777551801 learned_addr learned my addr 172.21.15.177:0/777551801 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.271+0000 7ff716ffd700 1 --2- 172.21.15.177:0/777551801 >> v2:172.21.15.178:3300/0 conn(0x7ff7181586c0 0x7ff718161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff7167fc700 1 -- 172.21.15.177:0/777551801 >> v2:172.21.15.178:3300/0 conn(0x7ff7181586c0 msgr2=0x7ff718161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff7167fc700 1 --2- 172.21.15.177:0/777551801 >> v2:172.21.15.178:3300/0 conn(0x7ff7181586c0 0x7ff718161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff7167fc700 1 -- 172.21.15.177:0/777551801 >> v1:172.21.15.178:6789/0 conn(0x7ff718072ad0 legacy=0x7ff718143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff7167fc700 1 -- 172.21.15.177:0/777551801 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718162040 con 0x7ff71815ee80 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff7167fc700 1 --2- 172.21.15.177:0/777551801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff71815ee80 0x7ff718072590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff7180ba3b0 tx=0x7ff708009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ceb1146e5cc1be7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff715ffb700 1 -- 172.21.15.177:0/777551801 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708004230 con 0x7ff71815ee80 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff715ffb700 1 -- 172.21.15.177:0/777551801 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708004390 con 0x7ff71815ee80 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff715ffb700 1 -- 172.21.15.177:0/777551801 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7080036a0 con 0x7ff71815ee80 2023-11-27T17:48:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff71d3fc700 1 -- 172.21.15.177:0/777551801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff71815ee80 msgr2=0x7ff718072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/777551801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff71815ee80 0x7ff718072590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff7180ba3b0 tx=0x7ff708009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff71d3fc700 1 -- 172.21.15.177:0/777551801 shutdown_connections 2023-11-27T17:48:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/777551801 >> v2:172.21.15.178:3300/0 conn(0x7ff7181586c0 0x7ff718161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/777551801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff71815ee80 0x7ff718072590 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff71d3fc700 1 -- 172.21.15.177:0/777551801 >> 172.21.15.177:0/777551801 conn(0x7ff7180b6110 msgr2=0x7ff7180b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.272+0000 7ff71d3fc700 1 -- 172.21.15.177:0/777551801 shutdown_connections 2023-11-27T17:48:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.273+0000 7ff71d3fc700 1 -- 172.21.15.177:0/777551801 wait complete. 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.274+0000 7ff71d3fc700 1 Processor -- start 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.274+0000 7ff71d3fc700 1 -- start start 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff71d3fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff718072ad0 0x7ff7180b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff71d3fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7181586c0 0x7ff718152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff71d3fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff71815ee80 0x7ff718153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff71d3fc700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71815a470 con 0x7ff718072ad0 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff71d3fc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181598f0 con 0x7ff71815ee80 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff71d3fc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff718159bd0 con 0x7ff7181586c0 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff718072ad0 0x7ff7180b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff718072ad0 0x7ff7180b7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52204/0 (socket says 172.21.15.177:52204) 2023-11-27T17:48:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 -- 172.21.15.177:0/1827760695 learned_addr learned my addr 172.21.15.177:0/1827760695 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff7167fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7181586c0 0x7ff718152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff7177fe700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff71815ee80 0x7ff718153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 -- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7181586c0 msgr2=0x7ff718152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7181586c0 0x7ff718152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 -- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff71815ee80 msgr2=0x7ff718153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff71815ee80 0x7ff718153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 -- 172.21.15.177:0/1827760695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708009550 con 0x7ff718072ad0 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff7177fe700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff71815ee80 0x7ff718153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff7167fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7181586c0 0x7ff718152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff716ffd700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff718072ad0 0x7ff7180b7560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff70000e810 tx=0x7ff70000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff70f7fe700 1 -- 172.21.15.177:0/1827760695 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700013610 con 0x7ff718072ad0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff70f7fe700 1 -- 172.21.15.177:0/1827760695 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff700013770 con 0x7ff718072ad0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff70f7fe700 1 -- 172.21.15.177:0/1827760695 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700013b20 con 0x7ff718072ad0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff718159eb0 con 0x7ff718072ad0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.275+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7180b7aa0 con 0x7ff718072ad0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.276+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7180b7c90 con 0x7ff718072ad0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.277+0000 7ff70f7fe700 1 -- 172.21.15.177:0/1827760695 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff700013c80 con 0x7ff718072ad0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.277+0000 7ff70f7fe700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff6f806b280 0x7ff6f806d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.277+0000 7ff70f7fe700 1 -- 172.21.15.177:0/1827760695 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff700089680 con 0x7ff718072ad0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.277+0000 7ff7167fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff6f806b280 0x7ff6f806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.278+0000 7ff7167fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff6f806b280 0x7ff6f806d740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7180b8520 tx=0x7ff708008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.282+0000 7ff70f7fe700 1 -- 172.21.15.177:0/1827760695 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff7000543c0 con 0x7ff718072ad0 2023-11-27T17:48:40.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.473+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff718069400 con 0x7ff718072ad0 2023-11-27T17:48:40.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.474+0000 7ff70f7fe700 1 -- 172.21.15.177:0/1827760695 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7ff7000579e0 con 0x7ff718072ad0 2023-11-27T17:48:40.476 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:40.477 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff6f806b280 msgr2=0x7ff6f806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff6f806b280 0x7ff6f806d740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7180b8520 tx=0x7ff708008030 comp rx=0 tx=0).stop 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff718072ad0 msgr2=0x7ff7180b7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff718072ad0 0x7ff7180b7560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff70000e810 tx=0x7ff70000ebd0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 shutdown_connections 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff6f806b280 0x7ff6f806d740 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff71815ee80 0x7ff718153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff718072ad0 0x7ff7180b7560 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 --2- 172.21.15.177:0/1827760695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7181586c0 0x7ff718152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 >> 172.21.15.177:0/1827760695 conn(0x7ff7180b6110 msgr2=0x7ff71815d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:40.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 shutdown_connections 2023-11-27T17:48:40.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.476+0000 7ff71d3fc700 1 -- 172.21.15.177:0/1827760695 wait complete. 2023-11-27T17:48:40.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:40.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:40.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.612+0000 7f45bd61a700 1 Processor -- start 2023-11-27T17:48:40.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.612+0000 7f45bd61a700 1 -- start start 2023-11-27T17:48:40.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45bd61a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45b813eb80 0x7f45b80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45bd61a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45b813ef60 0x7f45b81414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45bd61a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b8141e60 con 0x7f45b81419f0 2023-11-27T17:48:40.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45bd61a700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b815d420 con 0x7f45b813ef60 2023-11-27T17:48:40.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45bd61a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b80cf720 con 0x7f45b813eb80 2023-11-27T17:48:40.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b67fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45b813ef60 0x7f45b81414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b67fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45b813ef60 0x7f45b81414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52214/0 (socket says 172.21.15.177:52214) 2023-11-27T17:48:40.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b67fc700 1 -- 172.21.15.177:0/867714322 learned_addr learned my addr 172.21.15.177:0/867714322 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:40.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b6ffd700 1 --2- 172.21.15.177:0/867714322 >> v2:172.21.15.178:3300/0 conn(0x7f45b813eb80 0x7f45b80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b67fc700 1 -- 172.21.15.177:0/867714322 >> v2:172.21.15.178:3300/0 conn(0x7f45b813eb80 msgr2=0x7f45b80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b67fc700 1 --2- 172.21.15.177:0/867714322 >> v2:172.21.15.178:3300/0 conn(0x7f45b813eb80 0x7f45b80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b67fc700 1 -- 172.21.15.177:0/867714322 >> v1:172.21.15.178:6789/0 conn(0x7f45b81419f0 legacy=0x7f45b815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b67fc700 1 -- 172.21.15.177:0/867714322 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b815d140 con 0x7f45b813ef60 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.613+0000 7f45b67fc700 1 --2- 172.21.15.177:0/867714322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813ef60 0x7f45b81414b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b57d0 tx=0x7f45ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40c39c2ed1a934e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45b5ffb700 1 -- 172.21.15.177:0/867714322 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011830 con 0x7f45b813ef60 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45b5ffb700 1 -- 172.21.15.177:0/867714322 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac011990 con 0x7f45b813ef60 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45b5ffb700 1 -- 172.21.15.177:0/867714322 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011d20 con 0x7f45b813ef60 2023-11-27T17:48:40.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45bd61a700 1 -- 172.21.15.177:0/867714322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813ef60 msgr2=0x7f45b81414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45bd61a700 1 --2- 172.21.15.177:0/867714322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813ef60 0x7f45b81414b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b57d0 tx=0x7f45ac009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45bd61a700 1 -- 172.21.15.177:0/867714322 shutdown_connections 2023-11-27T17:48:40.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45bd61a700 1 --2- 172.21.15.177:0/867714322 >> v2:172.21.15.178:3300/0 conn(0x7f45b813eb80 0x7f45b80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45bd61a700 1 --2- 172.21.15.177:0/867714322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813ef60 0x7f45b81414b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45bd61a700 1 -- 172.21.15.177:0/867714322 >> 172.21.15.177:0/867714322 conn(0x7f45b80b31d0 msgr2=0x7f45b80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:40.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45bd61a700 1 -- 172.21.15.177:0/867714322 shutdown_connections 2023-11-27T17:48:40.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.614+0000 7f45bd61a700 1 -- 172.21.15.177:0/867714322 wait complete. 2023-11-27T17:48:40.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.616+0000 7f45bd61a700 1 Processor -- start 2023-11-27T17:48:40.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.616+0000 7f45bd61a700 1 -- start start 2023-11-27T17:48:40.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.616+0000 7f45bd61a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813eb80 0x7f45b813b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.616+0000 7f45bd61a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45b81419f0 0x7f45b8159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45bd61a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45b8157da0 0x7f45b81403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45bd61a700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8159090 con 0x7f45b813eb80 2023-11-27T17:48:40.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45bd61a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8158230 con 0x7f45b81419f0 2023-11-27T17:48:40.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45bd61a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b81564f0 con 0x7f45b8157da0 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813eb80 0x7f45b813b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813eb80 0x7f45b813b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52218/0 (socket says 172.21.15.177:52218) 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 -- 172.21.15.177:0/3347535218 learned_addr learned my addr 172.21.15.177:0/3347535218 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b67fc700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45b81419f0 0x7f45b8159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b77fe700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45b8157da0 0x7f45b81403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 -- 172.21.15.177:0/3347535218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45b8157da0 msgr2=0x7f45b81403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45b8157da0 0x7f45b81403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 -- 172.21.15.177:0/3347535218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45b81419f0 msgr2=0x7f45b8159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45b81419f0 0x7f45b8159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 -- 172.21.15.177:0/3347535218 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac009550 con 0x7f45b813eb80 2023-11-27T17:48:40.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45b6ffd700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813eb80 0x7f45b813b070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45a800e9b0 tx=0x7f45a800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f459f7fe700 1 -- 172.21.15.177:0/3347535218 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a8009710 con 0x7f45b813eb80 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f459f7fe700 1 -- 172.21.15.177:0/3347535218 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a800ee50 con 0x7f45b813eb80 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b8158480 con 0x7f45b813eb80 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f459f7fe700 1 -- 172.21.15.177:0/3347535218 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a800ca50 con 0x7f45b813eb80 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.617+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b8158a40 con 0x7f45b813eb80 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.618+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b8069400 con 0x7f45b813eb80 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.619+0000 7f459f7fe700 1 -- 172.21.15.177:0/3347535218 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f45a800cbb0 con 0x7f45b813eb80 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.619+0000 7f459f7fe700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f45a406b250 0x7f45a406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.619+0000 7f459f7fe700 1 -- 172.21.15.177:0/3347535218 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45a80899a0 con 0x7f45b813eb80 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.619+0000 7f45b67fc700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f45a406b250 0x7f45a406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.620+0000 7f45b67fc700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f45a406b250 0x7f45a406d710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b5330 tx=0x7f45ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.624+0000 7f459f7fe700 1 -- 172.21.15.177:0/3347535218 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f45a80546d0 con 0x7f45b813eb80 2023-11-27T17:48:40.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.814+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45b815ce80 con 0x7f45b813eb80 2023-11-27T17:48:40.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.814+0000 7f459f7fe700 1 -- 172.21.15.177:0/3347535218 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45a80210a0 con 0x7f45b813eb80 2023-11-27T17:48:40.817 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:40.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f45a406b250 msgr2=0x7f45a406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f45a406b250 0x7f45a406d710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b5330 tx=0x7f45ac008030 comp rx=0 tx=0).stop 2023-11-27T17:48:40.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813eb80 msgr2=0x7f45b813b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813eb80 0x7f45b813b070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45a800e9b0 tx=0x7f45a800ecc0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 shutdown_connections 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f45a406b250 0x7f45a406d710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45b8157da0 0x7f45b81403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b813eb80 0x7f45b813b070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 --2- 172.21.15.177:0/3347535218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45b81419f0 0x7f45b8159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 >> 172.21.15.177:0/3347535218 conn(0x7f45b80b31d0 msgr2=0x7f45b806e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 shutdown_connections 2023-11-27T17:48:40.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.817+0000 7f45bd61a700 1 -- 172.21.15.177:0/3347535218 wait complete. 2023-11-27T17:48:40.831 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:40.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.952+0000 7f6c6c718700 1 Processor -- start 2023-11-27T17:48:40.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.952+0000 7f6c6c718700 1 -- start start 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c6c718700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c640cdff0 0x7f6c64162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c6c718700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640afc30 0x7f6c640cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c6c718700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c64162bc0 con 0x7f6c64146f00 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c6c718700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c641472e0 con 0x7f6c640cdff0 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c6c718700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640b0110 con 0x7f6c640afc30 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c69cb3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c640cdff0 0x7f6c64162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c69cb3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c640cdff0 0x7f6c64162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52228/0 (socket says 172.21.15.177:52228) 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c6a4b4700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6c64146f00 0x7f6c640cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46544/0 (socket says 172.21.15.177:46544) 2023-11-27T17:48:40.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c69cb3700 1 -- 172.21.15.177:0/1662478423 learned_addr learned my addr 172.21.15.177:0/1662478423 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c6acb5700 1 --2- 172.21.15.177:0/1662478423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640afc30 0x7f6c640cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c69cb3700 1 -- 172.21.15.177:0/1662478423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640afc30 msgr2=0x7f6c640cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c69cb3700 1 --2- 172.21.15.177:0/1662478423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640afc30 0x7f6c640cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c69cb3700 1 -- 172.21.15.177:0/1662478423 >> v1:172.21.15.177:6789/0 conn(0x7f6c64146f00 legacy=0x7f6c640cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c69cb3700 1 -- 172.21.15.177:0/1662478423 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640b03f0 con 0x7f6c640cdff0 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c694b2700 1 -- 172.21.15.177:0/1662478423 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096959260 0 0) 0x7f6c64162bc0 con 0x7f6c64146f00 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.953+0000 7f6c69cb3700 1 --2- 172.21.15.177:0/1662478423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c640cdff0 0x7f6c64162680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c600098f0 tx=0x7f6c60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9eb6fccf847a847 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c694b2700 1 -- 172.21.15.177:0/1662478423 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000b8a0 con 0x7f6c640cdff0 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c694b2700 1 -- 172.21.15.177:0/1662478423 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6000ba00 con 0x7f6c640cdff0 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c694b2700 1 -- 172.21.15.177:0/1662478423 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000bd90 con 0x7f6c640cdff0 2023-11-27T17:48:40.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c6c718700 1 -- 172.21.15.177:0/1662478423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c640cdff0 msgr2=0x7f6c64162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1662478423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c640cdff0 0x7f6c64162680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c600098f0 tx=0x7f6c60009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:40.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c6c718700 1 -- 172.21.15.177:0/1662478423 shutdown_connections 2023-11-27T17:48:40.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1662478423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640afc30 0x7f6c640cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1662478423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c640cdff0 0x7f6c64162680 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c6c718700 1 -- 172.21.15.177:0/1662478423 >> 172.21.15.177:0/1662478423 conn(0x7f6c640b38b0 msgr2=0x7f6c640b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:40.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c6c718700 1 -- 172.21.15.177:0/1662478423 shutdown_connections 2023-11-27T17:48:40.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.954+0000 7f6c6c718700 1 -- 172.21.15.177:0/1662478423 wait complete. 2023-11-27T17:48:40.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.955+0000 7f6c6c718700 1 Processor -- start 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.955+0000 7f6c6c718700 1 -- start start 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6c718700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640afc30 0x7f6c6413fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6c718700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640cdff0 0x7f6c640b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6c718700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c64146f00 0x7f6c640b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6c718700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64073430 con 0x7f6c64146f00 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6c718700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64073150 con 0x7f6c640afc30 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6c718700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6415d940 con 0x7f6c640cdff0 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6acb5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c64146f00 0x7f6c640b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6acb5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c64146f00 0x7f6c640b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52236/0 (socket says 172.21.15.177:52236) 2023-11-27T17:48:40.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6acb5700 1 -- 172.21.15.177:0/1898685965 learned_addr learned my addr 172.21.15.177:0/1898685965 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c69cb3700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640cdff0 0x7f6c640b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6a4b4700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640afc30 0x7f6c6413fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6acb5700 1 -- 172.21.15.177:0/1898685965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640cdff0 msgr2=0x7f6c640b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6acb5700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640cdff0 0x7f6c640b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6acb5700 1 -- 172.21.15.177:0/1898685965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640afc30 msgr2=0x7f6c6413fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6acb5700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640afc30 0x7f6c6413fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.956+0000 7f6c6acb5700 1 -- 172.21.15.177:0/1898685965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009550 con 0x7f6c64146f00 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.957+0000 7f6c6acb5700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c64146f00 0x7f6c640b5610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009fd0 tx=0x7f6c5c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.957+0000 7f6c5affd700 1 -- 172.21.15.177:0/1898685965 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c007ea0 con 0x7f6c64146f00 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.957+0000 7f6c5affd700 1 -- 172.21.15.177:0/1898685965 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c00ed30 con 0x7f6c64146f00 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.957+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6415dc20 con 0x7f6c64146f00 2023-11-27T17:48:40.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.957+0000 7f6c5affd700 1 -- 172.21.15.177:0/1898685965 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00eea0 con 0x7f6c64146f00 2023-11-27T17:48:40.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.957+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c641403b0 con 0x7f6c64146f00 2023-11-27T17:48:40.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.958+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6415d7a0 con 0x7f6c64146f00 2023-11-27T17:48:40.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.958+0000 7f6c5affd700 1 -- 172.21.15.177:0/1898685965 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6c5c014660 con 0x7f6c64146f00 2023-11-27T17:48:40.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.959+0000 7f6c5affd700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6c4806b250 0x7f6c4806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:40.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.959+0000 7f6c5affd700 1 -- 172.21.15.177:0/1898685965 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c5c08a0c0 con 0x7f6c64146f00 2023-11-27T17:48:40.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.959+0000 7f6c6a4b4700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6c4806b250 0x7f6c4806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:40.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.959+0000 7f6c6a4b4700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6c4806b250 0x7f6c4806d710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c54007fd0 tx=0x7f6c54007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:40.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:40.963+0000 7f6c5affd700 1 -- 172.21.15.177:0/1898685965 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6c6415d7a0 con 0x7f6c64146f00 2023-11-27T17:48:41.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.155+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c6415d7a0 con 0x7f6c64146f00 2023-11-27T17:48:41.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.155+0000 7f6c5affd700 1 -- 172.21.15.177:0/1898685965 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c6415d7a0 con 0x7f6c64146f00 2023-11-27T17:48:41.158 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:41.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6c4806b250 msgr2=0x7f6c4806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6c4806b250 0x7f6c4806d710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c54007fd0 tx=0x7f6c54007de0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c64146f00 msgr2=0x7f6c640b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c64146f00 0x7f6c640b5610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009fd0 tx=0x7f6c5c00e3c0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 shutdown_connections 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6c4806b250 0x7f6c4806d710 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c64146f00 0x7f6c640b5610 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640afc30 0x7f6c6413fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 --2- 172.21.15.177:0/1898685965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640cdff0 0x7f6c640b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 >> 172.21.15.177:0/1898685965 conn(0x7f6c640b38b0 msgr2=0x7f6c6406d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 shutdown_connections 2023-11-27T17:48:41.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.158+0000 7f6c6c718700 1 -- 172.21.15.177:0/1898685965 wait complete. 2023-11-27T17:48:41.172 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:41.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.294+0000 7f4f281ae700 1 Processor -- start 2023-11-27T17:48:41.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.294+0000 7f4f281ae700 1 -- start start 2023-11-27T17:48:41.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f281ae700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4f2013eb80 0x7f4f200cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f281ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013ef60 0x7f4f201414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f281ae700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f20141e50 con 0x7f4f201419f0 2023-11-27T17:48:41.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f281ae700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2015d420 con 0x7f4f2013eb80 2023-11-27T17:48:41.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f281ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200cf720 con 0x7f4f2013ef60 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f25f4a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4f2013eb80 0x7f4f200cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f2674b700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f4f201419f0 0x7f4f2015c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46562/0 (socket says 172.21.15.177:46562) 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f25f4a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4f2013eb80 0x7f4f200cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52240/0 (socket says 172.21.15.177:52240) 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f2674b700 1 -- 172.21.15.177:0/3159381873 learned_addr learned my addr 172.21.15.177:0/3159381873 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.295+0000 7f4f25749700 1 --2- 172.21.15.177:0/3159381873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013ef60 0x7f4f201414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f25f4a700 1 -- 172.21.15.177:0/3159381873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013ef60 msgr2=0x7f4f201414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f25f4a700 1 --2- 172.21.15.177:0/3159381873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013ef60 0x7f4f201414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f25f4a700 1 -- 172.21.15.177:0/3159381873 >> v1:172.21.15.177:6789/0 conn(0x7f4f201419f0 legacy=0x7f4f2015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f25f4a700 1 -- 172.21.15.177:0/3159381873 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2015d140 con 0x7f4f2013eb80 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f24f48700 1 -- 172.21.15.177:0/3159381873 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492797018 0 0) 0x7f4f20141e50 con 0x7f4f201419f0 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f25749700 1 --2- 172.21.15.177:0/3159381873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013ef60 0x7f4f201414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f25f4a700 1 --2- 172.21.15.177:0/3159381873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2013eb80 0x7f4f200cf1e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009840 tx=0x7f4f10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104d761e59d612b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f24f48700 1 -- 172.21.15.177:0/3159381873 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10011830 con 0x7f4f2013eb80 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f24f48700 1 -- 172.21.15.177:0/3159381873 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10011990 con 0x7f4f2013eb80 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f24f48700 1 -- 172.21.15.177:0/3159381873 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10011d20 con 0x7f4f2013eb80 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f281ae700 1 -- 172.21.15.177:0/3159381873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2013eb80 msgr2=0x7f4f200cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.296+0000 7f4f281ae700 1 --2- 172.21.15.177:0/3159381873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2013eb80 0x7f4f200cf1e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009840 tx=0x7f4f10009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.297+0000 7f4f281ae700 1 -- 172.21.15.177:0/3159381873 shutdown_connections 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.297+0000 7f4f281ae700 1 --2- 172.21.15.177:0/3159381873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f2013eb80 0x7f4f200cf1e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.297+0000 7f4f281ae700 1 --2- 172.21.15.177:0/3159381873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013ef60 0x7f4f201414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.297+0000 7f4f281ae700 1 -- 172.21.15.177:0/3159381873 >> 172.21.15.177:0/3159381873 conn(0x7f4f200b31d0 msgr2=0x7f4f200b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.297+0000 7f4f281ae700 1 -- 172.21.15.177:0/3159381873 shutdown_connections 2023-11-27T17:48:41.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.297+0000 7f4f281ae700 1 -- 172.21.15.177:0/3159381873 wait complete. 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.298+0000 7f4f281ae700 1 Processor -- start 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.298+0000 7f4f281ae700 1 -- start start 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.298+0000 7f4f281ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013eb80 0x7f4f20153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.298+0000 7f4f281ae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f201419f0 0x7f4f20158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.298+0000 7f4f281ae700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f20156aa0 0x7f4f20151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.298+0000 7f4f281ae700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f201563f0 con 0x7f4f20156aa0 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.298+0000 7f4f281ae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f20153b60 con 0x7f4f201419f0 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.298+0000 7f4f281ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2013c6f0 con 0x7f4f2013eb80 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f20156aa0 0x7f4f20151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f20156aa0 0x7f4f20151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52250/0 (socket says 172.21.15.177:52250) 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 -- 172.21.15.177:0/1757708039 learned_addr learned my addr 172.21.15.177:0/1757708039 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f25f4a700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013eb80 0x7f4f20153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f25749700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f201419f0 0x7f4f20158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 -- 172.21.15.177:0/1757708039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013eb80 msgr2=0x7f4f20153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013eb80 0x7f4f20153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 -- 172.21.15.177:0/1757708039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f201419f0 msgr2=0x7f4f20158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f201419f0 0x7f4f20158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 -- 172.21.15.177:0/1757708039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f100094a0 con 0x7f4f20156aa0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f2674b700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f20156aa0 0x7f4f20151bc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800cba0 tx=0x7f4f1800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f167fc700 1 -- 172.21.15.177:0/1757708039 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800aaa0 con 0x7f4f20156aa0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f167fc700 1 -- 172.21.15.177:0/1757708039 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1800ac20 con 0x7f4f20156aa0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2013c9d0 con 0x7f4f20156aa0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f167fc700 1 -- 172.21.15.177:0/1757708039 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f180070d0 con 0x7f4f20156aa0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.299+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2013cf90 con 0x7f4f20156aa0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.300+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f20069400 con 0x7f4f20156aa0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.301+0000 7f4f167fc700 1 -- 172.21.15.177:0/1757708039 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4f18007230 con 0x7f4f20156aa0 2023-11-27T17:48:41.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.301+0000 7f4f167fc700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4f0406b250 0x7f4f0406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.301+0000 7f4f25f4a700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4f0406b250 0x7f4f0406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.301+0000 7f4f167fc700 1 -- 172.21.15.177:0/1757708039 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f18089770 con 0x7f4f20156aa0 2023-11-27T17:48:41.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.301+0000 7f4f25f4a700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4f0406b250 0x7f4f0406d710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f100090b0 tx=0x7f4f10008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.306+0000 7f4f167fc700 1 -- 172.21.15.177:0/1757708039 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4f18054410 con 0x7f4f20156aa0 2023-11-27T17:48:41.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.494+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f200b5c90 con 0x7f4f20156aa0 2023-11-27T17:48:41.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.495+0000 7f4f167fc700 1 -- 172.21.15.177:0/1757708039 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f18018020 con 0x7f4f20156aa0 2023-11-27T17:48:41.497 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:41.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4f0406b250 msgr2=0x7f4f0406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4f0406b250 0x7f4f0406d710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f100090b0 tx=0x7f4f10008030 comp rx=0 tx=0).stop 2023-11-27T17:48:41.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f20156aa0 msgr2=0x7f4f20151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f20156aa0 0x7f4f20151bc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800cba0 tx=0x7f4f1800ceb0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 shutdown_connections 2023-11-27T17:48:41.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4f0406b250 0x7f4f0406d710 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f20156aa0 0x7f4f20151bc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2013eb80 0x7f4f20153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 --2- 172.21.15.177:0/1757708039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f201419f0 0x7f4f20158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 >> 172.21.15.177:0/1757708039 conn(0x7f4f200b31d0 msgr2=0x7f4f200b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:41.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 shutdown_connections 2023-11-27T17:48:41.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.497+0000 7f4f281ae700 1 -- 172.21.15.177:0/1757708039 wait complete. 2023-11-27T17:48:41.511 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:41.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.628+0000 7ff0d1d72700 1 Processor -- start 2023-11-27T17:48:41.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.628+0000 7ff0d1d72700 1 -- start start 2023-11-27T17:48:41.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.629+0000 7ff0d1d72700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0cc147880 0x7ff0cc06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.629+0000 7ff0d1d72700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc070c00 0x7ff0cc15f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.629+0000 7ff0d1d72700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0cc0b5ce0 con 0x7ff0cc0b6170 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.629+0000 7ff0d1d72700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0cc0b5700 con 0x7ff0cc147880 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.629+0000 7ff0d1d72700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc06e230 con 0x7ff0cc070c00 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cbfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc070c00 0x7ff0cc15f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cb7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0cc147880 0x7ff0cc06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cb7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0cc147880 0x7ff0cc06d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:60276/0 (socket says 172.21.15.177:60276) 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cbfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc070c00 0x7ff0cc15f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39724/0 (socket says 172.21.15.177:39724) 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cb7fe700 1 -- 172.21.15.177:0/680122003 learned_addr learned my addr 172.21.15.177:0/680122003 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0caffd700 1 --1- 172.21.15.177:0/680122003 >> v1:172.21.15.178:6789/0 conn(0x7ff0cc0b6170 0x7ff0cc0704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45550/0 (socket says 172.21.15.177:45550) 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cb7fe700 1 -- 172.21.15.177:0/680122003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc070c00 msgr2=0x7ff0cc15f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cb7fe700 1 --2- 172.21.15.177:0/680122003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc070c00 0x7ff0cc15f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cb7fe700 1 -- 172.21.15.177:0/680122003 >> v1:172.21.15.178:6789/0 conn(0x7ff0cc0b6170 legacy=0x7ff0cc0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cb7fe700 1 -- 172.21.15.177:0/680122003 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc0b5970 con 0x7ff0cc147880 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0ca7fc700 1 -- 172.21.15.177:0/680122003 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971896124 0 0) 0x7ff0cc0b5ce0 con 0x7ff0cc0b6170 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cbfff700 1 --2- 172.21.15.177:0/680122003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc070c00 0x7ff0cc15f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0cb7fe700 1 --2- 172.21.15.177:0/680122003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 0x7ff0cc06d910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009e50 tx=0x7ff0bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63170be8efc31897 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0ca7fc700 1 -- 172.21.15.177:0/680122003 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc00e070 con 0x7ff0cc147880 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0ca7fc700 1 -- 172.21.15.177:0/680122003 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc00b910 con 0x7ff0cc147880 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.630+0000 7ff0ca7fc700 1 -- 172.21.15.177:0/680122003 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc00bcc0 con 0x7ff0cc147880 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.631+0000 7ff0d1d72700 1 -- 172.21.15.177:0/680122003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 msgr2=0x7ff0cc06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.631+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/680122003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 0x7ff0cc06d910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009e50 tx=0x7ff0bc00b330 comp rx=0 tx=0).stop 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.631+0000 7ff0d1d72700 1 -- 172.21.15.177:0/680122003 shutdown_connections 2023-11-27T17:48:41.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.631+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/680122003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 0x7ff0cc06d910 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.631+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/680122003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc070c00 0x7ff0cc15f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.631+0000 7ff0d1d72700 1 -- 172.21.15.177:0/680122003 >> 172.21.15.177:0/680122003 conn(0x7ff0cc0b2130 msgr2=0x7ff0cc0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:41.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.631+0000 7ff0d1d72700 1 -- 172.21.15.177:0/680122003 shutdown_connections 2023-11-27T17:48:41.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.631+0000 7ff0d1d72700 1 -- 172.21.15.177:0/680122003 wait complete. 2023-11-27T17:48:41.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.632+0000 7ff0d1d72700 1 Processor -- start 2023-11-27T17:48:41.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.632+0000 7ff0d1d72700 1 -- start start 2023-11-27T17:48:41.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0d1d72700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0cc070c00 0x7ff0cc145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0d1d72700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc0b6170 0x7ff0cc0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0d1d72700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 0x7ff0cc0af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0d1d72700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc0c7eb0 con 0x7ff0cc070c00 2023-11-27T17:48:41.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0d1d72700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc0c8a20 con 0x7ff0cc147880 2023-11-27T17:48:41.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0d1d72700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc0c8cc0 con 0x7ff0cc0b6170 2023-11-27T17:48:41.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0cb7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0cc070c00 0x7ff0cc145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0cb7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0cc070c00 0x7ff0cc145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52260/0 (socket says 172.21.15.177:52260) 2023-11-27T17:48:41.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0cb7fe700 1 -- 172.21.15.177:0/1353498480 learned_addr learned my addr 172.21.15.177:0/1353498480 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0cbfff700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 0x7ff0cc0af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0cb7fe700 1 -- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc0b6170 msgr2=0x7ff0cc0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0caffd700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc0b6170 0x7ff0cc0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0cb7fe700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc0b6170 0x7ff0cc0cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.633+0000 7ff0cb7fe700 1 -- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 msgr2=0x7ff0cc0af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0cb7fe700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 0x7ff0cc0af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0cb7fe700 1 -- 172.21.15.177:0/1353498480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40094a0 con 0x7ff0cc070c00 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0cbfff700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 0x7ff0cc0af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0cb7fe700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0cc070c00 0x7ff0cc145b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00b370 tx=0x7ff0bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0c3fff700 1 -- 172.21.15.177:0/1353498480 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0099b0 con 0x7ff0cc070c00 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0c3fff700 1 -- 172.21.15.177:0/1353498480 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0092e0 con 0x7ff0cc070c00 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc009b30 con 0x7ff0cc070c00 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0c3fff700 1 -- 172.21.15.177:0/1353498480 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc01b630 con 0x7ff0cc070c00 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.634+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc0c9280 con 0x7ff0cc070c00 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.635+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc0c9440 con 0x7ff0cc070c00 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.635+0000 7ff0c3fff700 1 -- 172.21.15.177:0/1353498480 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff0bc01b790 con 0x7ff0cc070c00 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.636+0000 7ff0c3fff700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0ac06b250 0x7ff0ac06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.636+0000 7ff0c3fff700 1 -- 172.21.15.177:0/1353498480 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0bc08b330 con 0x7ff0cc070c00 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.636+0000 7ff0caffd700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0ac06b250 0x7ff0ac06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.636+0000 7ff0caffd700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0ac06b250 0x7ff0ac06d710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0b0680 tx=0x7ff0b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.640+0000 7ff0c3fff700 1 -- 172.21.15.177:0/1353498480 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff0bc0560f0 con 0x7ff0cc070c00 2023-11-27T17:48:41.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.830+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0cc073aa0 con 0x7ff0cc070c00 2023-11-27T17:48:41.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.831+0000 7ff0c3fff700 1 -- 172.21.15.177:0/1353498480 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7ff0bc059710 con 0x7ff0cc070c00 2023-11-27T17:48:41.835 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:41.835 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:41.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.833+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0ac06b250 msgr2=0x7ff0ac06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.833+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0ac06b250 0x7ff0ac06d710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0b0680 tx=0x7ff0b4009040 comp rx=0 tx=0).stop 2023-11-27T17:48:41.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.833+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0cc070c00 msgr2=0x7ff0cc145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.833+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0cc070c00 0x7ff0cc145b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00b370 tx=0x7ff0bc004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.834+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 shutdown_connections 2023-11-27T17:48:41.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.834+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff0ac06b250 0x7ff0ac06d710 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.834+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0cc147880 0x7ff0cc0af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.834+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0cc070c00 0x7ff0cc145b10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.834+0000 7ff0d1d72700 1 --2- 172.21.15.177:0/1353498480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0cc0b6170 0x7ff0cc0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.834+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 >> 172.21.15.177:0/1353498480 conn(0x7ff0cc0b2130 msgr2=0x7ff0cc0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:41.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.834+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 shutdown_connections 2023-11-27T17:48:41.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.834+0000 7ff0d1d72700 1 -- 172.21.15.177:0/1353498480 wait complete. 2023-11-27T17:48:41.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:41.849 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:41.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.969+0000 7ff2d169d700 1 Processor -- start 2023-11-27T17:48:41.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.969+0000 7ff2d169d700 1 -- start start 2023-11-27T17:48:41.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2d169d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2cc0d2610 0x7ff2cc072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2d169d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc071280 con 0x7ff2cc15e010 2023-11-27T17:48:41.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2d169d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc071560 con 0x7ff2cc06f200 2023-11-27T17:48:41.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2d169d700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc071840 con 0x7ff2cc0d2610 2023-11-27T17:48:41.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2ca7fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2cc0d2610 0x7ff2cc072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2ca7fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2cc0d2610 0x7ff2cc072110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52270/0 (socket says 172.21.15.177:52270) 2023-11-27T17:48:41.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2ca7fc700 1 -- 172.21.15.177:0/231994742 learned_addr learned my addr 172.21.15.177:0/231994742 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:41.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2caffd700 1 --1- 172.21.15.177:0/231994742 >> v1:172.21.15.177:6789/0 conn(0x7ff2cc15e010 0x7ff2cc0d1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46586/0 (socket says 172.21.15.177:46586) 2023-11-27T17:48:41.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2ca7fc700 1 -- 172.21.15.177:0/231994742 >> v1:172.21.15.178:6789/0 conn(0x7ff2cc06f200 legacy=0x7ff2cc06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:41.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2ca7fc700 1 -- 172.21.15.177:0/231994742 >> v1:172.21.15.177:6789/0 conn(0x7ff2cc15e010 legacy=0x7ff2cc0d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2c9ffb700 1 -- 172.21.15.177:0/231994742 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892221841 0 0) 0x7ff2cc071280 con 0x7ff2cc15e010 2023-11-27T17:48:41.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2ca7fc700 1 -- 172.21.15.177:0/231994742 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc071b20 con 0x7ff2cc0d2610 2023-11-27T17:48:41.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2ca7fc700 1 --2- 172.21.15.177:0/231994742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc072110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40098f0 tx=0x7ff2b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f071a07c25fba09d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2c9ffb700 1 -- 172.21.15.177:0/231994742 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4004230 con 0x7ff2cc0d2610 2023-11-27T17:48:41.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2c9ffb700 1 -- 172.21.15.177:0/231994742 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b4004390 con 0x7ff2cc0d2610 2023-11-27T17:48:41.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.970+0000 7ff2c9ffb700 1 -- 172.21.15.177:0/231994742 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40036a0 con 0x7ff2cc0d2610 2023-11-27T17:48:41.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.971+0000 7ff2d169d700 1 -- 172.21.15.177:0/231994742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 msgr2=0x7ff2cc072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.971+0000 7ff2d169d700 1 --2- 172.21.15.177:0/231994742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc072110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40098f0 tx=0x7ff2b4009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:41.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.971+0000 7ff2d169d700 1 -- 172.21.15.177:0/231994742 shutdown_connections 2023-11-27T17:48:41.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.971+0000 7ff2d169d700 1 --2- 172.21.15.177:0/231994742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc072110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.971+0000 7ff2d169d700 1 -- 172.21.15.177:0/231994742 >> 172.21.15.177:0/231994742 conn(0x7ff2cc0b6110 msgr2=0x7ff2cc0b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:41.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.971+0000 7ff2d169d700 1 -- 172.21.15.177:0/231994742 shutdown_connections 2023-11-27T17:48:41.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.971+0000 7ff2d169d700 1 -- 172.21.15.177:0/231994742 wait complete. 2023-11-27T17:48:41.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.972+0000 7ff2d169d700 1 Processor -- start 2023-11-27T17:48:41.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.972+0000 7ff2d169d700 1 -- start start 2023-11-27T17:48:41.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2d169d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc06f200 0x7ff2cc158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2d169d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2d169d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15e010 0x7ff2cc0ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2d169d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0b9830 con 0x7ff2cc0d2610 2023-11-27T17:48:41.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2d169d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0b9cc0 con 0x7ff2cc06f200 2023-11-27T17:48:41.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2d169d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0b8c20 con 0x7ff2cc15e010 2023-11-27T17:48:41.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2ca7fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2ca7fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc0ae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52274/0 (socket says 172.21.15.177:52274) 2023-11-27T17:48:41.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2ca7fc700 1 -- 172.21.15.177:0/2620811347 learned_addr learned my addr 172.21.15.177:0/2620811347 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:41.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2caffd700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc06f200 0x7ff2cc158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2ca7fc700 1 -- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15e010 msgr2=0x7ff2cc0ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2cb7fe700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15e010 0x7ff2cc0ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2ca7fc700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15e010 0x7ff2cc0ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2ca7fc700 1 -- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc06f200 msgr2=0x7ff2cc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:41.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2ca7fc700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc06f200 0x7ff2cc158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:41.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2ca7fc700 1 -- 172.21.15.177:0/2620811347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4009550 con 0x7ff2cc0d2610 2023-11-27T17:48:41.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.973+0000 7ff2caffd700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc06f200 0x7ff2cc158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:41.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.974+0000 7ff2ca7fc700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc0ae280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4004000 tx=0x7ff2b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.974+0000 7ff2c37fe700 1 -- 172.21.15.177:0/2620811347 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4003dc0 con 0x7ff2cc0d2610 2023-11-27T17:48:41.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.974+0000 7ff2c37fe700 1 -- 172.21.15.177:0/2620811347 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b401f070 con 0x7ff2cc0d2610 2023-11-27T17:48:41.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.974+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc0b8f00 con 0x7ff2cc0d2610 2023-11-27T17:48:41.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.974+0000 7ff2c37fe700 1 -- 172.21.15.177:0/2620811347 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400b8a0 con 0x7ff2cc0d2610 2023-11-27T17:48:41.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.974+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc0b94c0 con 0x7ff2cc0d2610 2023-11-27T17:48:41.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.975+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc0d1bf0 con 0x7ff2cc0d2610 2023-11-27T17:48:41.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.975+0000 7ff2c37fe700 1 -- 172.21.15.177:0/2620811347 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff2b4021030 con 0x7ff2cc0d2610 2023-11-27T17:48:41.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.976+0000 7ff2c37fe700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff2ac06b250 0x7ff2ac06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:41.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.976+0000 7ff2c37fe700 1 -- 172.21.15.177:0/2620811347 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2b408b1c0 con 0x7ff2cc0d2610 2023-11-27T17:48:41.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.976+0000 7ff2caffd700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff2ac06b250 0x7ff2ac06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:41.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.976+0000 7ff2caffd700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff2ac06b250 0x7ff2ac06d710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc000f60 tx=0x7ff2bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:41.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:41.980+0000 7ff2c37fe700 1 -- 172.21.15.177:0/2620811347 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff2b4055ee0 con 0x7ff2cc0d2610 2023-11-27T17:48:42.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.166+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2cc0d1bf0 con 0x7ff2cc0d2610 2023-11-27T17:48:42.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.167+0000 7ff2c37fe700 1 -- 172.21.15.177:0/2620811347 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2b4059500 con 0x7ff2cc0d2610 2023-11-27T17:48:42.169 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:42.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.168+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff2ac06b250 msgr2=0x7ff2ac06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.168+0000 7ff2d169d700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff2ac06b250 0x7ff2ac06d710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc000f60 tx=0x7ff2bc009040 comp rx=0 tx=0).stop 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.168+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 msgr2=0x7ff2cc0ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.168+0000 7ff2d169d700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc0ae280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4004000 tx=0x7ff2b4004750 comp rx=0 tx=0).stop 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.169+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 shutdown_connections 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.169+0000 7ff2d169d700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff2ac06b250 0x7ff2ac06d710 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.169+0000 7ff2d169d700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15e010 0x7ff2cc0ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.169+0000 7ff2d169d700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc06f200 0x7ff2cc158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.169+0000 7ff2d169d700 1 --2- 172.21.15.177:0/2620811347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc0d2610 0x7ff2cc0ae280 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.169+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 >> 172.21.15.177:0/2620811347 conn(0x7ff2cc0b6110 msgr2=0x7ff2cc06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.169+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 shutdown_connections 2023-11-27T17:48:42.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.169+0000 7ff2d169d700 1 -- 172.21.15.177:0/2620811347 wait complete. 2023-11-27T17:48:42.183 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:42.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.304+0000 7f368d307700 1 Processor -- start 2023-11-27T17:48:42.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.304+0000 7f368d307700 1 -- start start 2023-11-27T17:48:42.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f368d307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f368815e010 0x7f3688072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f368d307700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36880d2610 0x7f368806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f368d307700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3688071280 con 0x7f368806f200 2023-11-27T17:48:42.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f368d307700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3688071560 con 0x7f36880d2610 2023-11-27T17:48:42.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f368d307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3688071840 con 0x7f368815e010 2023-11-27T17:48:42.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36877fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36880d2610 0x7f368806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36867fc700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f368806f200 0x7f36880d1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46598/0 (socket says 172.21.15.177:46598) 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36877fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36880d2610 0x7f368806ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52284/0 (socket says 172.21.15.177:52284) 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36877fe700 1 -- 172.21.15.177:0/2612789129 learned_addr learned my addr 172.21.15.177:0/2612789129 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f3686ffd700 1 --2- 172.21.15.177:0/2612789129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f368815e010 0x7f3688072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36877fe700 1 -- 172.21.15.177:0/2612789129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f368815e010 msgr2=0x7f3688072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36877fe700 1 --2- 172.21.15.177:0/2612789129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f368815e010 0x7f3688072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36877fe700 1 -- 172.21.15.177:0/2612789129 >> v1:172.21.15.177:6789/0 conn(0x7f368806f200 legacy=0x7f36880d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36877fe700 1 -- 172.21.15.177:0/2612789129 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688071b20 con 0x7f36880d2610 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f3685ffb700 1 -- 172.21.15.177:0/2612789129 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566808052 0 0) 0x7f3688071280 con 0x7f368806f200 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f3686ffd700 1 --2- 172.21.15.177:0/2612789129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f368815e010 0x7f3688072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f36877fe700 1 --2- 172.21.15.177:0/2612789129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36880d2610 0x7f368806ca10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3680009e50 tx=0x7f368000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfb523271b8681c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:42.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f3685ffb700 1 -- 172.21.15.177:0/2612789129 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000e070 con 0x7f36880d2610 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f3685ffb700 1 -- 172.21.15.177:0/2612789129 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000b9c0 con 0x7f36880d2610 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.305+0000 7f3685ffb700 1 -- 172.21.15.177:0/2612789129 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000bd70 con 0x7f36880d2610 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.306+0000 7f368d307700 1 -- 172.21.15.177:0/2612789129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36880d2610 msgr2=0x7f368806ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.306+0000 7f368d307700 1 --2- 172.21.15.177:0/2612789129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36880d2610 0x7f368806ca10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3680009e50 tx=0x7f368000b330 comp rx=0 tx=0).stop 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.306+0000 7f368d307700 1 -- 172.21.15.177:0/2612789129 shutdown_connections 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.306+0000 7f368d307700 1 --2- 172.21.15.177:0/2612789129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36880d2610 0x7f368806ca10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.306+0000 7f368d307700 1 --2- 172.21.15.177:0/2612789129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f368815e010 0x7f3688072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.306+0000 7f368d307700 1 -- 172.21.15.177:0/2612789129 >> 172.21.15.177:0/2612789129 conn(0x7f36880b6110 msgr2=0x7f36880b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.306+0000 7f368d307700 1 -- 172.21.15.177:0/2612789129 shutdown_connections 2023-11-27T17:48:42.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.306+0000 7f368d307700 1 -- 172.21.15.177:0/2612789129 wait complete. 2023-11-27T17:48:42.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.307+0000 7f368d307700 1 Processor -- start 2023-11-27T17:48:42.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.307+0000 7f368d307700 1 -- start start 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f368d307700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f368806f200 0x7f36880b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f368d307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36880d2610 0x7f36881f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f368d307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f368815e010 0x7f36880b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f368d307700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880b29a0 con 0x7f368806f200 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f368d307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368814c300 con 0x7f368815e010 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f368d307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36881f4340 con 0x7f36880d2610 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f3686ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f368806f200 0x7f36880b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f3686ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f368806f200 0x7f36880b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52286/0 (socket says 172.21.15.177:52286) 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f3686ffd700 1 -- 172.21.15.177:0/724643070 learned_addr learned my addr 172.21.15.177:0/724643070 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f36877fe700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f368815e010 0x7f36880b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f3686ffd700 1 -- 172.21.15.177:0/724643070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36880d2610 msgr2=0x7f36881f3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f3686ffd700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36880d2610 0x7f36881f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f3686ffd700 1 -- 172.21.15.177:0/724643070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f368815e010 msgr2=0x7f36880b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f3686ffd700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f368815e010 0x7f36880b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.308+0000 7f3686ffd700 1 -- 172.21.15.177:0/724643070 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680009b30 con 0x7f368806f200 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.309+0000 7f3686ffd700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f368806f200 0x7f36880b2460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f367800e810 tx=0x7f367800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.309+0000 7f366f7fe700 1 -- 172.21.15.177:0/724643070 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367800c020 con 0x7f368806f200 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.309+0000 7f366f7fe700 1 -- 172.21.15.177:0/724643070 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3678004250 con 0x7f368806f200 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.309+0000 7f366f7fe700 1 -- 172.21.15.177:0/724643070 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780036a0 con 0x7f368806f200 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.309+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368814b780 con 0x7f368806f200 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.309+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368814bd40 con 0x7f368806f200 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.310+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3688069400 con 0x7f368806f200 2023-11-27T17:48:42.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.310+0000 7f366f7fe700 1 -- 172.21.15.177:0/724643070 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3678003800 con 0x7f368806f200 2023-11-27T17:48:42.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.311+0000 7f366f7fe700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f367406b250 0x7f367406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.311+0000 7f36867fc700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f367406b250 0x7f367406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.311+0000 7f366f7fe700 1 -- 172.21.15.177:0/724643070 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36780893d0 con 0x7f368806f200 2023-11-27T17:48:42.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.311+0000 7f36867fc700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f367406b250 0x7f367406d710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f367c0011e0 tx=0x7f367c0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:42.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.315+0000 7f366f7fe700 1 -- 172.21.15.177:0/724643070 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3678054190 con 0x7f368806f200 2023-11-27T17:48:42.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.508+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3688072110 con 0x7f368806f200 2023-11-27T17:48:42.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.508+0000 7f366f7fe700 1 -- 172.21.15.177:0/724643070 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f36780577b0 con 0x7f368806f200 2023-11-27T17:48:42.511 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f367406b250 msgr2=0x7f367406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f367406b250 0x7f367406d710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f367c0011e0 tx=0x7f367c0079b0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f368806f200 msgr2=0x7f36880b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f368806f200 0x7f36880b2460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f367800e810 tx=0x7f367800ebd0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 shutdown_connections 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f367406b250 0x7f367406d710 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f368815e010 0x7f36880b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f368806f200 0x7f36880b2460 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 --2- 172.21.15.177:0/724643070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36880d2610 0x7f36881f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 >> 172.21.15.177:0/724643070 conn(0x7f36880b6110 msgr2=0x7f36880b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 shutdown_connections 2023-11-27T17:48:42.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.510+0000 7f368d307700 1 -- 172.21.15.177:0/724643070 wait complete. 2023-11-27T17:48:42.524 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:42.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.648+0000 7f0faa8e8700 1 Processor -- start 2023-11-27T17:48:42.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.648+0000 7f0faa8e8700 1 -- start start 2023-11-27T17:48:42.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0faa8e8700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0fa40afc30 0x7f0fa4162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0faa8e8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa4162bc0 con 0x7f0fa4146f00 2023-11-27T17:48:42.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0faa8e8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40b0110 con 0x7f0fa40cdff0 2023-11-27T17:48:42.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0faa8e8700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa41472e0 con 0x7f0fa40afc30 2023-11-27T17:48:42.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa8e85700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0fa40afc30 0x7f0fa4162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa3fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0fa4146f00 0x7f0fa40cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46612/0 (socket says 172.21.15.177:46612) 2023-11-27T17:48:42.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa3fff700 1 -- 172.21.15.177:0/1455413074 learned_addr learned my addr 172.21.15.177:0/1455413074 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:42.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa8e85700 1 -- 172.21.15.177:0/1455413074 >> v1:172.21.15.178:6789/0 conn(0x7f0fa40cdff0 legacy=0x7f0fa40cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa8e85700 1 -- 172.21.15.177:0/1455413074 >> v1:172.21.15.177:6789/0 conn(0x7f0fa4146f00 legacy=0x7f0fa40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa2ffd700 1 -- 172.21.15.177:0/1455413074 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386090781 0 0) 0x7f0fa4162bc0 con 0x7f0fa4146f00 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa8e85700 1 -- 172.21.15.177:0/1455413074 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40b03f0 con 0x7f0fa40afc30 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa8e85700 1 --2- 172.21.15.177:0/1455413074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa40afc30 0x7f0fa4162680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009d90 tx=0x7f0f9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a953cc5ed3e3656 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa2ffd700 1 -- 172.21.15.177:0/1455413074 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c00e070 con 0x7f0fa40afc30 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa2ffd700 1 -- 172.21.15.177:0/1455413074 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c00bbd0 con 0x7f0fa40afc30 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.649+0000 7f0fa2ffd700 1 -- 172.21.15.177:0/1455413074 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c012430 con 0x7f0fa40afc30 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.650+0000 7f0faa8e8700 1 -- 172.21.15.177:0/1455413074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa40afc30 msgr2=0x7f0fa4162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.650+0000 7f0faa8e8700 1 --2- 172.21.15.177:0/1455413074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa40afc30 0x7f0fa4162680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009d90 tx=0x7f0f9c00b330 comp rx=0 tx=0).stop 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.650+0000 7f0faa8e8700 1 -- 172.21.15.177:0/1455413074 shutdown_connections 2023-11-27T17:48:42.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.650+0000 7f0faa8e8700 1 --2- 172.21.15.177:0/1455413074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa40afc30 0x7f0fa4162680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.650+0000 7f0faa8e8700 1 -- 172.21.15.177:0/1455413074 >> 172.21.15.177:0/1455413074 conn(0x7f0fa40b38b0 msgr2=0x7f0fa40b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:42.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.650+0000 7f0faa8e8700 1 -- 172.21.15.177:0/1455413074 shutdown_connections 2023-11-27T17:48:42.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.650+0000 7f0faa8e8700 1 -- 172.21.15.177:0/1455413074 wait complete. 2023-11-27T17:48:42.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.651+0000 7f0faa8e8700 1 Processor -- start 2023-11-27T17:48:42.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.651+0000 7f0faa8e8700 1 -- start start 2023-11-27T17:48:42.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0faa8e8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa40afc30 0x7f0fa413ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0faa8e8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa40cdff0 0x7f0fa41f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0faa8e8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa4146f00 0x7f0fa41f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0faa8e8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40731f0 con 0x7f0fa4146f00 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0faa8e8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa413e1e0 con 0x7f0fa40afc30 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0faa8e8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40704f0 con 0x7f0fa40cdff0 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa8e85700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa4146f00 0x7f0fa41f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa8e85700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa4146f00 0x7f0fa41f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52304/0 (socket says 172.21.15.177:52304) 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa8e85700 1 -- 172.21.15.177:0/2470852843 learned_addr learned my addr 172.21.15.177:0/2470852843 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa8e85700 1 -- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa40cdff0 msgr2=0x7f0fa41f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa37fe700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa40cdff0 0x7f0fa41f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa3fff700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa40afc30 0x7f0fa413ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa8e85700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa40cdff0 0x7f0fa41f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa8e85700 1 -- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa40afc30 msgr2=0x7f0fa413ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa8e85700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa40afc30 0x7f0fa413ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa8e85700 1 -- 172.21.15.177:0/2470852843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c009a70 con 0x7f0fa4146f00 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.652+0000 7f0fa3fff700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa40afc30 0x7f0fa413ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.653+0000 7f0fa8e85700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa4146f00 0x7f0fa41f7760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c014040 tx=0x7f0f9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.653+0000 7f0fa0ff9700 1 -- 172.21.15.177:0/2470852843 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c01b810 con 0x7f0fa4146f00 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.653+0000 7f0fa0ff9700 1 -- 172.21.15.177:0/2470852843 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c020070 con 0x7f0fa4146f00 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.653+0000 7f0fa0ff9700 1 -- 172.21.15.177:0/2470852843 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c01bbb0 con 0x7f0fa4146f00 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.653+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa4072b70 con 0x7f0fa4146f00 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.653+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa4070740 con 0x7f0fa4146f00 2023-11-27T17:48:42.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.654+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa4069400 con 0x7f0fa4146f00 2023-11-27T17:48:42.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.654+0000 7f0fa0ff9700 1 -- 172.21.15.177:0/2470852843 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0f9c01bd10 con 0x7f0fa4146f00 2023-11-27T17:48:42.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.654+0000 7f0fa0ff9700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0f9006b250 0x7f0f9006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.655+0000 7f0fa0ff9700 1 -- 172.21.15.177:0/2470852843 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f9c022070 con 0x7f0fa4146f00 2023-11-27T17:48:42.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.655+0000 7f0fa3fff700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0f9006b250 0x7f0f9006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.655+0000 7f0fa3fff700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0f9006b250 0x7f0f9006d710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f94000f60 tx=0x7f0f94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:42.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.659+0000 7f0fa0ff9700 1 -- 172.21.15.177:0/2470852843 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0f9c05a720 con 0x7f0fa4146f00 2023-11-27T17:48:42.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.850+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fa40ae640 con 0x7f0fa4146f00 2023-11-27T17:48:42.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.850+0000 7f0fa0ff9700 1 -- 172.21.15.177:0/2470852843 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f9c02c0a0 con 0x7f0fa4146f00 2023-11-27T17:48:42.853 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0f9006b250 msgr2=0x7f0f9006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0f9006b250 0x7f0f9006d710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f94000f60 tx=0x7f0f94009040 comp rx=0 tx=0).stop 2023-11-27T17:48:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa4146f00 msgr2=0x7f0fa41f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa4146f00 0x7f0fa41f7760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c014040 tx=0x7f0f9c004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 shutdown_connections 2023-11-27T17:48:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0f9006b250 0x7f0f9006d710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa4146f00 0x7f0fa41f7760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fa40afc30 0x7f0fa413ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 --2- 172.21.15.177:0/2470852843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fa40cdff0 0x7f0fa41f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 >> 172.21.15.177:0/2470852843 conn(0x7f0fa40b38b0 msgr2=0x7f0fa41615a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:42.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 shutdown_connections 2023-11-27T17:48:42.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.852+0000 7f0faa8e8700 1 -- 172.21.15.177:0/2470852843 wait complete. 2023-11-27T17:48:42.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:42.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.986+0000 7f9c7b325700 1 Processor -- start 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.986+0000 7f9c7b325700 1 -- start start 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c7b325700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c740b6b00 0x7f9c740cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c7b325700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7415c360 con 0x7f9c740cdc70 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c7b325700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c740b6020 con 0x7f9c740cfb70 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c7b325700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c74071810 con 0x7f9c740b6b00 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c798c2700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9c740cdc70 0x7f9c740cb8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46630/0 (socket says 172.21.15.177:46630) 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c798c2700 1 -- 172.21.15.177:0/2602439833 learned_addr learned my addr 172.21.15.177:0/2602439833 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466750695 0 0) 0x7f9c7415c360 con 0x7f9c740cdc70 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c788c0700 1 --2- 172.21.15.177:0/2602439833 >> v2:172.21.15.178:3300/0 conn(0x7f9c740b6b00 0x7f9c740cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.987+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c600035b0 con 0x7f9c740cdc70 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108178914 0 0) 0x7f9c600035b0 con 0x7f9c740cdc70 2023-11-27T17:48:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 >> v2:172.21.15.178:3300/0 conn(0x7f9c740b6b00 msgr2=0x7f9c740cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 --2- 172.21.15.177:0/2602439833 >> v2:172.21.15.178:3300/0 conn(0x7f9c740b6b00 0x7f9c740cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 >> v1:172.21.15.178:6789/0 conn(0x7f9c740cfb70 legacy=0x7f9c740b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740b6fd0 con 0x7f9c740cdc70 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f9c6c0019f0 con 0x7f9c740cdc70 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 >> v1:172.21.15.177:6789/0 conn(0x7f9c740cdc70 legacy=0x7f9c740cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c60003a00 0x7f9c60003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c60004850 0x7f9c60004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60005210 0x7f9c6000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74071810 con 0x7f9c60003a00 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6000e2c0 con 0x7f9c60004850 2023-11-27T17:48:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6000e480 con 0x7f9c60005210 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c790c1700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c60003a00 0x7f9c60003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c788c0700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c60004850 0x7f9c60004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c798c2700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60005210 0x7f9c6000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c790c1700 1 -- 172.21.15.177:0/2602439833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60005210 msgr2=0x7f9c6000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c790c1700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60005210 0x7f9c6000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c790c1700 1 -- 172.21.15.177:0/2602439833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c60004850 msgr2=0x7f9c60004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c790c1700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c60004850 0x7f9c60004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c798c2700 1 -- 172.21.15.177:0/2602439833 reap_dead start 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c790c1700 1 -- 172.21.15.177:0/2602439833 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600035b0 con 0x7f9c60003a00 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c790c1700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c60003a00 0x7f9c60003e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c64001800 tx=0x7f9c60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc7eb62ff400f91 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640012f0 con 0x7f9c60003a00 2023-11-27T17:48:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c640052f0 con 0x7f9c60003a00 2023-11-27T17:48:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.988+0000 7f9c6bfff700 1 -- 172.21.15.177:0/2602439833 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64006860 con 0x7f9c60003a00 2023-11-27T17:48:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.989+0000 7f9c7b325700 1 -- 172.21.15.177:0/2602439833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c60003a00 msgr2=0x7f9c60003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.989+0000 7f9c7b325700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c60003a00 0x7f9c60003e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c64001800 tx=0x7f9c60005880 comp rx=0 tx=0).stop 2023-11-27T17:48:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.989+0000 7f9c7b325700 1 -- 172.21.15.177:0/2602439833 shutdown_connections 2023-11-27T17:48:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.989+0000 7f9c7b325700 1 --2- 172.21.15.177:0/2602439833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c60003a00 0x7f9c60003e20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.989+0000 7f9c7b325700 1 -- 172.21.15.177:0/2602439833 >> 172.21.15.177:0/2602439833 conn(0x7f9c740b2130 msgr2=0x7f9c740b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.989+0000 7f9c7b325700 1 -- 172.21.15.177:0/2602439833 shutdown_connections 2023-11-27T17:48:42.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.989+0000 7f9c7b325700 1 -- 172.21.15.177:0/2602439833 wait complete. 2023-11-27T17:48:42.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.990+0000 7f9c7b325700 1 Processor -- start 2023-11-27T17:48:42.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.990+0000 7f9c7b325700 1 -- start start 2023-11-27T17:48:43.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c7b325700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60003a00 0x7f9c7415df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c7b325700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c74146bb0 0x7f9c741582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c7b325700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c741470b0 0x7f9c74158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c7b325700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7415d870 con 0x7f9c74146bb0 2023-11-27T17:48:43.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c7b325700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7415d2b0 con 0x7f9c741470b0 2023-11-27T17:48:43.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c7b325700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7415d590 con 0x7f9c60003a00 2023-11-27T17:48:43.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c788c0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c74146bb0 0x7f9c741582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c788c0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c74146bb0 0x7f9c741582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52322/0 (socket says 172.21.15.177:52322) 2023-11-27T17:48:43.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c788c0700 1 -- 172.21.15.177:0/2090621573 learned_addr learned my addr 172.21.15.177:0/2090621573 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:43.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c790c1700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60003a00 0x7f9c7415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c798c2700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c741470b0 0x7f9c74158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c788c0700 1 -- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60003a00 msgr2=0x7f9c7415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c788c0700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60003a00 0x7f9c7415df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c788c0700 1 -- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c741470b0 msgr2=0x7f9c74158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c788c0700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c741470b0 0x7f9c74158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c788c0700 1 -- 172.21.15.177:0/2090621573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74157500 con 0x7f9c74146bb0 2023-11-27T17:48:43.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.991+0000 7f9c798c2700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c741470b0 0x7f9c74158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:43.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.992+0000 7f9c788c0700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c74146bb0 0x7f9c741582f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c700118f0 tx=0x7f9c70011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:43.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.992+0000 7f9c69ffb700 1 -- 172.21.15.177:0/2090621573 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70004240 con 0x7f9c74146bb0 2023-11-27T17:48:43.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.992+0000 7f9c69ffb700 1 -- 172.21.15.177:0/2090621573 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c700043a0 con 0x7f9c74146bb0 2023-11-27T17:48:43.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.992+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c741577e0 con 0x7f9c74146bb0 2023-11-27T17:48:43.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.992+0000 7f9c69ffb700 1 -- 172.21.15.177:0/2090621573 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700036a0 con 0x7f9c74146bb0 2023-11-27T17:48:43.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.992+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c74157d00 con 0x7f9c74146bb0 2023-11-27T17:48:43.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.993+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c74157360 con 0x7f9c74146bb0 2023-11-27T17:48:43.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.993+0000 7f9c69ffb700 1 -- 172.21.15.177:0/2090621573 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9c70003800 con 0x7f9c74146bb0 2023-11-27T17:48:43.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.993+0000 7f9c69ffb700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c5806b280 0x7f9c5806d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.994+0000 7f9c69ffb700 1 -- 172.21.15.177:0/2090621573 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c70089cb0 con 0x7f9c74146bb0 2023-11-27T17:48:43.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.994+0000 7f9c790c1700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c5806b280 0x7f9c5806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.994+0000 7f9c790c1700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c5806b280 0x7f9c5806d740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9c64000c00 tx=0x7f9c64009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:43.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:42.998+0000 7f9c69ffb700 1 -- 172.21.15.177:0/2090621573 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9c74157360 con 0x7f9c74146bb0 2023-11-27T17:48:43.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.191+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c74157360 con 0x7f9c74146bb0 2023-11-27T17:48:43.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.192+0000 7f9c69ffb700 1 -- 172.21.15.177:0/2090621573 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f9c74157360 con 0x7f9c74146bb0 2023-11-27T17:48:43.195 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:43.196 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:43.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c5806b280 msgr2=0x7f9c5806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c5806b280 0x7f9c5806d740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9c64000c00 tx=0x7f9c64009030 comp rx=0 tx=0).stop 2023-11-27T17:48:43.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c74146bb0 msgr2=0x7f9c741582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c74146bb0 0x7f9c741582f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c700118f0 tx=0x7f9c70011c00 comp rx=0 tx=0).stop 2023-11-27T17:48:43.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 shutdown_connections 2023-11-27T17:48:43.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c5806b280 0x7f9c5806d740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c741470b0 0x7f9c74158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c60003a00 0x7f9c7415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 --2- 172.21.15.177:0/2090621573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c74146bb0 0x7f9c741582f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 >> 172.21.15.177:0/2090621573 conn(0x7f9c740b2130 msgr2=0x7f9c7415a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:43.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 shutdown_connections 2023-11-27T17:48:43.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.194+0000 7f9c7b325700 1 -- 172.21.15.177:0/2090621573 wait complete. 2023-11-27T17:48:43.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:43.210 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:43.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.332+0000 7f75ea0b7700 1 Processor -- start 2023-11-27T17:48:43.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.332+0000 7f75ea0b7700 1 -- start start 2023-11-27T17:48:43.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75ea0b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e4162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75ea0b7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f75e40afc30 0x7f75e40cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75ea0b7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f75e40cde20 0x7f75e40ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75ea0b7700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e41472e0 con 0x7f75e40afc30 2023-11-27T17:48:43.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75ea0b7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e40ce280 con 0x7f75e40cde20 2023-11-27T17:48:43.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75ea0b7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4162bc0 con 0x7f75e4146f00 2023-11-27T17:48:43.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75e2ffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f75e40afc30 0x7f75e40cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75e2ffd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f75e40afc30 0x7f75e40cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52328/0 (socket says 172.21.15.177:52328) 2023-11-27T17:48:43.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.333+0000 7f75e2ffd700 1 -- 172.21.15.177:0/2085616407 learned_addr learned my addr 172.21.15.177:0/2085616407 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:43.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e3fff700 1 --2- 172.21.15.177:0/2085616407 >> v2:172.21.15.178:3300/0 conn(0x7f75e40cde20 0x7f75e40ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e37fe700 1 --2- 172.21.15.177:0/2085616407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e4162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e2ffd700 1 -- 172.21.15.177:0/2085616407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 msgr2=0x7f75e4162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:43.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e2ffd700 1 --2- 172.21.15.177:0/2085616407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e4162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e2ffd700 1 -- 172.21.15.177:0/2085616407 >> v2:172.21.15.178:3300/0 conn(0x7f75e40cde20 msgr2=0x7f75e40ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e2ffd700 1 --2- 172.21.15.177:0/2085616407 >> v2:172.21.15.178:3300/0 conn(0x7f75e40cde20 0x7f75e40ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e2ffd700 1 -- 172.21.15.177:0/2085616407 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40b0110 con 0x7f75e40afc30 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e37fe700 1 --2- 172.21.15.177:0/2085616407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e4162680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e2ffd700 1 --2- 172.21.15.177:0/2085616407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e40cd8e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f75e40ce660 tx=0x7f75d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119dd4085b1ff7ae server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e27fc700 1 -- 172.21.15.177:0/2085616407 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d400b870 con 0x7f75e40afc30 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e27fc700 1 -- 172.21.15.177:0/2085616407 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d400b9d0 con 0x7f75e40afc30 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75e27fc700 1 -- 172.21.15.177:0/2085616407 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d400bd60 con 0x7f75e40afc30 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.334+0000 7f75ea0b7700 1 -- 172.21.15.177:0/2085616407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 msgr2=0x7f75e40cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.335+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/2085616407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e40cd8e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f75e40ce660 tx=0x7f75d4009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.335+0000 7f75ea0b7700 1 -- 172.21.15.177:0/2085616407 shutdown_connections 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.335+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/2085616407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e4162680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.335+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/2085616407 >> v2:172.21.15.178:3300/0 conn(0x7f75e40cde20 0x7f75e40ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.335+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/2085616407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e40cd8e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.335+0000 7f75ea0b7700 1 -- 172.21.15.177:0/2085616407 >> 172.21.15.177:0/2085616407 conn(0x7f75e40b38b0 msgr2=0x7f75e40b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:43.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.335+0000 7f75ea0b7700 1 -- 172.21.15.177:0/2085616407 shutdown_connections 2023-11-27T17:48:43.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.335+0000 7f75ea0b7700 1 -- 172.21.15.177:0/2085616407 wait complete. 2023-11-27T17:48:43.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.336+0000 7f75ea0b7700 1 Processor -- start 2023-11-27T17:48:43.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.336+0000 7f75ea0b7700 1 -- start start 2023-11-27T17:48:43.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75ea0b7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e4161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75ea0b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75e40cde20 0x7f75e413d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75ea0b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e40704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75ea0b7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e413ded0 con 0x7f75e40afc30 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75ea0b7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4070a30 con 0x7f75e40cde20 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75ea0b7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e41f3ce0 con 0x7f75e4146f00 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e4161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e4161610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52334/0 (socket says 172.21.15.177:52334) 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 -- 172.21.15.177:0/1974968969 learned_addr learned my addr 172.21.15.177:0/1974968969 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e2ffd700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75e40cde20 0x7f75e413d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e3fff700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e40704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 -- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 msgr2=0x7f75e40704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e40704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 -- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75e40cde20 msgr2=0x7f75e413d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75e40cde20 0x7f75e413d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 -- 172.21.15.177:0/1974968969 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009550 con 0x7f75e40afc30 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e2ffd700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75e40cde20 0x7f75e413d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75e37fe700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e4161610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c750 tx=0x7f75d800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75cbfff700 1 -- 172.21.15.177:0/1974968969 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8011800 con 0x7f75e40afc30 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75cbfff700 1 -- 172.21.15.177:0/1974968969 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8011960 con 0x7f75e40afc30 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75cbfff700 1 -- 172.21.15.177:0/1974968969 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8011cd0 con 0x7f75e40afc30 2023-11-27T17:48:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e4070cd0 con 0x7f75e40afc30 2023-11-27T17:48:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.337+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e4071290 con 0x7f75e40afc30 2023-11-27T17:48:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.338+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e41f4320 con 0x7f75e40afc30 2023-11-27T17:48:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.339+0000 7f75cbfff700 1 -- 172.21.15.177:0/1974968969 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f75d8021350 con 0x7f75e40afc30 2023-11-27T17:48:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.339+0000 7f75cbfff700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f75d006b250 0x7f75d006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.339+0000 7f75cbfff700 1 -- 172.21.15.177:0/1974968969 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75d80899f0 con 0x7f75e40afc30 2023-11-27T17:48:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.339+0000 7f75e2ffd700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f75d006b250 0x7f75d006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.339+0000 7f75e2ffd700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f75d006b250 0x7f75d006d710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75e40ae7e0 tx=0x7f75d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.344+0000 7f75cbfff700 1 -- 172.21.15.177:0/1974968969 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f75d8054720 con 0x7f75e40afc30 2023-11-27T17:48:43.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.532+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75e4071480 con 0x7f75e40afc30 2023-11-27T17:48:43.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.533+0000 7f75cbfff700 1 -- 172.21.15.177:0/1974968969 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75d801e0a0 con 0x7f75e40afc30 2023-11-27T17:48:43.536 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f75d006b250 msgr2=0x7f75d006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f75d006b250 0x7f75d006d710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75e40ae7e0 tx=0x7f75d4008030 comp rx=0 tx=0).stop 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 msgr2=0x7f75e4161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e4161610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c750 tx=0x7f75d800cb10 comp rx=0 tx=0).stop 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 shutdown_connections 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f75d006b250 0x7f75d006d710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75e4146f00 0x7f75e40704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e40afc30 0x7f75e4161610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 --2- 172.21.15.177:0/1974968969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75e40cde20 0x7f75e413d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 >> 172.21.15.177:0/1974968969 conn(0x7f75e40b38b0 msgr2=0x7f75e40b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:43.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 shutdown_connections 2023-11-27T17:48:43.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.535+0000 7f75ea0b7700 1 -- 172.21.15.177:0/1974968969 wait complete. 2023-11-27T17:48:43.549 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:43.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.670+0000 7f1516f43700 1 Processor -- start 2023-11-27T17:48:43.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.670+0000 7f1516f43700 1 -- start start 2023-11-27T17:48:43.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f1516f43700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f151013ef60 0x7f15101414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f1516f43700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15101419f0 0x7f151015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f1516f43700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1510141e80 con 0x7f151013eb80 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f1516f43700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151015d420 con 0x7f15101419f0 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f1516f43700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151015d140 con 0x7f151013ef60 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f15154e0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15101419f0 0x7f151015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f15154e0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f15101419f0 0x7f151015c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52346/0 (socket says 172.21.15.177:52346) 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f15154e0700 1 -- 172.21.15.177:0/20413132 learned_addr learned my addr 172.21.15.177:0/20413132 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f150ffff700 1 --2- 172.21.15.177:0/20413132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f151013ef60 0x7f15101414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f15154e0700 1 -- 172.21.15.177:0/20413132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f151013ef60 msgr2=0x7f15101414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f15154e0700 1 --2- 172.21.15.177:0/20413132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f151013ef60 0x7f15101414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f15154e0700 1 -- 172.21.15.177:0/20413132 >> v1:172.21.15.178:6789/0 conn(0x7f151013eb80 legacy=0x7f15100cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f15154e0700 1 -- 172.21.15.177:0/20413132 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15100ce700 con 0x7f15101419f0 2023-11-27T17:48:43.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f15154e0700 1 --2- 172.21.15.177:0/20413132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15101419f0 0x7f151015c3e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1508009e50 tx=0x7f150800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c3510014e8bddf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f150f7fe700 1 -- 172.21.15.177:0/20413132 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800e070 con 0x7f15101419f0 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f150f7fe700 1 -- 172.21.15.177:0/20413132 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800b9c0 con 0x7f15101419f0 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.671+0000 7f150f7fe700 1 -- 172.21.15.177:0/20413132 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800bd70 con 0x7f15101419f0 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.672+0000 7f1516f43700 1 -- 172.21.15.177:0/20413132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15101419f0 msgr2=0x7f151015c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.672+0000 7f1516f43700 1 --2- 172.21.15.177:0/20413132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15101419f0 0x7f151015c3e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1508009e50 tx=0x7f150800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.672+0000 7f1516f43700 1 -- 172.21.15.177:0/20413132 shutdown_connections 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.672+0000 7f1516f43700 1 --2- 172.21.15.177:0/20413132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15101419f0 0x7f151015c3e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.672+0000 7f1516f43700 1 --2- 172.21.15.177:0/20413132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f151013ef60 0x7f15101414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.672+0000 7f1516f43700 1 -- 172.21.15.177:0/20413132 >> 172.21.15.177:0/20413132 conn(0x7f15100b31d0 msgr2=0x7f15100b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.672+0000 7f1516f43700 1 -- 172.21.15.177:0/20413132 shutdown_connections 2023-11-27T17:48:43.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.672+0000 7f1516f43700 1 -- 172.21.15.177:0/20413132 wait complete. 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.673+0000 7f1516f43700 1 Processor -- start 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.674+0000 7f1516f43700 1 -- start start 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1516f43700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f151013eb80 0x7f151013a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1516f43700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15101419f0 0x7f15101534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1516f43700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1510156aa0 0x7f1510139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1516f43700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151013a430 con 0x7f151013eb80 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1516f43700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15101591d0 con 0x7f1510156aa0 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1516f43700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151013fe30 con 0x7f15101419f0 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f151013eb80 0x7f151013a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f151013eb80 0x7f151013a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52348/0 (socket says 172.21.15.177:52348) 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 -- 172.21.15.177:0/819097177 learned_addr learned my addr 172.21.15.177:0/819097177 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:43.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f15154e0700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1510156aa0 0x7f1510139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f150ffff700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15101419f0 0x7f15101534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 -- 172.21.15.177:0/819097177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15101419f0 msgr2=0x7f15101534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15101419f0 0x7f15101534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 -- 172.21.15.177:0/819097177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1510156aa0 msgr2=0x7f1510139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1510156aa0 0x7f1510139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 -- 172.21.15.177:0/819097177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508009b30 con 0x7f151013eb80 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1514cdf700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f151013eb80 0x7f151013a590 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f150400c4e0 tx=0x7f150400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f150d7fa700 1 -- 172.21.15.177:0/819097177 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040052d0 con 0x7f151013eb80 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f150d7fa700 1 -- 172.21.15.177:0/819097177 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504005430 con 0x7f151013eb80 2023-11-27T17:48:43.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1510140110 con 0x7f151013eb80 2023-11-27T17:48:43.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f150d7fa700 1 -- 172.21.15.177:0/819097177 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040038c0 con 0x7f151013eb80 2023-11-27T17:48:43.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.675+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151013ac00 con 0x7f151013eb80 2023-11-27T17:48:43.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.676+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1510069400 con 0x7f151013eb80 2023-11-27T17:48:43.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.677+0000 7f150d7fa700 1 -- 172.21.15.177:0/819097177 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1504003a20 con 0x7f151013eb80 2023-11-27T17:48:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.677+0000 7f150d7fa700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f14f406b250 0x7f14f406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.677+0000 7f150d7fa700 1 -- 172.21.15.177:0/819097177 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1504088e10 con 0x7f151013eb80 2023-11-27T17:48:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.677+0000 7f150ffff700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f14f406b250 0x7f14f406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:43.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.678+0000 7f150ffff700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f14f406b250 0x7f14f406d710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f15100b55e0 tx=0x7f14fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:43.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.682+0000 7f150d7fa700 1 -- 172.21.15.177:0/819097177 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f150408c030 con 0x7f151013eb80 2023-11-27T17:48:43.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.872+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f151013ad90 con 0x7f151013eb80 2023-11-27T17:48:43.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.873+0000 7f150d7fa700 1 -- 172.21.15.177:0/819097177 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1504017020 con 0x7f151013eb80 2023-11-27T17:48:43.875 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:43.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.874+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f14f406b250 msgr2=0x7f14f406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.874+0000 7f1516f43700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f14f406b250 0x7f14f406d710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f15100b55e0 tx=0x7f14fc008040 comp rx=0 tx=0).stop 2023-11-27T17:48:43.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.874+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f151013eb80 msgr2=0x7f151013a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:43.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.874+0000 7f1516f43700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f151013eb80 0x7f151013a590 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f150400c4e0 tx=0x7f150400c7f0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.875+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 shutdown_connections 2023-11-27T17:48:43.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.875+0000 7f1516f43700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f14f406b250 0x7f14f406d710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.875+0000 7f1516f43700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1510156aa0 0x7f1510139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.875+0000 7f1516f43700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f151013eb80 0x7f151013a590 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.875+0000 7f1516f43700 1 --2- 172.21.15.177:0/819097177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15101419f0 0x7f15101534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:43.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.875+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 >> 172.21.15.177:0/819097177 conn(0x7f15100b31d0 msgr2=0x7f1510140480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:43.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.875+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 shutdown_connections 2023-11-27T17:48:43.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:43.875+0000 7f1516f43700 1 -- 172.21.15.177:0/819097177 wait complete. 2023-11-27T17:48:43.889 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:44.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.010+0000 7fa40360a700 1 Processor -- start 2023-11-27T17:48:44.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.010+0000 7fa40360a700 1 -- start start 2023-11-27T17:48:44.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa40360a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3fc147930 0x7fa3fc161b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa40360a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc162070 0x7fa3fc0b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa40360a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3fc0b0600 0x7fa3fc15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa40360a700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3fc1624d0 con 0x7fa3fc0b0600 2023-11-27T17:48:44.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa40360a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3fc0b0e70 con 0x7fa3fc147930 2023-11-27T17:48:44.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa40360a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc0b1150 con 0x7fa3fc162070 2023-11-27T17:48:44.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3fc0b0600 0x7fa3fc15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3fc0b0600 0x7fa3fc15e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52360/0 (socket says 172.21.15.177:52360) 2023-11-27T17:48:44.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 -- 172.21.15.177:0/3485531363 learned_addr learned my addr 172.21.15.177:0/3485531363 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:44.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa4013a6700 1 --2- 172.21.15.177:0/3485531363 >> v2:172.21.15.178:3300/0 conn(0x7fa3fc147930 0x7fa3fc161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa400ba5700 1 --2- 172.21.15.177:0/3485531363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc162070 0x7fa3fc0b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 -- 172.21.15.177:0/3485531363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc162070 msgr2=0x7fa3fc0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:44.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 --2- 172.21.15.177:0/3485531363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc162070 0x7fa3fc0b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 -- 172.21.15.177:0/3485531363 >> v2:172.21.15.178:3300/0 conn(0x7fa3fc147930 msgr2=0x7fa3fc161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:44.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 --2- 172.21.15.177:0/3485531363 >> v2:172.21.15.178:3300/0 conn(0x7fa3fc147930 0x7fa3fc161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 -- 172.21.15.177:0/3485531363 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc0b1430 con 0x7fa3fc0b0600 2023-11-27T17:48:44.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa4013a6700 1 --2- 172.21.15.177:0/3485531363 >> v2:172.21.15.178:3300/0 conn(0x7fa3fc147930 0x7fa3fc161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:44.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa401ba7700 1 --2- 172.21.15.177:0/3485531363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc0b0600 0x7fa3fc15e4f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc06c250 tx=0x7fa3f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ab91806d0d2b9a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa3f3fff700 1 -- 172.21.15.177:0/3485531363 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400e070 con 0x7fa3fc0b0600 2023-11-27T17:48:44.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa3f3fff700 1 -- 172.21.15.177:0/3485531363 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400b9c0 con 0x7fa3fc0b0600 2023-11-27T17:48:44.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.011+0000 7fa3f3fff700 1 -- 172.21.15.177:0/3485531363 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400bd70 con 0x7fa3fc0b0600 2023-11-27T17:48:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 -- 172.21.15.177:0/3485531363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc0b0600 msgr2=0x7fa3fc15e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 --2- 172.21.15.177:0/3485531363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc0b0600 0x7fa3fc15e4f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc06c250 tx=0x7fa3f400b330 comp rx=0 tx=0).stop 2023-11-27T17:48:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 -- 172.21.15.177:0/3485531363 shutdown_connections 2023-11-27T17:48:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 --2- 172.21.15.177:0/3485531363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc0b0600 0x7fa3fc15e4f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 --2- 172.21.15.177:0/3485531363 >> v2:172.21.15.178:3300/0 conn(0x7fa3fc147930 0x7fa3fc161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 --2- 172.21.15.177:0/3485531363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc162070 0x7fa3fc0b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 -- 172.21.15.177:0/3485531363 >> 172.21.15.177:0/3485531363 conn(0x7fa3fc0b3420 msgr2=0x7fa3fc0b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 -- 172.21.15.177:0/3485531363 shutdown_connections 2023-11-27T17:48:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.012+0000 7fa40360a700 1 -- 172.21.15.177:0/3485531363 wait complete. 2023-11-27T17:48:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.013+0000 7fa40360a700 1 Processor -- start 2023-11-27T17:48:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.013+0000 7fa40360a700 1 -- start start 2023-11-27T17:48:44.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa40360a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc0b0600 0x7fa3fc145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa40360a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc147930 0x7fa3fc071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa40360a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3fc162070 0x7fa3fc0c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa40360a700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc1464f0 con 0x7fa3fc147930 2023-11-27T17:48:44.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa40360a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc072ef0 con 0x7fa3fc162070 2023-11-27T17:48:44.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa40360a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc072650 con 0x7fa3fc0b0600 2023-11-27T17:48:44.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc147930 0x7fa3fc071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc147930 0x7fa3fc071f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52366/0 (socket says 172.21.15.177:52366) 2023-11-27T17:48:44.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 -- 172.21.15.177:0/582550168 learned_addr learned my addr 172.21.15.177:0/582550168 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:44.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa4013a6700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc0b0600 0x7fa3fc145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa401ba7700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3fc162070 0x7fa3fc0c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 -- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc0b0600 msgr2=0x7fa3fc145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc0b0600 0x7fa3fc145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 -- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3fc162070 msgr2=0x7fa3fc0c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3fc162070 0x7fa3fc0c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 -- 172.21.15.177:0/582550168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4009b30 con 0x7fa3fc147930 2023-11-27T17:48:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa4013a6700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc0b0600 0x7fa3fc145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.014+0000 7fa400ba5700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc147930 0x7fa3fc071f50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00d800 tx=0x7fa3ec00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.015+0000 7fa3f1ffb700 1 -- 172.21.15.177:0/582550168 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0125f0 con 0x7fa3fc147930 2023-11-27T17:48:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.015+0000 7fa3f1ffb700 1 -- 172.21.15.177:0/582550168 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec012750 con 0x7fa3fc147930 2023-11-27T17:48:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.015+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3fc072930 con 0x7fa3fc147930 2023-11-27T17:48:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.015+0000 7fa3f1ffb700 1 -- 172.21.15.177:0/582550168 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec012b00 con 0x7fa3fc147930 2023-11-27T17:48:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.015+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc1e8550 con 0x7fa3fc147930 2023-11-27T17:48:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.016+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3fc1e8710 con 0x7fa3fc147930 2023-11-27T17:48:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.016+0000 7fa3f1ffb700 1 -- 172.21.15.177:0/582550168 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa3ec012c60 con 0x7fa3fc147930 2023-11-27T17:48:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.017+0000 7fa3f1ffb700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa3e006b250 0x7fa3e006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.017+0000 7fa3f1ffb700 1 -- 172.21.15.177:0/582550168 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3ec089ca0 con 0x7fa3fc147930 2023-11-27T17:48:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.017+0000 7fa4013a6700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa3e006b250 0x7fa3e006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.017+0000 7fa4013a6700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa3e006b250 0x7fa3e006d710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0cd7a0 tx=0x7fa3f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.021+0000 7fa3f1ffb700 1 -- 172.21.15.177:0/582550168 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa3ec0549d0 con 0x7fa3fc147930 2023-11-27T17:48:44.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.213+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3fc069400 con 0x7fa3fc147930 2023-11-27T17:48:44.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.214+0000 7fa3f1ffb700 1 -- 172.21.15.177:0/582550168 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3ec057ff0 con 0x7fa3fc147930 2023-11-27T17:48:44.216 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:44.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa3e006b250 msgr2=0x7fa3e006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa3e006b250 0x7fa3e006d710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0cd7a0 tx=0x7fa3f8008040 comp rx=0 tx=0).stop 2023-11-27T17:48:44.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc147930 msgr2=0x7fa3fc071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc147930 0x7fa3fc071f50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00d800 tx=0x7fa3ec00db10 comp rx=0 tx=0).stop 2023-11-27T17:48:44.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 shutdown_connections 2023-11-27T17:48:44.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa3e006b250 0x7fa3e006d710 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3fc162070 0x7fa3fc0c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3fc0b0600 0x7fa3fc145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 --2- 172.21.15.177:0/582550168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3fc147930 0x7fa3fc071f50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 >> 172.21.15.177:0/582550168 conn(0x7fa3fc0b3420 msgr2=0x7fa3fc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 shutdown_connections 2023-11-27T17:48:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.216+0000 7fa40360a700 1 -- 172.21.15.177:0/582550168 wait complete. 2023-11-27T17:48:44.231 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:44.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.348+0000 7f9a73a3b700 1 Processor -- start 2023-11-27T17:48:44.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.348+0000 7f9a73a3b700 1 -- start start 2023-11-27T17:48:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.349+0000 7f9a73a3b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a6c0b6170 0x7f9a6c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.349+0000 7f9a73a3b700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c0b5ce0 con 0x7f9a6c147880 2023-11-27T17:48:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.349+0000 7f9a73a3b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c0b5700 con 0x7f9a6c0b6600 2023-11-27T17:48:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.349+0000 7f9a73a3b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c06e020 con 0x7f9a6c0b6170 2023-11-27T17:48:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.349+0000 7f9a717d7700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9a6c147880 0x7f9a6c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46688/0 (socket says 172.21.15.177:46688) 2023-11-27T17:48:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.349+0000 7f9a717d7700 1 -- 172.21.15.177:0/587305254 learned_addr learned my addr 172.21.15.177:0/587305254 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.349+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154254990 0 0) 0x7f9a6c0b5ce0 con 0x7f9a6c147880 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.349+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a580035b0 con 0x7f9a6c147880 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a70fd6700 1 --2- 172.21.15.177:0/587305254 >> v2:172.21.15.178:3300/0 conn(0x7f9a6c0b6170 0x7f9a6c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4259962319 0 0) 0x7f9a580035b0 con 0x7f9a6c147880 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 >> v2:172.21.15.178:3300/0 conn(0x7f9a6c0b6170 msgr2=0x7f9a6c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 --2- 172.21.15.177:0/587305254 >> v2:172.21.15.178:3300/0 conn(0x7f9a6c0b6170 0x7f9a6c0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 >> v1:172.21.15.178:6789/0 conn(0x7f9a6c0b6600 legacy=0x7f9a6c15f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c06e230 con 0x7f9a6c147880 2023-11-27T17:48:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f9a68001670 con 0x7f9a6c147880 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 >> v1:172.21.15.177:6789/0 conn(0x7f9a6c147880 legacy=0x7f9a6c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a58004850 0x7f9a58004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a58005210 0x7f9a5800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c06e020 con 0x7f9a58003a00 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5800c0b0 con 0x7f9a58005210 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5800c270 con 0x7f9a58004850 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a717d7700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a71fd8700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a58005210 0x7f9a5800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a70fd6700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a58004850 0x7f9a58004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a717d7700 1 -- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a58004850 msgr2=0x7f9a58004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a717d7700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a58004850 0x7f9a58004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a717d7700 1 -- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a58005210 msgr2=0x7f9a5800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a717d7700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a58005210 0x7f9a5800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a71fd8700 1 -- 172.21.15.177:0/587305254 reap_dead start 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a717d7700 1 -- 172.21.15.177:0/587305254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a580035b0 con 0x7f9a58003a00 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a70fd6700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a58004850 0x7f9a58004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.350+0000 7f9a717d7700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a58003e20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c2a0 tx=0x7f9a58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73e1f5bc203edbf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68007c10 con 0x7f9a58003a00 2023-11-27T17:48:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6800cde0 con 0x7f9a58003a00 2023-11-27T17:48:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a63fff700 1 -- 172.21.15.177:0/587305254 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68005ba0 con 0x7f9a58003a00 2023-11-27T17:48:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a73a3b700 1 -- 172.21.15.177:0/587305254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 msgr2=0x7f9a58003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a73a3b700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a58003e20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c2a0 tx=0x7f9a58005880 comp rx=0 tx=0).stop 2023-11-27T17:48:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a73a3b700 1 -- 172.21.15.177:0/587305254 shutdown_connections 2023-11-27T17:48:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a73a3b700 1 --2- 172.21.15.177:0/587305254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a58003e20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a73a3b700 1 -- 172.21.15.177:0/587305254 >> 172.21.15.177:0/587305254 conn(0x7f9a6c0b2130 msgr2=0x7f9a6c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a73a3b700 1 -- 172.21.15.177:0/587305254 shutdown_connections 2023-11-27T17:48:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.351+0000 7f9a73a3b700 1 -- 172.21.15.177:0/587305254 wait complete. 2023-11-27T17:48:44.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.352+0000 7f9a73a3b700 1 Processor -- start 2023-11-27T17:48:44.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a73a3b700 1 -- start start 2023-11-27T17:48:44.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a73a3b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a6c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a73a3b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a6c0ae860 0x7f9a6c0aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a73a3b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a6c0c7970 0x7f9a6c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a73a3b700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c7550 con 0x7f9a58003a00 2023-11-27T17:48:44.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a73a3b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0af200 con 0x7f9a6c0c7970 2023-11-27T17:48:44.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a73a3b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c68d0 con 0x7f9a6c0ae860 2023-11-27T17:48:44.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a717d7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a6c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a717d7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a6c0c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52384/0 (socket says 172.21.15.177:52384) 2023-11-27T17:48:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a717d7700 1 -- 172.21.15.177:0/340301244 learned_addr learned my addr 172.21.15.177:0/340301244 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a71fd8700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a6c0c7970 0x7f9a6c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.353+0000 7f9a70fd6700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a6c0ae860 0x7f9a6c0aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a717d7700 1 -- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a6c0ae860 msgr2=0x7f9a6c0aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a717d7700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a6c0ae860 0x7f9a6c0aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a717d7700 1 -- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a6c0c7970 msgr2=0x7f9a6c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a717d7700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a6c0c7970 0x7f9a6c0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a717d7700 1 -- 172.21.15.177:0/340301244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0c6bb0 con 0x7f9a58003a00 2023-11-27T17:48:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a70fd6700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a6c0ae860 0x7f9a6c0aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a717d7700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a6c0c61d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000c00 tx=0x7f9a6c0b1aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a61ffb700 1 -- 172.21.15.177:0/340301244 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68001670 con 0x7f9a58003a00 2023-11-27T17:48:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a61ffb700 1 -- 172.21.15.177:0/340301244 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a680070d0 con 0x7f9a58003a00 2023-11-27T17:48:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a61ffb700 1 -- 172.21.15.177:0/340301244 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a680074a0 con 0x7f9a58003a00 2023-11-27T17:48:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c0c6e90 con 0x7f9a58003a00 2023-11-27T17:48:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.354+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c133110 con 0x7f9a58003a00 2023-11-27T17:48:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.355+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c073aa0 con 0x7f9a58003a00 2023-11-27T17:48:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.355+0000 7f9a61ffb700 1 -- 172.21.15.177:0/340301244 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9a68007600 con 0x7f9a58003a00 2023-11-27T17:48:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.356+0000 7f9a61ffb700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9a5006b250 0x7f9a5006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.356+0000 7f9a61ffb700 1 -- 172.21.15.177:0/340301244 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a6808a820 con 0x7f9a58003a00 2023-11-27T17:48:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.356+0000 7f9a70fd6700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9a5006b250 0x7f9a5006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.356+0000 7f9a70fd6700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9a5006b250 0x7f9a5006d710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c050b10 tx=0x7f9a5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.360+0000 7f9a61ffb700 1 -- 172.21.15.177:0/340301244 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9a680555e0 con 0x7f9a58003a00 2023-11-27T17:48:44.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.553+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a6c069400 con 0x7f9a58003a00 2023-11-27T17:48:44.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.554+0000 7f9a61ffb700 1 -- 172.21.15.177:0/340301244 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f9a6808a020 con 0x7f9a58003a00 2023-11-27T17:48:44.557 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:44.558 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:44.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9a5006b250 msgr2=0x7f9a5006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9a5006b250 0x7f9a5006d710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c050b10 tx=0x7f9a5c008040 comp rx=0 tx=0).stop 2023-11-27T17:48:44.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 msgr2=0x7f9a6c0c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a6c0c61d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000c00 tx=0x7f9a6c0b1aa0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 shutdown_connections 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9a5006b250 0x7f9a5006d710 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a6c0c7970 0x7f9a6c0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a58003a00 0x7f9a6c0c61d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 --2- 172.21.15.177:0/340301244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a6c0ae860 0x7f9a6c0aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.556+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 >> 172.21.15.177:0/340301244 conn(0x7f9a6c0b2130 msgr2=0x7f9a6c0d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.557+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 shutdown_connections 2023-11-27T17:48:44.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.557+0000 7f9a73a3b700 1 -- 172.21.15.177:0/340301244 wait complete. 2023-11-27T17:48:44.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:44.571 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:44.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.693+0000 7f1e8cb80700 1 Processor -- start 2023-11-27T17:48:44.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.693+0000 7f1e8cb80700 1 -- start start 2023-11-27T17:48:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e8cb80700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e881622d0 0x7f1e8806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e8cb80700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8815fea0 con 0x7f1e881585b0 2023-11-27T17:48:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e8cb80700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880b5370 con 0x7f1e8806c260 2023-11-27T17:48:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e8cb80700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880b7af0 con 0x7f1e881622d0 2023-11-27T17:48:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e86d9d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e881622d0 0x7f1e8806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e86d9d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e881622d0 0x7f1e8806c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52390/0 (socket says 172.21.15.177:52390) 2023-11-27T17:48:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e86d9d700 1 -- 172.21.15.177:0/4081775558 learned_addr learned my addr 172.21.15.177:0/4081775558 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e8659c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1e881585b0 0x7f1e8815f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46706/0 (socket says 172.21.15.177:46706) 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e86d9d700 1 -- 172.21.15.177:0/4081775558 >> v1:172.21.15.178:6789/0 conn(0x7f1e8806c260 legacy=0x7f1e88161bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e86d9d700 1 -- 172.21.15.177:0/4081775558 >> v1:172.21.15.177:6789/0 conn(0x7f1e881585b0 legacy=0x7f1e8815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e86d9d700 1 -- 172.21.15.177:0/4081775558 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880b5650 con 0x7f1e881622d0 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e8559a700 1 -- 172.21.15.177:0/4081775558 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568866425 0 0) 0x7f1e8815fea0 con 0x7f1e881585b0 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e86d9d700 1 --2- 172.21.15.177:0/4081775558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881622d0 0x7f1e8806c6e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009e50 tx=0x7f1e8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a984594fbcd0c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.694+0000 7f1e8559a700 1 -- 172.21.15.177:0/4081775558 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000e070 con 0x7f1e881622d0 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8559a700 1 -- 172.21.15.177:0/4081775558 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80003a20 con 0x7f1e881622d0 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8559a700 1 -- 172.21.15.177:0/4081775558 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80003dd0 con 0x7f1e881622d0 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8cb80700 1 -- 172.21.15.177:0/4081775558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881622d0 msgr2=0x7f1e8806c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8cb80700 1 --2- 172.21.15.177:0/4081775558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881622d0 0x7f1e8806c6e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009e50 tx=0x7f1e8000b330 comp rx=0 tx=0).stop 2023-11-27T17:48:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8cb80700 1 -- 172.21.15.177:0/4081775558 shutdown_connections 2023-11-27T17:48:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8cb80700 1 --2- 172.21.15.177:0/4081775558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881622d0 0x7f1e8806c6e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8cb80700 1 -- 172.21.15.177:0/4081775558 >> 172.21.15.177:0/4081775558 conn(0x7f1e880b31d0 msgr2=0x7f1e880b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8cb80700 1 -- 172.21.15.177:0/4081775558 shutdown_connections 2023-11-27T17:48:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.695+0000 7f1e8cb80700 1 -- 172.21.15.177:0/4081775558 wait complete. 2023-11-27T17:48:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e8cb80700 1 Processor -- start 2023-11-27T17:48:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e8cb80700 1 -- start start 2023-11-27T17:48:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e8cb80700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8806c260 0x7f1e88147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e8cb80700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881585b0 0x7f1e880cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e8cb80700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e881622d0 0x7f1e880cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e8cb80700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880cd110 con 0x7f1e881585b0 2023-11-27T17:48:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e8cb80700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88147e80 con 0x7f1e881622d0 2023-11-27T17:48:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e8cb80700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880d10b0 con 0x7f1e8806c260 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e85d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881585b0 0x7f1e880cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e85d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881585b0 0x7f1e880cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52392/0 (socket says 172.21.15.177:52392) 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.697+0000 7f1e85d9b700 1 -- 172.21.15.177:0/732644728 learned_addr learned my addr 172.21.15.177:0/732644728 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e8659c700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8806c260 0x7f1e88147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e86d9d700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e881622d0 0x7f1e880cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e85d9b700 1 -- 172.21.15.177:0/732644728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8806c260 msgr2=0x7f1e88147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e85d9b700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8806c260 0x7f1e88147940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e85d9b700 1 -- 172.21.15.177:0/732644728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e881622d0 msgr2=0x7f1e880cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e85d9b700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e881622d0 0x7f1e880cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e85d9b700 1 -- 172.21.15.177:0/732644728 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009b30 con 0x7f1e881585b0 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e85d9b700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881585b0 0x7f1e880cd860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00b4d0 tx=0x7f1e7c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e76ffd700 1 -- 172.21.15.177:0/732644728 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c011830 con 0x7f1e881585b0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e76ffd700 1 -- 172.21.15.177:0/732644728 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c011990 con 0x7f1e881585b0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e880cc490 con 0x7f1e881585b0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e76ffd700 1 -- 172.21.15.177:0/732644728 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c011d40 con 0x7f1e881585b0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.698+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e880cca50 con 0x7f1e881585b0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.699+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e88069400 con 0x7f1e881585b0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.699+0000 7f1e76ffd700 1 -- 172.21.15.177:0/732644728 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1e7c01a400 con 0x7f1e881585b0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.700+0000 7f1e76ffd700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1e6806b250 0x7f1e6806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.700+0000 7f1e76ffd700 1 -- 172.21.15.177:0/732644728 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e7c0896c0 con 0x7f1e881585b0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.700+0000 7f1e8659c700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1e6806b250 0x7f1e6806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.700+0000 7f1e8659c700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1e6806b250 0x7f1e6806d710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1e78000f60 tx=0x7f1e78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:44.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.704+0000 7f1e76ffd700 1 -- 172.21.15.177:0/732644728 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1e7c0543f0 con 0x7f1e881585b0 2023-11-27T17:48:44.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.899+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e8806efe0 con 0x7f1e881585b0 2023-11-27T17:48:44.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.900+0000 7f1e76ffd700 1 -- 172.21.15.177:0/732644728 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e7c057a10 con 0x7f1e881585b0 2023-11-27T17:48:44.902 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1e6806b250 msgr2=0x7f1e6806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1e6806b250 0x7f1e6806d710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1e78000f60 tx=0x7f1e78009040 comp rx=0 tx=0).stop 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881585b0 msgr2=0x7f1e880cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881585b0 0x7f1e880cd860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00b4d0 tx=0x7f1e7c00b890 comp rx=0 tx=0).stop 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 shutdown_connections 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1e6806b250 0x7f1e6806d710 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e881622d0 0x7f1e880cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8806c260 0x7f1e88147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 --2- 172.21.15.177:0/732644728 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e881585b0 0x7f1e880cd860 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:44.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 >> 172.21.15.177:0/732644728 conn(0x7f1e880b31d0 msgr2=0x7f1e881600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:44.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 shutdown_connections 2023-11-27T17:48:44.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:44.902+0000 7f1e8cb80700 1 -- 172.21.15.177:0/732644728 wait complete. 2023-11-27T17:48:44.916 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:45.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f87510c9700 1 Processor -- start 2023-11-27T17:48:45.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f87510c9700 1 -- start start 2023-11-27T17:48:45.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f87510c9700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f874c0afa50 0x7f874c0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f87510c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c15b3d0 0x7f874c15e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f87510c9700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c15b870 con 0x7f874c0cd850 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f87510c9700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c0afe30 con 0x7f874c0afa50 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f87510c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c15bb50 con 0x7f874c15b3d0 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f874ad9d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f874c0afa50 0x7f874c0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f874ad9d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f874c0afa50 0x7f874c0b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52400/0 (socket says 172.21.15.177:52400) 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f874b59e700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f874c0cd850 0x7f874c0cf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46720/0 (socket says 172.21.15.177:46720) 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.038+0000 7f874ad9d700 1 -- 172.21.15.177:0/654226573 learned_addr learned my addr 172.21.15.177:0/654226573 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f874a59c700 1 --2- 172.21.15.177:0/654226573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c15b3d0 0x7f874c15e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f8749d9b700 1 -- 172.21.15.177:0/654226573 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958203464 0 0) 0x7f874c15b870 con 0x7f874c0cd850 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f8749d9b700 1 -- 172.21.15.177:0/654226573 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87380035b0 con 0x7f874c0cd850 2023-11-27T17:48:45.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f874ad9d700 1 -- 172.21.15.177:0/654226573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c15b3d0 msgr2=0x7f874c15e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f874ad9d700 1 --2- 172.21.15.177:0/654226573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c15b3d0 0x7f874c15e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f874ad9d700 1 -- 172.21.15.177:0/654226573 >> v1:172.21.15.177:6789/0 conn(0x7f874c0cd850 legacy=0x7f874c0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f874ad9d700 1 -- 172.21.15.177:0/654226573 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c15be30 con 0x7f874c0afa50 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f874a59c700 1 --2- 172.21.15.177:0/654226573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c15b3d0 0x7f874c15e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f874ad9d700 1 --2- 172.21.15.177:0/654226573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c0b0e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f873400bb90 tx=0x7f873400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ded30c72686a0ee server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f8749d9b700 1 -- 172.21.15.177:0/654226573 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873400dd30 con 0x7f874c0afa50 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f8749d9b700 1 -- 172.21.15.177:0/654226573 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873400de90 con 0x7f874c0afa50 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.039+0000 7f8749d9b700 1 -- 172.21.15.177:0/654226573 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734010670 con 0x7f874c0afa50 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.040+0000 7f87510c9700 1 -- 172.21.15.177:0/654226573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 msgr2=0x7f874c0b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.040+0000 7f87510c9700 1 --2- 172.21.15.177:0/654226573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c0b0e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f873400bb90 tx=0x7f873400bea0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.040+0000 7f87510c9700 1 -- 172.21.15.177:0/654226573 shutdown_connections 2023-11-27T17:48:45.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.040+0000 7f87510c9700 1 --2- 172.21.15.177:0/654226573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c0b0e80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.040+0000 7f87510c9700 1 --2- 172.21.15.177:0/654226573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c15b3d0 0x7f874c15e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.040+0000 7f87510c9700 1 -- 172.21.15.177:0/654226573 >> 172.21.15.177:0/654226573 conn(0x7f874c0b38b0 msgr2=0x7f874c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.040+0000 7f87510c9700 1 -- 172.21.15.177:0/654226573 shutdown_connections 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.040+0000 7f87510c9700 1 -- 172.21.15.177:0/654226573 wait complete. 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.041+0000 7f87510c9700 1 Processor -- start 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.041+0000 7f87510c9700 1 -- start start 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f87510c9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f87510c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0cd850 0x7f874c0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f87510c9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c15b3d0 0x7f874c0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f87510c9700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c157370 con 0x7f874c0afa50 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f87510c9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c14e1d0 con 0x7f874c15b3d0 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f87510c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0b5c00 con 0x7f874c0cd850 2023-11-27T17:48:45.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874ad9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874ad9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52404/0 (socket says 172.21.15.177:52404) 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874ad9d700 1 -- 172.21.15.177:0/3559128251 learned_addr learned my addr 172.21.15.177:0/3559128251 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874b59e700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c15b3d0 0x7f874c0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874a59c700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0cd850 0x7f874c0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874ad9d700 1 -- 172.21.15.177:0/3559128251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0cd850 msgr2=0x7f874c0b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874ad9d700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0cd850 0x7f874c0b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874ad9d700 1 -- 172.21.15.177:0/3559128251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c15b3d0 msgr2=0x7f874c0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874ad9d700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c15b3d0 0x7f874c0b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.042+0000 7f874ad9d700 1 -- 172.21.15.177:0/3559128251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873400b7f0 con 0x7f874c0afa50 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.043+0000 7f874ad9d700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c155a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f873400bee0 tx=0x7f8734004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.043+0000 7f87437fe700 1 -- 172.21.15.177:0/3559128251 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873401d070 con 0x7f874c0afa50 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.043+0000 7f87437fe700 1 -- 172.21.15.177:0/3559128251 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873400dcb0 con 0x7f874c0afa50 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.043+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c0b5ee0 con 0x7f874c0afa50 2023-11-27T17:48:45.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.043+0000 7f87437fe700 1 -- 172.21.15.177:0/3559128251 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734010c50 con 0x7f874c0afa50 2023-11-27T17:48:45.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.043+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c155f80 con 0x7f874c0afa50 2023-11-27T17:48:45.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.044+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c156170 con 0x7f874c0afa50 2023-11-27T17:48:45.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.044+0000 7f87437fe700 1 -- 172.21.15.177:0/3559128251 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f87340036a0 con 0x7f874c0afa50 2023-11-27T17:48:45.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.044+0000 7f87437fe700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f872c06b250 0x7f872c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.044+0000 7f87437fe700 1 -- 172.21.15.177:0/3559128251 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f873408b590 con 0x7f874c0afa50 2023-11-27T17:48:45.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.044+0000 7f874a59c700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f872c06b250 0x7f872c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.045+0000 7f874a59c700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f872c06b250 0x7f872c06d710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f874c1f6f10 tx=0x7f873c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.049+0000 7f87437fe700 1 -- 172.21.15.177:0/3559128251 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8734056350 con 0x7f874c0afa50 2023-11-27T17:48:45.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.238+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f874c0b60c0 con 0x7f874c0afa50 2023-11-27T17:48:45.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.238+0000 7f87437fe700 1 -- 172.21.15.177:0/3559128251 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8734059970 con 0x7f874c0afa50 2023-11-27T17:48:45.241 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:45.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f872c06b250 msgr2=0x7f872c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f872c06b250 0x7f872c06d710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f874c1f6f10 tx=0x7f873c008040 comp rx=0 tx=0).stop 2023-11-27T17:48:45.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 msgr2=0x7f874c155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c155a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f873400bee0 tx=0x7f8734004750 comp rx=0 tx=0).stop 2023-11-27T17:48:45.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 shutdown_connections 2023-11-27T17:48:45.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f872c06b250 0x7f872c06d710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c15b3d0 0x7f874c0b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f874c0afa50 0x7f874c155a40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 --2- 172.21.15.177:0/3559128251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0cd850 0x7f874c0b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.240+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 >> 172.21.15.177:0/3559128251 conn(0x7f874c0b38b0 msgr2=0x7f874c1568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:45.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.241+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 shutdown_connections 2023-11-27T17:48:45.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.241+0000 7f87510c9700 1 -- 172.21.15.177:0/3559128251 wait complete. 2023-11-27T17:48:45.256 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:45.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.376+0000 7facc90d3700 1 Processor -- start 2023-11-27T17:48:45.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.376+0000 7facc90d3700 1 -- start start 2023-11-27T17:48:45.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc90d3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7facc40afc30 0x7facc4162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc90d3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc4162bc0 con 0x7facc4146f00 2023-11-27T17:48:45.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc90d3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc40b0110 con 0x7facc40cdff0 2023-11-27T17:48:45.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc90d3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc41472e0 con 0x7facc40afc30 2023-11-27T17:48:45.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc2d9d700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7facc4146f00 0x7facc40cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46730/0 (socket says 172.21.15.177:46730) 2023-11-27T17:48:45.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc2d9d700 1 -- 172.21.15.177:0/2743974434 learned_addr learned my addr 172.21.15.177:0/2743974434 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:45.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc359e700 1 --2- 172.21.15.177:0/2743974434 >> v2:172.21.15.178:3300/0 conn(0x7facc40afc30 0x7facc4162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063982699 0 0) 0x7facc4162bc0 con 0x7facc4146f00 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.377+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facac0035b0 con 0x7facc4146f00 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090108111 0 0) 0x7facac0035b0 con 0x7facc4146f00 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 >> v2:172.21.15.178:3300/0 conn(0x7facc40afc30 msgr2=0x7facc4162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 --2- 172.21.15.177:0/2743974434 >> v2:172.21.15.178:3300/0 conn(0x7facc40afc30 0x7facc4162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 >> v1:172.21.15.178:6789/0 conn(0x7facc40cdff0 legacy=0x7facc40cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc40b03f0 con 0x7facc4146f00 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7facb8001670 con 0x7facc4146f00 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 >> v1:172.21.15.177:6789/0 conn(0x7facc4146f00 legacy=0x7facc40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facac003a00 0x7facac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facac004850 0x7facac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac005210 0x7facac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc41472e0 con 0x7facac004850 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac00c0b0 con 0x7facac003a00 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac00c270 con 0x7facac005210 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc259c700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facac004850 0x7facac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc2d9d700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facac003a00 0x7facac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc359e700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac005210 0x7facac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc259c700 1 -- 172.21.15.177:0/2743974434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac005210 msgr2=0x7facac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc259c700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac005210 0x7facac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc259c700 1 -- 172.21.15.177:0/2743974434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facac003a00 msgr2=0x7facac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc259c700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facac003a00 0x7facac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc359e700 1 -- 172.21.15.177:0/2743974434 reap_dead start 2023-11-27T17:48:45.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc259c700 1 -- 172.21.15.177:0/2743974434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0035b0 con 0x7facac004850 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc259c700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facac004850 0x7facac004cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7facc40b1460 tx=0x7facac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7d9b28acb6efe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.378+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40052d0 con 0x7facac004850 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4005450 con 0x7facac004850 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc1d9b700 1 -- 172.21.15.177:0/2743974434 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40038c0 con 0x7facac004850 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc90d3700 1 -- 172.21.15.177:0/2743974434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facac004850 msgr2=0x7facac004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc90d3700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facac004850 0x7facac004cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7facc40b1460 tx=0x7facac005880 comp rx=0 tx=0).stop 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc90d3700 1 -- 172.21.15.177:0/2743974434 shutdown_connections 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc90d3700 1 --2- 172.21.15.177:0/2743974434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facac004850 0x7facac004cd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc90d3700 1 -- 172.21.15.177:0/2743974434 >> 172.21.15.177:0/2743974434 conn(0x7facc40b38b0 msgr2=0x7facc40b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc90d3700 1 -- 172.21.15.177:0/2743974434 shutdown_connections 2023-11-27T17:48:45.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.379+0000 7facc90d3700 1 -- 172.21.15.177:0/2743974434 wait complete. 2023-11-27T17:48:45.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc90d3700 1 Processor -- start 2023-11-27T17:48:45.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc90d3700 1 -- start start 2023-11-27T17:48:45.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc90d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac004850 0x7facc4070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc90d3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc4154490 0x7facc40c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc90d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc413ea30 0x7facc40726c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc90d3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40c63b0 con 0x7facc4154490 2023-11-27T17:48:45.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc90d3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc4154910 con 0x7facc413ea30 2023-11-27T17:48:45.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc90d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc4071900 con 0x7facac004850 2023-11-27T17:48:45.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc259c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc4154490 0x7facc40c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc259c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc4154490 0x7facc40c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52426/0 (socket says 172.21.15.177:52426) 2023-11-27T17:48:45.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc259c700 1 -- 172.21.15.177:0/1430795751 learned_addr learned my addr 172.21.15.177:0/1430795751 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:45.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.381+0000 7facc359e700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc413ea30 0x7facc40726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc2d9d700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac004850 0x7facc4070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc259c700 1 -- 172.21.15.177:0/1430795751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac004850 msgr2=0x7facc4070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc259c700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac004850 0x7facc4070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc259c700 1 -- 172.21.15.177:0/1430795751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc413ea30 msgr2=0x7facc40726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc259c700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc413ea30 0x7facc40726c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc259c700 1 -- 172.21.15.177:0/1430795751 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc4071be0 con 0x7facc4154490 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc259c700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc4154490 0x7facc40c5e70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7facb4005040 tx=0x7facb4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facab7fe700 1 -- 172.21.15.177:0/1430795751 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4006ea0 con 0x7facc4154490 2023-11-27T17:48:45.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facab7fe700 1 -- 172.21.15.177:0/1430795751 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4001290 con 0x7facc4154490 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facab7fe700 1 -- 172.21.15.177:0/1430795751 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4007280 con 0x7facc4154490 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc4071ec0 con 0x7facc4154490 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.382+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc40c65a0 con 0x7facc4154490 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.383+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc4072510 con 0x7facc4154490 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.384+0000 7facab7fe700 1 -- 172.21.15.177:0/1430795751 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7facb40073e0 con 0x7facc4154490 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.384+0000 7facab7fe700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facb006b250 0x7facb006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.384+0000 7facab7fe700 1 -- 172.21.15.177:0/1430795751 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facb408a0d0 con 0x7facc4154490 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.384+0000 7facc2d9d700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facb006b250 0x7facb006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.384+0000 7facc2d9d700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facb006b250 0x7facb006d710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7facb8001c10 tx=0x7facb8001b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.388+0000 7facab7fe700 1 -- 172.21.15.177:0/1430795751 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7facb4054f40 con 0x7facc4154490 2023-11-27T17:48:45.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.578+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7facc4071a40 con 0x7facc4154490 2023-11-27T17:48:45.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.578+0000 7facab7fe700 1 -- 172.21.15.177:0/1430795751 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7facc4071a40 con 0x7facc4154490 2023-11-27T17:48:45.581 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:45.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facb006b250 msgr2=0x7facb006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facb006b250 0x7facb006d710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7facb8001c10 tx=0x7facb8001b20 comp rx=0 tx=0).stop 2023-11-27T17:48:45.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc4154490 msgr2=0x7facc40c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc4154490 0x7facc40c5e70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7facb4005040 tx=0x7facb4001120 comp rx=0 tx=0).stop 2023-11-27T17:48:45.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 shutdown_connections 2023-11-27T17:48:45.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7facb006b250 0x7facb006d710 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc413ea30 0x7facc40726c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facac004850 0x7facc4070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 --2- 172.21.15.177:0/1430795751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facc4154490 0x7facc40c5e70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 >> 172.21.15.177:0/1430795751 conn(0x7facc40b38b0 msgr2=0x7facc4142de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:45.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 shutdown_connections 2023-11-27T17:48:45.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.581+0000 7facc90d3700 1 -- 172.21.15.177:0/1430795751 wait complete. 2023-11-27T17:48:45.627 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-27T17:48:45.628 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:45.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.746+0000 7fe78bc15700 1 Processor -- start 2023-11-27T17:48:45.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.746+0000 7fe78bc15700 1 -- start start 2023-11-27T17:48:45.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe78bc15700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7841413a0 0x7fe78406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe78bc15700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe784147370 0x7fe78406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe78bc15700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7840735a0 con 0x7fe784140fc0 2023-11-27T17:48:45.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe78bc15700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe784162cd0 con 0x7fe784147370 2023-11-27T17:48:45.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe78bc15700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840ae270 con 0x7fe7841413a0 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe7891b0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7841413a0 0x7fe78406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe78a1b2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe784147370 0x7fe78406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe7891b0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7841413a0 0x7fe78406cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39900/0 (socket says 172.21.15.177:39900) 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe78a1b2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe784147370 0x7fe78406d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:60458/0 (socket says 172.21.15.177:60458) 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe7891b0700 1 -- 172.21.15.177:0/2449481351 learned_addr learned my addr 172.21.15.177:0/2449481351 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe7899b1700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe784140fc0 0x7fe7840ae9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45728/0 (socket says 172.21.15.177:45728) 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe7891b0700 1 -- 172.21.15.177:0/2449481351 >> v2:172.21.15.178:3300/0 conn(0x7fe784147370 msgr2=0x7fe78406d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe7891b0700 1 --2- 172.21.15.177:0/2449481351 >> v2:172.21.15.178:3300/0 conn(0x7fe784147370 0x7fe78406d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe7891b0700 1 -- 172.21.15.177:0/2449481351 >> v1:172.21.15.178:6789/0 conn(0x7fe784140fc0 legacy=0x7fe7840ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe7891b0700 1 -- 172.21.15.177:0/2449481351 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840af0f0 con 0x7fe7841413a0 2023-11-27T17:48:45.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.747+0000 7fe78a1b2700 1 --2- 172.21.15.177:0/2449481351 >> v2:172.21.15.178:3300/0 conn(0x7fe784147370 0x7fe78406d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:45.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe7891b0700 1 --2- 172.21.15.177:0/2449481351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7841413a0 0x7fe78406cf00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7740098f0 tx=0x7fe774009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd35490c15cba473 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe7889af700 1 -- 172.21.15.177:0/2449481351 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774011830 con 0x7fe7841413a0 2023-11-27T17:48:45.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe7889af700 1 -- 172.21.15.177:0/2449481351 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774011990 con 0x7fe7841413a0 2023-11-27T17:48:45.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe7889af700 1 -- 172.21.15.177:0/2449481351 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774011d20 con 0x7fe7841413a0 2023-11-27T17:48:45.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe78bc15700 1 -- 172.21.15.177:0/2449481351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7841413a0 msgr2=0x7fe78406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe78bc15700 1 --2- 172.21.15.177:0/2449481351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7841413a0 0x7fe78406cf00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7740098f0 tx=0x7fe774009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:45.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe78bc15700 1 -- 172.21.15.177:0/2449481351 shutdown_connections 2023-11-27T17:48:45.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe78bc15700 1 --2- 172.21.15.177:0/2449481351 >> v2:172.21.15.178:3300/0 conn(0x7fe784147370 0x7fe78406d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe78bc15700 1 --2- 172.21.15.177:0/2449481351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7841413a0 0x7fe78406cf00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe78bc15700 1 -- 172.21.15.177:0/2449481351 >> 172.21.15.177:0/2449481351 conn(0x7fe7840d0e70 msgr2=0x7fe7840b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.748+0000 7fe78bc15700 1 -- 172.21.15.177:0/2449481351 shutdown_connections 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.749+0000 7fe78bc15700 1 -- 172.21.15.177:0/2449481351 wait complete. 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe78bc15700 1 Processor -- start 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe78bc15700 1 -- start start 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe78bc15700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784140fc0 0x7fe78413b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe78bc15700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7841413a0 0x7fe78415e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe78bc15700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe784147370 0x7fe78415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe78bc15700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78413bf20 con 0x7fe784140fc0 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe78bc15700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78415f550 con 0x7fe7841413a0 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe78bc15700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78415f270 con 0x7fe784147370 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe7899b1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784140fc0 0x7fe78413b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe7899b1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784140fc0 0x7fe78413b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52438/0 (socket says 172.21.15.177:52438) 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.750+0000 7fe7899b1700 1 -- 172.21.15.177:0/4079034255 learned_addr learned my addr 172.21.15.177:0/4079034255 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe78a1b2700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe784147370 0x7fe78415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe7891b0700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7841413a0 0x7fe78415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe7899b1700 1 -- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe784147370 msgr2=0x7fe78415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe7899b1700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe784147370 0x7fe78415ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe7899b1700 1 -- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7841413a0 msgr2=0x7fe78415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe7899b1700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7841413a0 0x7fe78415e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe7899b1700 1 -- 172.21.15.177:0/4079034255 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c009a70 con 0x7fe784140fc0 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe78a1b2700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe784147370 0x7fe78415ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe7899b1700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784140fc0 0x7fe78413b9e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c520 tx=0x7fe78000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe77a7fc700 1 -- 172.21.15.177:0/4079034255 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780005cb0 con 0x7fe784140fc0 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe77a7fc700 1 -- 172.21.15.177:0/4079034255 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780005e10 con 0x7fe784140fc0 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe774009550 con 0x7fe784140fc0 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe77a7fc700 1 -- 172.21.15.177:0/4079034255 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800072d0 con 0x7fe784140fc0 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.751+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7840cdc50 con 0x7fe784140fc0 2023-11-27T17:48:45.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.752+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe784073aa0 con 0x7fe784140fc0 2023-11-27T17:48:45.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.753+0000 7fe77a7fc700 1 -- 172.21.15.177:0/4079034255 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe780007430 con 0x7fe784140fc0 2023-11-27T17:48:45.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.753+0000 7fe77a7fc700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe76806b280 0x7fe76806d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:45.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.753+0000 7fe77a7fc700 1 -- 172.21.15.177:0/4079034255 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe780088da0 con 0x7fe784140fc0 2023-11-27T17:48:45.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.753+0000 7fe7891b0700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe76806b280 0x7fe76806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:45.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.753+0000 7fe7891b0700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe76806b280 0x7fe76806d740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe774009c40 tx=0x7fe774008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:45.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.757+0000 7fe77a7fc700 1 -- 172.21.15.177:0/4079034255 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe780053af0 con 0x7fe784140fc0 2023-11-27T17:48:45.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.946+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7840cd7b0 con 0x7fe784140fc0 2023-11-27T17:48:45.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.947+0000 7fe77a7fc700 1 -- 172.21.15.177:0/4079034255 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fe780017070 con 0x7fe784140fc0 2023-11-27T17:48:45.950 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:45.950 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:45.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.949+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe76806b280 msgr2=0x7fe76806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.949+0000 7fe78bc15700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe76806b280 0x7fe76806d740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe774009c40 tx=0x7fe774008030 comp rx=0 tx=0).stop 2023-11-27T17:48:45.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.949+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784140fc0 msgr2=0x7fe78413b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:45.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.949+0000 7fe78bc15700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784140fc0 0x7fe78413b9e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c520 tx=0x7fe78000c830 comp rx=0 tx=0).stop 2023-11-27T17:48:45.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.950+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 shutdown_connections 2023-11-27T17:48:45.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.950+0000 7fe78bc15700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe76806b280 0x7fe76806d740 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.950+0000 7fe78bc15700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe784147370 0x7fe78415ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.950+0000 7fe78bc15700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784140fc0 0x7fe78413b9e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.950+0000 7fe78bc15700 1 --2- 172.21.15.177:0/4079034255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7841413a0 0x7fe78415e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:45.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.950+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 >> 172.21.15.177:0/4079034255 conn(0x7fe7840d0e70 msgr2=0x7fe7840b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:45.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.950+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 shutdown_connections 2023-11-27T17:48:45.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:45.950+0000 7fe78bc15700 1 -- 172.21.15.177:0/4079034255 wait complete. 2023-11-27T17:48:45.964 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:45.965 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:46.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.087+0000 7f975ea19700 1 Processor -- start 2023-11-27T17:48:46.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.087+0000 7f975ea19700 1 -- start start 2023-11-27T17:48:46.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975ea19700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9758146f00 0x7f9758162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975ea19700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f97580cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975ea19700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97580cde20 0x7f97580ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975ea19700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97581472e0 con 0x7f97580cde20 2023-11-27T17:48:46.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975ea19700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97580ce2a0 con 0x7f9758146f00 2023-11-27T17:48:46.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975ea19700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9758162bc0 con 0x7f97580afc30 2023-11-27T17:48:46.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97580cde20 0x7f97580ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97580cde20 0x7f97580ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52450/0 (socket says 172.21.15.177:52450) 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 -- 172.21.15.177:0/3552236072 learned_addr learned my addr 172.21.15.177:0/3552236072 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f9757fff700 1 --2- 172.21.15.177:0/3552236072 >> v2:172.21.15.178:3300/0 conn(0x7f9758146f00 0x7f9758162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f97577fe700 1 --2- 172.21.15.177:0/3552236072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f97580cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 -- 172.21.15.177:0/3552236072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 msgr2=0x7f97580cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 --2- 172.21.15.177:0/3552236072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f97580cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 -- 172.21.15.177:0/3552236072 >> v2:172.21.15.178:3300/0 conn(0x7f9758146f00 msgr2=0x7f9758162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 --2- 172.21.15.177:0/3552236072 >> v2:172.21.15.178:3300/0 conn(0x7f9758146f00 0x7f9758162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 -- 172.21.15.177:0/3552236072 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97580b0110 con 0x7f97580cde20 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f975cfb6700 1 --2- 172.21.15.177:0/3552236072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97580cde20 0x7f97580ad860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f97580afa20 tx=0x7f975000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810a9cdabb577691 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.088+0000 7f9756ffd700 1 -- 172.21.15.177:0/3552236072 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000e070 con 0x7f97580cde20 2023-11-27T17:48:46.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f9756ffd700 1 -- 172.21.15.177:0/3552236072 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000b9c0 con 0x7f97580cde20 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f9756ffd700 1 -- 172.21.15.177:0/3552236072 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000bd70 con 0x7f97580cde20 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 -- 172.21.15.177:0/3552236072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97580cde20 msgr2=0x7f97580ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 --2- 172.21.15.177:0/3552236072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97580cde20 0x7f97580ad860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f97580afa20 tx=0x7f975000b330 comp rx=0 tx=0).stop 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 -- 172.21.15.177:0/3552236072 shutdown_connections 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 --2- 172.21.15.177:0/3552236072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97580cde20 0x7f97580ad860 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 --2- 172.21.15.177:0/3552236072 >> v2:172.21.15.178:3300/0 conn(0x7f9758146f00 0x7f9758162680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 --2- 172.21.15.177:0/3552236072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f97580cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 -- 172.21.15.177:0/3552236072 >> 172.21.15.177:0/3552236072 conn(0x7f97580b38b0 msgr2=0x7f97580b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 -- 172.21.15.177:0/3552236072 shutdown_connections 2023-11-27T17:48:46.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.089+0000 7f975ea19700 1 -- 172.21.15.177:0/3552236072 wait complete. 2023-11-27T17:48:46.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.091+0000 7f975ea19700 1 Processor -- start 2023-11-27T17:48:46.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.091+0000 7f975ea19700 1 -- start start 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975ea19700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f9758072c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975ea19700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97580cde20 0x7f97580704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975ea19700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9758146f00 0x7f9758070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975ea19700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97581f4a60 con 0x7f9758146f00 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975ea19700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97581f4780 con 0x7f97580cde20 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975ea19700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9758144200 con 0x7f97580afc30 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9758146f00 0x7f9758070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9758146f00 0x7f9758070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52456/0 (socket says 172.21.15.177:52456) 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 -- 172.21.15.177:0/2448831510 learned_addr learned my addr 172.21.15.177:0/2448831510 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:46.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f97577fe700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97580cde20 0x7f97580704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f9757fff700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f9758072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 -- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 msgr2=0x7f9758072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f9758072c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 -- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97580cde20 msgr2=0x7f97580704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97580cde20 0x7f97580704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 -- 172.21.15.177:0/2448831510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750009b30 con 0x7f9758146f00 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f97577fe700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97580cde20 0x7f97580704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f9757fff700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f9758072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975cfb6700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9758146f00 0x7f9758070a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9750012000 tx=0x7f9750004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f9754ff9700 1 -- 172.21.15.177:0/2448831510 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750004250 con 0x7f9758146f00 2023-11-27T17:48:46.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f9754ff9700 1 -- 172.21.15.177:0/2448831510 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97500043d0 con 0x7f9758146f00 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97581444e0 con 0x7f9758146f00 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f9754ff9700 1 -- 172.21.15.177:0/2448831510 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750004780 con 0x7f9758146f00 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.092+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9758073140 con 0x7f9758146f00 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.093+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9758144b30 con 0x7f9758146f00 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.094+0000 7f9754ff9700 1 -- 172.21.15.177:0/2448831510 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f975001b430 con 0x7f9758146f00 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.094+0000 7f9754ff9700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f974406b250 0x7f974406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.094+0000 7f9757fff700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f974406b250 0x7f974406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.094+0000 7f9754ff9700 1 -- 172.21.15.177:0/2448831510 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f975008abb0 con 0x7f9758146f00 2023-11-27T17:48:46.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.095+0000 7f9757fff700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f974406b250 0x7f974406d710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f974c009a00 tx=0x7f974c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.099+0000 7f9754ff9700 1 -- 172.21.15.177:0/2448831510 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9750055970 con 0x7f9758146f00 2023-11-27T17:48:46.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.286+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97580732d0 con 0x7f9758146f00 2023-11-27T17:48:46.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.287+0000 7f9754ff9700 1 -- 172.21.15.177:0/2448831510 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f975001f020 con 0x7f9758146f00 2023-11-27T17:48:46.289 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:46.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f974406b250 msgr2=0x7f974406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f974406b250 0x7f974406d710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f974c009a00 tx=0x7f974c008040 comp rx=0 tx=0).stop 2023-11-27T17:48:46.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9758146f00 msgr2=0x7f9758070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9758146f00 0x7f9758070a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9750012000 tx=0x7f9750004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 shutdown_connections 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f974406b250 0x7f974406d710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9758146f00 0x7f9758070a30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97580afc30 0x7f9758072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 --2- 172.21.15.177:0/2448831510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97580cde20 0x7f97580704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 >> 172.21.15.177:0/2448831510 conn(0x7f97580b38b0 msgr2=0x7f97580ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 shutdown_connections 2023-11-27T17:48:46.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.289+0000 7f975ea19700 1 -- 172.21.15.177:0/2448831510 wait complete. 2023-11-27T17:48:46.303 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:46.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.423+0000 7f1b46cd1700 1 Processor -- start 2023-11-27T17:48:46.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.423+0000 7f1b46cd1700 1 -- start start 2023-11-27T17:48:46.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b46cd1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b4013d250 0x7f1b400cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b46cd1700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4015b8a0 con 0x7f1b4015b240 2023-11-27T17:48:46.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b46cd1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b400cf110 con 0x7f1b400cd390 2023-11-27T17:48:46.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b46cd1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4015b6a0 con 0x7f1b4013d250 2023-11-27T17:48:46.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b4526e700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1b4015b240 0x7f1b400714c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46782/0 (socket says 172.21.15.177:46782) 2023-11-27T17:48:46.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b4526e700 1 -- 172.21.15.177:0/498651647 learned_addr learned my addr 172.21.15.177:0/498651647 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:46.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059040219 0 0) 0x7f1b4015b8a0 con 0x7f1b4015b240 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b44a6d700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b4013d250 0x7f1b400cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.424+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b300035b0 con 0x7f1b4015b240 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1388475337 0 0) 0x7f1b300035b0 con 0x7f1b4015b240 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b4013d250 msgr2=0x7f1b400cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b4013d250 0x7f1b400cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 >> v1:172.21.15.178:6789/0 conn(0x7f1b400cd390 legacy=0x7f1b4015ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400cf3f0 con 0x7f1b4015b240 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f1b380019f0 con 0x7f1b4015b240 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 >> v1:172.21.15.177:6789/0 conn(0x7f1b4015b240 legacy=0x7f1b400714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30003a30 0x7f1b30003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b30004850 0x7f1b30004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b4013d250 0x7f1b30005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4015b6a0 con 0x7f1b30004850 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3000bac0 con 0x7f1b30003a30 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3000bc80 con 0x7f1b4013d250 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3ffff700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b30004850 0x7f1b30004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b44a6d700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30003a30 0x7f1b30003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b4526e700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b4013d250 0x7f1b30005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3ffff700 1 -- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b4013d250 msgr2=0x7f1b30005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3ffff700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b4013d250 0x7f1b30005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3ffff700 1 -- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30003a30 msgr2=0x7f1b30003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3ffff700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30003a30 0x7f1b30003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3ffff700 1 -- 172.21.15.177:0/498651647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300035b0 con 0x7f1b30004850 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3ffff700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b30004850 0x7f1b30004cd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c007fd0 tx=0x7f1b30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d521a581d6d317 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0052d0 con 0x7f1b30004850 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c005470 con 0x7f1b30004850 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.425+0000 7f1b3f7fe700 1 -- 172.21.15.177:0/498651647 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0038c0 con 0x7f1b30004850 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.426+0000 7f1b46cd1700 1 -- 172.21.15.177:0/498651647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b30004850 msgr2=0x7f1b30004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.426+0000 7f1b46cd1700 1 --2- 172.21.15.177:0/498651647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b30004850 0x7f1b30004cd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c007fd0 tx=0x7f1b30005880 comp rx=0 tx=0).stop 2023-11-27T17:48:46.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.426+0000 7f1b4526e700 1 -- 172.21.15.177:0/498651647 reap_dead start 2023-11-27T17:48:46.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.426+0000 7f1b46cd1700 1 -- 172.21.15.177:0/498651647 shutdown_connections 2023-11-27T17:48:46.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.426+0000 7f1b46cd1700 1 -- 172.21.15.177:0/498651647 >> 172.21.15.177:0/498651647 conn(0x7f1b400b1d50 msgr2=0x7f1b400b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:46.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.426+0000 7f1b46cd1700 1 -- 172.21.15.177:0/498651647 shutdown_connections 2023-11-27T17:48:46.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.426+0000 7f1b46cd1700 1 -- 172.21.15.177:0/498651647 wait complete. 2023-11-27T17:48:46.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.427+0000 7f1b46cd1700 1 Processor -- start 2023-11-27T17:48:46.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.427+0000 7f1b46cd1700 1 -- start start 2023-11-27T17:48:46.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b46cd1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30004850 0x7f1b401371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b46cd1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b401426a0 0x7f1b40142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b46cd1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b40168320 0x7f1b401687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b46cd1700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40168ce0 con 0x7f1b40168320 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b46cd1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4013e410 con 0x7f1b30004850 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b46cd1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4013e8a0 con 0x7f1b401426a0 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b4526e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b40168320 0x7f1b401687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b4526e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b40168320 0x7f1b401687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52476/0 (socket says 172.21.15.177:52476) 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b4526e700 1 -- 172.21.15.177:0/3519540277 learned_addr learned my addr 172.21.15.177:0/3519540277 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b44a6d700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30004850 0x7f1b401371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b3ffff700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b401426a0 0x7f1b40142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b4526e700 1 -- 172.21.15.177:0/3519540277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b401426a0 msgr2=0x7f1b40142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b4526e700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b401426a0 0x7f1b40142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b4526e700 1 -- 172.21.15.177:0/3519540277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30004850 msgr2=0x7f1b401371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b4526e700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30004850 0x7f1b401371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.428+0000 7f1b4526e700 1 -- 172.21.15.177:0/3519540277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4013dae0 con 0x7f1b40168320 2023-11-27T17:48:46.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.429+0000 7f1b4526e700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b40168320 0x7f1b401687a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b40155000 tx=0x7f1b3800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.429+0000 7f1b3d7fa700 1 -- 172.21.15.177:0/3519540277 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800ad10 con 0x7f1b40168320 2023-11-27T17:48:46.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.429+0000 7f1b3d7fa700 1 -- 172.21.15.177:0/3519540277 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3800ae70 con 0x7f1b40168320 2023-11-27T17:48:46.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.429+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4013ddc0 con 0x7f1b40168320 2023-11-27T17:48:46.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.429+0000 7f1b3d7fa700 1 -- 172.21.15.177:0/3519540277 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38013610 con 0x7f1b40168320 2023-11-27T17:48:46.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.429+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b40143160 con 0x7f1b40168320 2023-11-27T17:48:46.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.430+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b40069400 con 0x7f1b40168320 2023-11-27T17:48:46.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.430+0000 7f1b3d7fa700 1 -- 172.21.15.177:0/3519540277 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1b38013770 con 0x7f1b40168320 2023-11-27T17:48:46.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.431+0000 7f1b3d7fa700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1b2406b250 0x7f1b2406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.431+0000 7f1b44a6d700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1b2406b250 0x7f1b2406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.431+0000 7f1b3d7fa700 1 -- 172.21.15.177:0/3519540277 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b3808a510 con 0x7f1b40168320 2023-11-27T17:48:46.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.431+0000 7f1b44a6d700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1b2406b250 0x7f1b2406d710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009be0 tx=0x7f1b34009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.435+0000 7f1b3d7fa700 1 -- 172.21.15.177:0/3519540277 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1b380552d0 con 0x7f1b40168320 2023-11-27T17:48:46.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.622+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b400ce270 con 0x7f1b40168320 2023-11-27T17:48:46.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.622+0000 7f1b3d7fa700 1 -- 172.21.15.177:0/3519540277 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b38088e60 con 0x7f1b40168320 2023-11-27T17:48:46.625 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1b2406b250 msgr2=0x7f1b2406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1b2406b250 0x7f1b2406d710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009be0 tx=0x7f1b34009210 comp rx=0 tx=0).stop 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b40168320 msgr2=0x7f1b401687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b40168320 0x7f1b401687a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b40155000 tx=0x7f1b3800a6a0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 shutdown_connections 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1b2406b250 0x7f1b2406d710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b40168320 0x7f1b401687a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b30004850 0x7f1b401371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 --2- 172.21.15.177:0/3519540277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b401426a0 0x7f1b40142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 >> 172.21.15.177:0/3519540277 conn(0x7f1b400b1d50 msgr2=0x7f1b40072610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:46.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 shutdown_connections 2023-11-27T17:48:46.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.624+0000 7f1b46cd1700 1 -- 172.21.15.177:0/3519540277 wait complete. 2023-11-27T17:48:46.639 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:46.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.760+0000 7fdc81e3c700 1 Processor -- start 2023-11-27T17:48:46.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.760+0000 7fdc81e3c700 1 -- start start 2023-11-27T17:48:46.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc81e3c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdc7c0afa50 0x7fdc7c0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc81e3c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c15b3d0 0x7fdc7c15e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc81e3c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c15b870 con 0x7fdc7c0cd850 2023-11-27T17:48:46.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc81e3c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7c0afe30 con 0x7fdc7c0afa50 2023-11-27T17:48:46.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc81e3c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c15bb50 con 0x7fdc7c15b3d0 2023-11-27T17:48:46.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc7affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c15b3d0 0x7fdc7c15e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc7b7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdc7c0afa50 0x7fdc7c0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc7affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c15b3d0 0x7fdc7c15e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:39948/0 (socket says 172.21.15.177:39948) 2023-11-27T17:48:46.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc7b7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdc7c0afa50 0x7fdc7c0b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:60502/0 (socket says 172.21.15.177:60502) 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc7affd700 1 -- 172.21.15.177:0/507368243 learned_addr learned my addr 172.21.15.177:0/507368243 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.761+0000 7fdc7bfff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fdc7c0cd850 0x7fdc7c0cf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45780/0 (socket says 172.21.15.177:45780) 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7affd700 1 -- 172.21.15.177:0/507368243 >> v2:172.21.15.178:3300/0 conn(0x7fdc7c0afa50 msgr2=0x7fdc7c0b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7affd700 1 --2- 172.21.15.177:0/507368243 >> v2:172.21.15.178:3300/0 conn(0x7fdc7c0afa50 0x7fdc7c0b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7affd700 1 -- 172.21.15.177:0/507368243 >> v1:172.21.15.178:6789/0 conn(0x7fdc7c0cd850 legacy=0x7fdc7c0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7affd700 1 -- 172.21.15.177:0/507368243 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c15be30 con 0x7fdc7c15b3d0 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7b7fe700 1 --2- 172.21.15.177:0/507368243 >> v2:172.21.15.178:3300/0 conn(0x7fdc7c0afa50 0x7fdc7c0b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7affd700 1 --2- 172.21.15.177:0/507368243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c15b3d0 0x7fdc7c15e9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc700098f0 tx=0x7fdc70009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c31ea88f173ae3d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7a7fc700 1 -- 172.21.15.177:0/507368243 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011830 con 0x7fdc7c15b3d0 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7a7fc700 1 -- 172.21.15.177:0/507368243 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70011990 con 0x7fdc7c15b3d0 2023-11-27T17:48:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.762+0000 7fdc7a7fc700 1 -- 172.21.15.177:0/507368243 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011d20 con 0x7fdc7c15b3d0 2023-11-27T17:48:46.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.763+0000 7fdc81e3c700 1 -- 172.21.15.177:0/507368243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c15b3d0 msgr2=0x7fdc7c15e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.763+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/507368243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c15b3d0 0x7fdc7c15e9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc700098f0 tx=0x7fdc70009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:46.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.763+0000 7fdc81e3c700 1 -- 172.21.15.177:0/507368243 shutdown_connections 2023-11-27T17:48:46.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.763+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/507368243 >> v2:172.21.15.178:3300/0 conn(0x7fdc7c0afa50 0x7fdc7c0b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.763+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/507368243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c15b3d0 0x7fdc7c15e9d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.763+0000 7fdc81e3c700 1 -- 172.21.15.177:0/507368243 >> 172.21.15.177:0/507368243 conn(0x7fdc7c0b38b0 msgr2=0x7fdc7c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:46.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.763+0000 7fdc81e3c700 1 -- 172.21.15.177:0/507368243 shutdown_connections 2023-11-27T17:48:46.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.763+0000 7fdc81e3c700 1 -- 172.21.15.177:0/507368243 wait complete. 2023-11-27T17:48:46.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.764+0000 7fdc81e3c700 1 Processor -- start 2023-11-27T17:48:46.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.764+0000 7fdc81e3c700 1 -- start start 2023-11-27T17:48:46.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc81e3c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c0afa50 0x7fdc7c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc81e3c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc7c0cd850 0x7fdc7c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc81e3c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7c15b3d0 0x7fdc7c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc81e3c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c1562c0 con 0x7fdc7c0cd850 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc81e3c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c156750 con 0x7fdc7c15b3d0 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc81e3c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c1556b0 con 0x7fdc7c0afa50 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc7affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc7c0cd850 0x7fdc7c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc7affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc7c0cd850 0x7fdc7c154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52486/0 (socket says 172.21.15.177:52486) 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.765+0000 7fdc7affd700 1 -- 172.21.15.177:0/311532032 learned_addr learned my addr 172.21.15.177:0/311532032 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7bfff700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7c15b3d0 0x7fdc7c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7b7fe700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c0afa50 0x7fdc7c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7affd700 1 -- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c0afa50 msgr2=0x7fdc7c156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7affd700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c0afa50 0x7fdc7c156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7affd700 1 -- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7c15b3d0 msgr2=0x7fdc7c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7affd700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7c15b3d0 0x7fdc7c06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7affd700 1 -- 172.21.15.177:0/311532032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0094a0 con 0x7fdc7c0cd850 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7bfff700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7c15b3d0 0x7fdc7c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7b7fe700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c0afa50 0x7fdc7c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc7affd700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc7c0cd850 0x7fdc7c154db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009c40 tx=0x7fdc70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc63fff700 1 -- 172.21.15.177:0/311532032 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc700043c0 con 0x7fdc7c0cd850 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc63fff700 1 -- 172.21.15.177:0/311532032 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70004540 con 0x7fdc7c0cd850 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc70009550 con 0x7fdc7c0cd850 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc63fff700 1 -- 172.21.15.177:0/311532032 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc700038e0 con 0x7fdc7c0cd850 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.766+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c155c70 con 0x7fdc7c0cd850 2023-11-27T17:48:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.767+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c073890 con 0x7fdc7c0cd850 2023-11-27T17:48:46.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.768+0000 7fdc63fff700 1 -- 172.21.15.177:0/311532032 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdc70023070 con 0x7fdc7c0cd850 2023-11-27T17:48:46.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.768+0000 7fdc63fff700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdc6806b250 0x7fdc6806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:46.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.768+0000 7fdc63fff700 1 -- 172.21.15.177:0/311532032 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc7008c7c0 con 0x7fdc7c0cd850 2023-11-27T17:48:46.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.768+0000 7fdc7b7fe700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdc6806b250 0x7fdc6806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:46.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.768+0000 7fdc7b7fe700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdc6806b250 0x7fdc6806d710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009dc0 tx=0x7fdc6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:46.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.772+0000 7fdc63fff700 1 -- 172.21.15.177:0/311532032 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdc70057580 con 0x7fdc7c0cd850 2023-11-27T17:48:46.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.962+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc7c069400 con 0x7fdc7c0cd850 2023-11-27T17:48:46.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.963+0000 7fdc63fff700 1 -- 172.21.15.177:0/311532032 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc70015020 con 0x7fdc7c0cd850 2023-11-27T17:48:46.965 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdc6806b250 msgr2=0x7fdc6806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdc6806b250 0x7fdc6806d710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009dc0 tx=0x7fdc6c008040 comp rx=0 tx=0).stop 2023-11-27T17:48:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc7c0cd850 msgr2=0x7fdc7c154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc7c0cd850 0x7fdc7c154db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009c40 tx=0x7fdc70004750 comp rx=0 tx=0).stop 2023-11-27T17:48:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 shutdown_connections 2023-11-27T17:48:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdc6806b250 0x7fdc6806d710 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7c15b3d0 0x7fdc7c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc7c0afa50 0x7fdc7c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 --2- 172.21.15.177:0/311532032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc7c0cd850 0x7fdc7c154db0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 >> 172.21.15.177:0/311532032 conn(0x7fdc7c0b38b0 msgr2=0x7fdc7c153770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 shutdown_connections 2023-11-27T17:48:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:46.965+0000 7fdc81e3c700 1 -- 172.21.15.177:0/311532032 wait complete. 2023-11-27T17:48:46.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-27T17:48:47.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.098+0000 7fe04a263700 1 Processor -- start 2023-11-27T17:48:47.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.098+0000 7fe04a263700 1 -- start start 2023-11-27T17:48:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.099+0000 7fe04a263700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe044147880 0x7fe04406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.099+0000 7fe04a263700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0440b5ce0 con 0x7fe0440b6170 2023-11-27T17:48:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.099+0000 7fe04a263700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0440b5700 con 0x7fe044070c00 2023-11-27T17:48:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.099+0000 7fe04a263700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04406e230 con 0x7fe044147880 2023-11-27T17:48:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.099+0000 7fe0437fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe0440b6170 0x7fe0440704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46812/0 (socket says 172.21.15.177:46812) 2023-11-27T17:48:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.099+0000 7fe0437fe700 1 -- 172.21.15.177:0/603370488 learned_addr learned my addr 172.21.15.177:0/603370488 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe043fff700 1 --2- 172.21.15.177:0/603370488 >> v2:172.21.15.178:3300/0 conn(0x7fe044147880 0x7fe04406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702615895 0 0) 0x7fe0440b5ce0 con 0x7fe0440b6170 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe02c0035b0 con 0x7fe0440b6170 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124125539 0 0) 0x7fe02c0035b0 con 0x7fe0440b6170 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 >> v2:172.21.15.178:3300/0 conn(0x7fe044147880 msgr2=0x7fe04406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 --2- 172.21.15.177:0/603370488 >> v2:172.21.15.178:3300/0 conn(0x7fe044147880 0x7fe04406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 >> v1:172.21.15.178:6789/0 conn(0x7fe044070c00 legacy=0x7fe04415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440b5970 con 0x7fe0440b6170 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fe034001670 con 0x7fe0440b6170 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 >> v1:172.21.15.177:6789/0 conn(0x7fe0440b6170 legacy=0x7fe0440704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe02c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c004850 0x7fe02c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c005210 0x7fe02c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04406e230 con 0x7fe02c003a00 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c00c0b0 con 0x7fe02c005210 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c00c270 con 0x7fe02c004850 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe043fff700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe02c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe048800700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c005210 0x7fe02c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe0437fe700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c004850 0x7fe02c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe043fff700 1 -- 172.21.15.177:0/603370488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c004850 msgr2=0x7fe02c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe043fff700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c004850 0x7fe02c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe043fff700 1 -- 172.21.15.177:0/603370488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c005210 msgr2=0x7fe02c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe043fff700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c005210 0x7fe02c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe043fff700 1 -- 172.21.15.177:0/603370488 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c0035b0 con 0x7fe02c003a00 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.100+0000 7fe048800700 1 -- 172.21.15.177:0/603370488 reap_dead start 2023-11-27T17:48:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe043fff700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe02c003e20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe038009b60 tx=0x7fe02c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50310ff6495b199c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800e6c0 con 0x7fe02c003a00 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03800e820 con 0x7fe02c003a00 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe042ffd700 1 -- 172.21.15.177:0/603370488 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800eb90 con 0x7fe02c003a00 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe04a263700 1 -- 172.21.15.177:0/603370488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 msgr2=0x7fe02c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe04a263700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe02c003e20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe038009b60 tx=0x7fe02c005880 comp rx=0 tx=0).stop 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe04a263700 1 -- 172.21.15.177:0/603370488 shutdown_connections 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe04a263700 1 --2- 172.21.15.177:0/603370488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe02c003e20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe04a263700 1 -- 172.21.15.177:0/603370488 >> 172.21.15.177:0/603370488 conn(0x7fe0440b2130 msgr2=0x7fe0440b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe04a263700 1 -- 172.21.15.177:0/603370488 shutdown_connections 2023-11-27T17:48:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.101+0000 7fe04a263700 1 -- 172.21.15.177:0/603370488 wait complete. 2023-11-27T17:48:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.103+0000 7fe04a263700 1 Processor -- start 2023-11-27T17:48:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.103+0000 7fe04a263700 1 -- start start 2023-11-27T17:48:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.103+0000 7fe04a263700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe0440c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.103+0000 7fe04a263700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0440c8e50 0x7fe044133930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.103+0000 7fe04a263700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe044133e70 0x7fe044134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.103+0000 7fe04a263700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440c92d0 con 0x7fe02c003a00 2023-11-27T17:48:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.103+0000 7fe04a263700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440b01b0 con 0x7fe0440c8e50 2023-11-27T17:48:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.103+0000 7fe04a263700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe044131940 con 0x7fe044133e70 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe0440c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe0440c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52506/0 (socket says 172.21.15.177:52506) 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 -- 172.21.15.177:0/499524259 learned_addr learned my addr 172.21.15.177:0/499524259 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe0437fe700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0440c8e50 0x7fe044133930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe048800700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe044133e70 0x7fe044134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 -- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe044133e70 msgr2=0x7fe044134320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe044133e70 0x7fe044134320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 -- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0440c8e50 msgr2=0x7fe044133930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0440c8e50 0x7fe044133930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 -- 172.21.15.177:0/499524259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044131c20 con 0x7fe02c003a00 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe0437fe700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0440c8e50 0x7fe044133930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe043fff700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe0440c8910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c080 tx=0x7fe0380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe040ff9700 1 -- 172.21.15.177:0/499524259 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800e6c0 con 0x7fe02c003a00 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe040ff9700 1 -- 172.21.15.177:0/499524259 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038003ad0 con 0x7fe02c003a00 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe044131f00 con 0x7fe02c003a00 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe040ff9700 1 -- 172.21.15.177:0/499524259 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038003e80 con 0x7fe02c003a00 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.104+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0440c5f20 con 0x7fe02c003a00 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.105+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe044073aa0 con 0x7fe02c003a00 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.106+0000 7fe040ff9700 1 -- 172.21.15.177:0/499524259 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe038013470 con 0x7fe02c003a00 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.106+0000 7fe040ff9700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe03006b250 0x7fe03006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.106+0000 7fe0437fe700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe03006b250 0x7fe03006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.106+0000 7fe040ff9700 1 -- 172.21.15.177:0/499524259 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe03808b080 con 0x7fe02c003a00 2023-11-27T17:48:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.107+0000 7fe0437fe700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe03006b250 0x7fe03006d710 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe0440d0720 tx=0x7fe034009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:47.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.111+0000 7fe040ff9700 1 -- 172.21.15.177:0/499524259 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe038055f60 con 0x7fe02c003a00 2023-11-27T17:48:47.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.381+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fe044132550 con 0x7fe02c003a00 2023-11-27T17:48:47.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.795+0000 7fe040ff9700 1 -- 172.21.15.177:0/499524259 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v48) v1 ==== 147+0+0 (secure 0 0 0) 0x7fe038059580 con 0x7fe02c003a00 2023-11-27T17:48:47.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe03006b250 msgr2=0x7fe03006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe03006b250 0x7fe03006d710 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe0440d0720 tx=0x7fe034009040 comp rx=0 tx=0).stop 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 msgr2=0x7fe0440c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe0440c8910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c080 tx=0x7fe0380047c0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 shutdown_connections 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe03006b250 0x7fe03006d710 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe044133e70 0x7fe044134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe02c003a00 0x7fe0440c8910 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 --2- 172.21.15.177:0/499524259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0440c8e50 0x7fe044133930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 >> 172.21.15.177:0/499524259 conn(0x7fe0440b2130 msgr2=0x7fe04415fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:47.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 shutdown_connections 2023-11-27T17:48:47.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.798+0000 7fe04a263700 1 -- 172.21.15.177:0/499524259 wait complete. 2023-11-27T17:48:47.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-27T17:48:47.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.936+0000 7f8ff4d60700 1 Processor -- start 2023-11-27T17:48:47.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.937+0000 7f8ff4d60700 1 -- start start 2023-11-27T17:48:47.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.937+0000 7f8ff4d60700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8ff01585b0 0x7f8ff015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8ff4d60700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8ff0161bc0 0x7f8ff0161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8ff4d60700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff0162530 con 0x7f8ff015fcd0 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8ff4d60700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff00b7af0 con 0x7f8ff01585b0 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8ff4d60700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff0162a20 con 0x7f8ff0161bc0 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fee59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8ff01585b0 0x7f8ff015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fedd9b700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f8ff015fcd0 0x7f8ff006c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46832/0 (socket says 172.21.15.177:46832) 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fedd9b700 1 -- 172.21.15.177:0/2323251583 learned_addr learned my addr 172.21.15.177:0/2323251583 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fee59c700 1 --2- 172.21.15.177:0/2323251583 >> v2:172.21.15.177:3300/0 conn(0x7f8ff01585b0 0x7f8ff015f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52514/0 (socket says 172.21.15.177:52514) 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8feed9d700 1 --2- 172.21.15.177:0/2323251583 >> v2:172.21.15.178:3300/0 conn(0x7f8ff0161bc0 0x7f8ff0161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fee59c700 1 -- 172.21.15.177:0/2323251583 >> v2:172.21.15.178:3300/0 conn(0x7f8ff0161bc0 msgr2=0x7f8ff0161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fee59c700 1 --2- 172.21.15.177:0/2323251583 >> v2:172.21.15.178:3300/0 conn(0x7f8ff0161bc0 0x7f8ff0161ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fee59c700 1 -- 172.21.15.177:0/2323251583 >> v1:172.21.15.177:6789/0 conn(0x7f8ff015fcd0 legacy=0x7f8ff006c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fee59c700 1 -- 172.21.15.177:0/2323251583 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00b5370 con 0x7f8ff01585b0 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fee59c700 1 --2- 172.21.15.177:0/2323251583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff01585b0 0x7f8ff015f790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8ff015f600 tx=0x7f8fe4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb95ab20501052 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fed59a700 1 -- 172.21.15.177:0/2323251583 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011830 con 0x7f8ff01585b0 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fed59a700 1 -- 172.21.15.177:0/2323251583 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe4011990 con 0x7f8ff01585b0 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.938+0000 7f8fed59a700 1 -- 172.21.15.177:0/2323251583 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011d20 con 0x7f8ff01585b0 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.939+0000 7f8ff4d60700 1 -- 172.21.15.177:0/2323251583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff01585b0 msgr2=0x7f8ff015f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.939+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/2323251583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff01585b0 0x7f8ff015f790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8ff015f600 tx=0x7f8fe4009b20 comp rx=0 tx=0).stop 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.939+0000 7f8ff4d60700 1 -- 172.21.15.177:0/2323251583 shutdown_connections 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.939+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/2323251583 >> v2:172.21.15.178:3300/0 conn(0x7f8ff0161bc0 0x7f8ff0161ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.939+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/2323251583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff01585b0 0x7f8ff015f790 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.939+0000 7f8ff4d60700 1 -- 172.21.15.177:0/2323251583 >> 172.21.15.177:0/2323251583 conn(0x7f8ff00b31d0 msgr2=0x7f8ff00b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:47.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.939+0000 7f8ff4d60700 1 -- 172.21.15.177:0/2323251583 shutdown_connections 2023-11-27T17:48:47.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.939+0000 7f8ff4d60700 1 -- 172.21.15.177:0/2323251583 wait complete. 2023-11-27T17:48:47.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.940+0000 7f8ff4d60700 1 Processor -- start 2023-11-27T17:48:47.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.940+0000 7f8ff4d60700 1 -- start start 2023-11-27T17:48:47.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8ff4d60700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff01585b0 0x7f8ff00ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8ff4d60700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0161bc0 0x7f8ff014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8ff4d60700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff0157090 0x7f8ff00d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8ff4d60700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00cf370 con 0x7f8ff0157090 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8ff4d60700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00cf650 con 0x7f8ff01585b0 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8ff4d60700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00cf930 con 0x7f8ff0161bc0 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8feed9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff0157090 0x7f8ff00d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8feed9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff0157090 0x7f8ff00d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52524/0 (socket says 172.21.15.177:52524) 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8feed9d700 1 -- 172.21.15.177:0/3390353012 learned_addr learned my addr 172.21.15.177:0/3390353012 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8fee59c700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff01585b0 0x7f8ff00ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8fedd9b700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0161bc0 0x7f8ff014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8feed9d700 1 -- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0161bc0 msgr2=0x7f8ff014ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8feed9d700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0161bc0 0x7f8ff014ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8feed9d700 1 -- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff01585b0 msgr2=0x7f8ff00ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:47.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8feed9d700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff01585b0 0x7f8ff00ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8feed9d700 1 -- 172.21.15.177:0/3390353012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe40094a0 con 0x7f8ff0157090 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.941+0000 7f8fee59c700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff01585b0 0x7f8ff00ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.942+0000 7f8feed9d700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff0157090 0x7f8ff00d0410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800cc30 tx=0x7f8fe800a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.942+0000 7f8fdeffd700 1 -- 172.21.15.177:0/3390353012 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe800ab70 con 0x7f8ff0157090 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.942+0000 7f8fdeffd700 1 -- 172.21.15.177:0/3390353012 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe800acd0 con 0x7f8ff0157090 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.942+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff00cfc10 con 0x7f8ff0157090 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.942+0000 7f8fdeffd700 1 -- 172.21.15.177:0/3390353012 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8003c40 con 0x7f8ff0157090 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.942+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff00cf080 con 0x7f8ff0157090 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.943+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff00cf790 con 0x7f8ff0157090 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.943+0000 7f8fdeffd700 1 -- 172.21.15.177:0/3390353012 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8fe800f3f0 con 0x7f8ff0157090 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.943+0000 7f8fdeffd700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8fd006b250 0x7f8fd006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:47.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.943+0000 7f8fdeffd700 1 -- 172.21.15.177:0/3390353012 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fe8089b80 con 0x7f8ff0157090 2023-11-27T17:48:47.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.943+0000 7f8fee59c700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8fd006b250 0x7f8fd006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:47.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.944+0000 7f8fee59c700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8fd006b250 0x7f8fd006d710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40090b0 tx=0x7f8fe4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:47.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:47.948+0000 7f8fdeffd700 1 -- 172.21.15.177:0/3390353012 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8ff00cf790 con 0x7f8ff0157090 2023-11-27T17:48:48.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.137+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8ff00cf790 con 0x7f8ff0157090 2023-11-27T17:48:48.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.142+0000 7f8fdeffd700 1 -- 172.21.15.177:0/3390353012 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ff00cf790 con 0x7f8ff0157090 2023-11-27T17:48:48.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8fd006b250 msgr2=0x7f8fd006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8fd006b250 0x7f8fd006d710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40090b0 tx=0x7f8fe4008030 comp rx=0 tx=0).stop 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff0157090 msgr2=0x7f8ff00d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff0157090 0x7f8ff00d0410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800cc30 tx=0x7f8fe800a1f0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 shutdown_connections 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8fd006b250 0x7f8fd006d710 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ff0157090 0x7f8ff00d0410 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff01585b0 0x7f8ff00ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 --2- 172.21.15.177:0/3390353012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0161bc0 0x7f8ff014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 >> 172.21.15.177:0/3390353012 conn(0x7f8ff00b31d0 msgr2=0x7f8ff01605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 shutdown_connections 2023-11-27T17:48:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.145+0000 7f8ff4d60700 1 -- 172.21.15.177:0/3390353012 wait complete. 2023-11-27T17:48:48.159 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T17:48:48.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T17:48:48.199 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T17:48:48.249 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T17:48:48.250 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:48:48.250 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:48.267 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:48:48.267 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:48.325 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:48:48.325 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:48.382 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:48.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.539+0000 7f7865713700 1 Processor -- start 2023-11-27T17:48:48.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.540+0000 7f7865713700 1 -- start start 2023-11-27T17:48:48.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.540+0000 7f7865713700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f786015a540 0x7f78600cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.540+0000 7f7865713700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78600b3e80 con 0x7f78600b2e90 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.540+0000 7f7865713700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786015a920 con 0x7f78600aec90 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.540+0000 7f7865713700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78600b4100 con 0x7f786015a540 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785effd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f786015a540 0x7f78600cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785f7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f78600b2e90 0x7f78600ced10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46850/0 (socket says 172.21.15.177:46850) 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785f7fe700 1 -- 172.21.15.177:0/1669556780 learned_addr learned my addr 172.21.15.177:0/1669556780 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785effd700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f786015a540 0x7f78600cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52528/0 (socket says 172.21.15.177:52528) 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785effd700 1 -- 172.21.15.177:0/1669556780 >> v1:172.21.15.178:6789/0 conn(0x7f78600aec90 legacy=0x7f78600cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785effd700 1 -- 172.21.15.177:0/1669556780 >> v1:172.21.15.177:6789/0 conn(0x7f78600b2e90 legacy=0x7f78600ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785effd700 1 -- 172.21.15.177:0/1669556780 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600b43e0 con 0x7f786015a540 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785dffb700 1 -- 172.21.15.177:0/1669556780 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228597430 0 0) 0x7f78600b3e80 con 0x7f78600b2e90 2023-11-27T17:48:48.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785effd700 1 --2- 172.21.15.177:0/1669556780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786015a540 0x7f78600cb080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f785400a9e0 tx=0x7f785400acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f406bd73fd03d91 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:48.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785dffb700 1 -- 172.21.15.177:0/1669556780 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400cb30 con 0x7f786015a540 2023-11-27T17:48:48.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785dffb700 1 -- 172.21.15.177:0/1669556780 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785400cc90 con 0x7f786015a540 2023-11-27T17:48:48.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.541+0000 7f785dffb700 1 -- 172.21.15.177:0/1669556780 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854004030 con 0x7f786015a540 2023-11-27T17:48:48.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.542+0000 7f7865713700 1 -- 172.21.15.177:0/1669556780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786015a540 msgr2=0x7f78600cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.542+0000 7f7865713700 1 --2- 172.21.15.177:0/1669556780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786015a540 0x7f78600cb080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f785400a9e0 tx=0x7f785400acf0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.542+0000 7f7865713700 1 -- 172.21.15.177:0/1669556780 shutdown_connections 2023-11-27T17:48:48.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.542+0000 7f7865713700 1 --2- 172.21.15.177:0/1669556780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786015a540 0x7f78600cb080 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.542+0000 7f7865713700 1 -- 172.21.15.177:0/1669556780 >> 172.21.15.177:0/1669556780 conn(0x7f78600b15d0 msgr2=0x7f78600b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.542+0000 7f7865713700 1 -- 172.21.15.177:0/1669556780 shutdown_connections 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.542+0000 7f7865713700 1 -- 172.21.15.177:0/1669556780 wait complete. 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.543+0000 7f7865713700 1 Processor -- start 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.543+0000 7f7865713700 1 -- start start 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f7865713700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78600aec90 0x7f786014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f7865713700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78600b2e90 0x7f78601552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f7865713700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f786015a540 0x7f7860155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f7865713700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860155d70 con 0x7f78600aec90 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f7865713700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860154250 con 0x7f78600b2e90 2023-11-27T17:48:48.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f7865713700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7860154530 con 0x7f786015a540 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78600aec90 0x7f786014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78600aec90 0x7f786014f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52534/0 (socket says 172.21.15.177:52534) 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 -- 172.21.15.177:0/876143790 learned_addr learned my addr 172.21.15.177:0/876143790 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785f7fe700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f786015a540 0x7f7860155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785e7fc700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78600b2e90 0x7f78601552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 -- 172.21.15.177:0/876143790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f786015a540 msgr2=0x7f7860155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f786015a540 0x7f7860155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 -- 172.21.15.177:0/876143790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78600b2e90 msgr2=0x7f78601552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78600b2e90 0x7f78601552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 -- 172.21.15.177:0/876143790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785400a640 con 0x7f78600aec90 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f785effd700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78600aec90 0x7f786014f440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f785400a1c0 tx=0x7f7854004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:48.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f78477fe700 1 -- 172.21.15.177:0/876143790 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785401d070 con 0x7f78600aec90 2023-11-27T17:48:48.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f78477fe700 1 -- 172.21.15.177:0/876143790 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7854003b30 con 0x7f78600aec90 2023-11-27T17:48:48.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7860154810 con 0x7f78600aec90 2023-11-27T17:48:48.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.544+0000 7f78477fe700 1 -- 172.21.15.177:0/876143790 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854022470 con 0x7f78600aec90 2023-11-27T17:48:48.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.545+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7860154dd0 con 0x7f78600aec90 2023-11-27T17:48:48.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.545+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7860069400 con 0x7f78600aec90 2023-11-27T17:48:48.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.547+0000 7f78477fe700 1 -- 172.21.15.177:0/876143790 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f78540183f0 con 0x7f78600aec90 2023-11-27T17:48:48.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.547+0000 7f78477fe700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f784c06b250 0x7f784c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.547+0000 7f78477fe700 1 -- 172.21.15.177:0/876143790 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f785408b310 con 0x7f78600aec90 2023-11-27T17:48:48.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.547+0000 7f785e7fc700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f784c06b250 0x7f784c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.548+0000 7f785e7fc700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f784c06b250 0x7f784c06d710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f78600af0f0 tx=0x7f7850009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:48.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.551+0000 7f78477fe700 1 -- 172.21.15.177:0/876143790 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f78540561d0 con 0x7f78600aec90 2023-11-27T17:48:48.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.746+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78600cf190 con 0x7f78600aec90 2023-11-27T17:48:48.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.747+0000 7f78477fe700 1 -- 172.21.15.177:0/876143790 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f78540597f0 con 0x7f78600aec90 2023-11-27T17:48:48.750 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:48.750 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:48.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.749+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f784c06b250 msgr2=0x7f784c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f784c06b250 0x7f784c06d710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f78600af0f0 tx=0x7f7850009040 comp rx=0 tx=0).stop 2023-11-27T17:48:48.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78600aec90 msgr2=0x7f786014f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78600aec90 0x7f786014f440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f785400a1c0 tx=0x7f7854004750 comp rx=0 tx=0).stop 2023-11-27T17:48:48.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 shutdown_connections 2023-11-27T17:48:48.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f784c06b250 0x7f784c06d710 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f786015a540 0x7f7860155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78600aec90 0x7f786014f440 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 --2- 172.21.15.177:0/876143790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78600b2e90 0x7f78601552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 >> 172.21.15.177:0/876143790 conn(0x7f78600b15d0 msgr2=0x7f78600cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:48.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 shutdown_connections 2023-11-27T17:48:48.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.750+0000 7f7865713700 1 -- 172.21.15.177:0/876143790 wait complete. 2023-11-27T17:48:48.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:48.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:48.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.888+0000 7fe4dbdc6700 1 Processor -- start 2023-11-27T17:48:48.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.888+0000 7fe4dbdc6700 1 -- start start 2023-11-27T17:48:48.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4dbdc6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4d40cdff0 0x7fe4d4162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4dbdc6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4dbdc6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d4162bc0 con 0x7fe4d4146f00 2023-11-27T17:48:48.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4dbdc6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d41472e0 con 0x7fe4d40cdff0 2023-11-27T17:48:48.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4dbdc6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40b0110 con 0x7fe4d40afc30 2023-11-27T17:48:48.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4da363700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4d9361700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4d40cdff0 0x7fe4d4162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4d9b62700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe4d4146f00 0x7fe4d40cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45838/0 (socket says 172.21.15.177:45838) 2023-11-27T17:48:48.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4d9361700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4d40cdff0 0x7fe4d4162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:60566/0 (socket says 172.21.15.177:60566) 2023-11-27T17:48:48.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4da363700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:40012/0 (socket says 172.21.15.177:40012) 2023-11-27T17:48:48.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4d9361700 1 -- 172.21.15.177:0/725189165 learned_addr learned my addr 172.21.15.177:0/725189165 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:48.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4d9361700 1 -- 172.21.15.177:0/725189165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 msgr2=0x7fe4d40cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:48.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4d9361700 1 --2- 172.21.15.177:0/725189165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4d9361700 1 -- 172.21.15.177:0/725189165 >> v1:172.21.15.178:6789/0 conn(0x7fe4d4146f00 legacy=0x7fe4d40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4d9361700 1 -- 172.21.15.177:0/725189165 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d40b03f0 con 0x7fe4d40cdff0 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.889+0000 7fe4d8b60700 1 -- 172.21.15.177:0/725189165 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367707002 0 0) 0x7fe4d4162bc0 con 0x7fe4d4146f00 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4da363700 1 --2- 172.21.15.177:0/725189165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4d9361700 1 --2- 172.21.15.177:0/725189165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 0x7fe4d4162680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40098f0 tx=0x7fe4c4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55bebe8b64a5d560 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4d8b60700 1 -- 172.21.15.177:0/725189165 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4011830 con 0x7fe4d40cdff0 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4d8b60700 1 -- 172.21.15.177:0/725189165 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c4011990 con 0x7fe4d40cdff0 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4d8b60700 1 -- 172.21.15.177:0/725189165 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4011d20 con 0x7fe4d40cdff0 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/725189165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 msgr2=0x7fe4d4162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/725189165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 0x7fe4d4162680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40098f0 tx=0x7fe4c4009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/725189165 shutdown_connections 2023-11-27T17:48:48.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/725189165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/725189165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 0x7fe4d4162680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/725189165 >> 172.21.15.177:0/725189165 conn(0x7fe4d40b38b0 msgr2=0x7fe4d40b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:48.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/725189165 shutdown_connections 2023-11-27T17:48:48.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.890+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/725189165 wait complete. 2023-11-27T17:48:48.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4dbdc6700 1 Processor -- start 2023-11-27T17:48:48.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4dbdc6700 1 -- start start 2023-11-27T17:48:48.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4dbdc6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4dbdc6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 0x7fe4d4152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4dbdc6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4d4146f00 0x7fe4d4070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4dbdc6700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d4150a50 con 0x7fe4d4146f00 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4dbdc6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40cd6b0 con 0x7fe4d40cdff0 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4dbdc6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d415fd80 con 0x7fe4d40afc30 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.892+0000 7fe4da363700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4d4146f00 0x7fe4d4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4da363700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4d4146f00 0x7fe4d4070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52552/0 (socket says 172.21.15.177:52552) 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4da363700 1 -- 172.21.15.177:0/2444996425 learned_addr learned my addr 172.21.15.177:0/2444996425 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4d9b62700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4d9361700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 0x7fe4d4152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4da363700 1 -- 172.21.15.177:0/2444996425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 msgr2=0x7fe4d40cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4da363700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4da363700 1 -- 172.21.15.177:0/2444996425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 msgr2=0x7fe4d4152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4da363700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 0x7fe4d4152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4da363700 1 -- 172.21.15.177:0/2444996425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009a70 con 0x7fe4d4146f00 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4da363700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4d4146f00 0x7fe4d4070720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009e10 tx=0x7fe4cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4ca7fc700 1 -- 172.21.15.177:0/2444996425 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc009cb0 con 0x7fe4d4146f00 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4ca7fc700 1 -- 172.21.15.177:0/2444996425 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc00f040 con 0x7fe4d4146f00 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c4009550 con 0x7fe4d4146f00 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4ca7fc700 1 -- 172.21.15.177:0/2444996425 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00ceb0 con 0x7fe4d4146f00 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.893+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d414fe40 con 0x7fe4d4146f00 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.894+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d4069400 con 0x7fe4d4146f00 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.895+0000 7fe4ca7fc700 1 -- 172.21.15.177:0/2444996425 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe4cc014480 con 0x7fe4d4146f00 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.895+0000 7fe4ca7fc700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe4b806b250 0x7fe4b806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:48.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.895+0000 7fe4ca7fc700 1 -- 172.21.15.177:0/2444996425 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4cc08a650 con 0x7fe4d4146f00 2023-11-27T17:48:48.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.895+0000 7fe4d9b62700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe4b806b250 0x7fe4b806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:48.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.896+0000 7fe4d9b62700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe4b806b250 0x7fe4b806d710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0007fd0 tx=0x7fe4d0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:48.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:48.900+0000 7fe4ca7fc700 1 -- 172.21.15.177:0/2444996425 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe4cc0552f0 con 0x7fe4d4146f00 2023-11-27T17:48:49.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.090+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4d4150b90 con 0x7fe4d4146f00 2023-11-27T17:48:49.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.090+0000 7fe4ca7fc700 1 -- 172.21.15.177:0/2444996425 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4cc0180a0 con 0x7fe4d4146f00 2023-11-27T17:48:49.093 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:49.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe4b806b250 msgr2=0x7fe4b806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe4b806b250 0x7fe4b806d710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0007fd0 tx=0x7fe4d0007de0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4d4146f00 msgr2=0x7fe4d4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4d4146f00 0x7fe4d4070720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009e10 tx=0x7fe4cc00c3a0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 shutdown_connections 2023-11-27T17:48:49.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe4b806b250 0x7fe4b806d710 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4d4146f00 0x7fe4d4070720 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d40afc30 0x7fe4d40cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 --2- 172.21.15.177:0/2444996425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d40cdff0 0x7fe4d4152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 >> 172.21.15.177:0/2444996425 conn(0x7fe4d40b38b0 msgr2=0x7fe4d406b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:49.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 shutdown_connections 2023-11-27T17:48:49.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.092+0000 7fe4dbdc6700 1 -- 172.21.15.177:0/2444996425 wait complete. 2023-11-27T17:48:49.107 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:49.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.230+0000 7f4abc91b700 1 Processor -- start 2023-11-27T17:48:49.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.230+0000 7f4abc91b700 1 -- start start 2023-11-27T17:48:49.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.231+0000 7f4abc91b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ab813ef60 0x7f4ab81414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.231+0000 7f4abc91b700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab8141e80 con 0x7f4ab81419f0 2023-11-27T17:48:49.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.231+0000 7f4abc91b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab815d140 con 0x7f4ab813eb80 2023-11-27T17:48:49.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.231+0000 7f4abc91b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab815d420 con 0x7f4ab813ef60 2023-11-27T17:48:49.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab6d9d700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f4ab81419f0 0x7f4ab815c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46878/0 (socket says 172.21.15.177:46878) 2023-11-27T17:48:49.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab6d9d700 1 -- 172.21.15.177:0/1193571337 learned_addr learned my addr 172.21.15.177:0/1193571337 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:49.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404685620 0 0) 0x7f4ab8141e80 con 0x7f4ab81419f0 2023-11-27T17:48:49.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab5d9b700 1 --2- 172.21.15.177:0/1193571337 >> v2:172.21.15.178:3300/0 conn(0x7f4ab813ef60 0x7f4ab81414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa00035b0 con 0x7f4ab81419f0 2023-11-27T17:48:49.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3255471651 0 0) 0x7f4aa00035b0 con 0x7f4ab81419f0 2023-11-27T17:48:49.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 >> v2:172.21.15.178:3300/0 conn(0x7f4ab813ef60 msgr2=0x7f4ab81414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:49.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 --2- 172.21.15.177:0/1193571337 >> v2:172.21.15.178:3300/0 conn(0x7f4ab813ef60 0x7f4ab81414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 >> v1:172.21.15.178:6789/0 conn(0x7f4ab813eb80 legacy=0x7f4ab80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80ce700 con 0x7f4ab81419f0 2023-11-27T17:48:49.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f4ab00019f0 con 0x7f4ab81419f0 2023-11-27T17:48:49.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 >> v1:172.21.15.177:6789/0 conn(0x7f4ab81419f0 legacy=0x7f4ab815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aa0003a50 0x7f4aa0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4aa0004850 0x7f4aa0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0005410 0x7f4aa000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab815d420 con 0x7f4aa0004850 2023-11-27T17:48:49.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa000c2f0 con 0x7f4aa0003a50 2023-11-27T17:48:49.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa000c4b0 con 0x7f4aa0005410 2023-11-27T17:48:49.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab5d9b700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4aa0004850 0x7f4aa0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab659c700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aa0003a50 0x7f4aa0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.232+0000 7f4ab6d9d700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0005410 0x7f4aa000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab5d9b700 1 -- 172.21.15.177:0/1193571337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0005410 msgr2=0x7f4aa000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:49.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab5d9b700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0005410 0x7f4aa000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab5d9b700 1 -- 172.21.15.177:0/1193571337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aa0003a50 msgr2=0x7f4aa0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:49.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab5d9b700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aa0003a50 0x7f4aa0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab6d9d700 1 -- 172.21.15.177:0/1193571337 reap_dead start 2023-11-27T17:48:49.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab5d9b700 1 -- 172.21.15.177:0/1193571337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00035b0 con 0x7f4aa0004850 2023-11-27T17:48:49.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab5d9b700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4aa0004850 0x7f4aa0004cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80b5330 tx=0x7f4aa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d129dc2b61c74e1d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800c070 con 0x7f4aa0004850 2023-11-27T17:48:49.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa8013610 con 0x7f4aa0004850 2023-11-27T17:48:49.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4ab559a700 1 -- 172.21.15.177:0/1193571337 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa80139a0 con 0x7f4aa0004850 2023-11-27T17:48:49.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4abc91b700 1 -- 172.21.15.177:0/1193571337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4aa0004850 msgr2=0x7f4aa0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.233+0000 7f4abc91b700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4aa0004850 0x7f4aa0004cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80b5330 tx=0x7f4aa0005880 comp rx=0 tx=0).stop 2023-11-27T17:48:49.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.234+0000 7f4abc91b700 1 -- 172.21.15.177:0/1193571337 shutdown_connections 2023-11-27T17:48:49.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.234+0000 7f4abc91b700 1 --2- 172.21.15.177:0/1193571337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4aa0004850 0x7f4aa0004cd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.234+0000 7f4abc91b700 1 -- 172.21.15.177:0/1193571337 >> 172.21.15.177:0/1193571337 conn(0x7f4ab80b31d0 msgr2=0x7f4ab80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:49.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.234+0000 7f4abc91b700 1 -- 172.21.15.177:0/1193571337 shutdown_connections 2023-11-27T17:48:49.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.234+0000 7f4abc91b700 1 -- 172.21.15.177:0/1193571337 wait complete. 2023-11-27T17:48:49.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.235+0000 7f4abc91b700 1 Processor -- start 2023-11-27T17:48:49.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.235+0000 7f4abc91b700 1 -- start start 2023-11-27T17:48:49.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4abc91b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0004850 0x7f4ab80cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4abc91b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab8155820 0x7f4ab80b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4abc91b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab80cb3e0 0x7f4ab80cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4abc91b700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8154a60 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4abc91b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8154d40 con 0x7f4ab8155820 2023-11-27T17:48:49.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4abc91b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8155020 con 0x7f4aa0004850 2023-11-27T17:48:49.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab80cb3e0 0x7f4ab80cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab80cb3e0 0x7f4ab80cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52572/0 (socket says 172.21.15.177:52572) 2023-11-27T17:48:49.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 -- 172.21.15.177:0/2363495516 learned_addr learned my addr 172.21.15.177:0/2363495516 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:49.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab5d9b700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab8155820 0x7f4ab80b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab659c700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0004850 0x7f4ab80cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 -- 172.21.15.177:0/2363495516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0004850 msgr2=0x7f4ab80cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0004850 0x7f4ab80cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 -- 172.21.15.177:0/2363495516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab8155820 msgr2=0x7f4ab80b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab8155820 0x7f4ab80b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 -- 172.21.15.177:0/2363495516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8155300 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4ab6d9d700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab80cb3e0 0x7f4ab80cb890 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00047d0 tx=0x7f4ab000a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4aa6ffd700 1 -- 172.21.15.177:0/2363495516 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0001370 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4aa6ffd700 1 -- 172.21.15.177:0/2363495516 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab000abb0 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab80b7f80 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.236+0000 7f4aa6ffd700 1 -- 172.21.15.177:0/2363495516 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab00133f0 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.237+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab813abd0 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.238+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab8069400 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.238+0000 7f4aa6ffd700 1 -- 172.21.15.177:0/2363495516 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4ab0013550 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.238+0000 7f4aa6ffd700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a9806b250 0x7f4a9806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.239+0000 7f4aa6ffd700 1 -- 172.21.15.177:0/2363495516 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ab008a090 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.239+0000 7f4ab659c700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a9806b250 0x7f4a9806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.239+0000 7f4ab659c700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a9806b250 0x7f4a9806d710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4aac000c00 tx=0x7f4aac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.243+0000 7f4aa6ffd700 1 -- 172.21.15.177:0/2363495516 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4ab0054e50 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.432+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ab8154ba0 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.432+0000 7f4aa6ffd700 1 -- 172.21.15.177:0/2363495516 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ab8154ba0 con 0x7f4ab80cb3e0 2023-11-27T17:48:49.435 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:49.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a9806b250 msgr2=0x7f4a9806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a9806b250 0x7f4a9806d710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4aac000c00 tx=0x7f4aac009040 comp rx=0 tx=0).stop 2023-11-27T17:48:49.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab80cb3e0 msgr2=0x7f4ab80cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab80cb3e0 0x7f4ab80cb890 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00047d0 tx=0x7f4ab000a550 comp rx=0 tx=0).stop 2023-11-27T17:48:49.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 shutdown_connections 2023-11-27T17:48:49.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f4a9806b250 0x7f4a9806d710 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ab80cb3e0 0x7f4ab80cb890 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aa0004850 0x7f4ab80cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 --2- 172.21.15.177:0/2363495516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab8155820 0x7f4ab80b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 >> 172.21.15.177:0/2363495516 conn(0x7f4ab80b31d0 msgr2=0x7f4ab815c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:49.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 shutdown_connections 2023-11-27T17:48:49.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.435+0000 7f4abc91b700 1 -- 172.21.15.177:0/2363495516 wait complete. 2023-11-27T17:48:49.449 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:49.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.570+0000 7f569aecd700 1 Processor -- start 2023-11-27T17:48:49.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.570+0000 7f569aecd700 1 -- start start 2023-11-27T17:48:49.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f569aecd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5694141bc0 0x7f569415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f569aecd700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569415d140 con 0x7f569413ef60 2023-11-27T17:48:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f569aecd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56940ce700 con 0x7f569413eb80 2023-11-27T17:48:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f569aecd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569415d420 con 0x7f5694141bc0 2023-11-27T17:48:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f5693fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f569413ef60 0x7f56941414b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46894/0 (socket says 172.21.15.177:46894) 2023-11-27T17:48:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f5693fff700 1 -- 172.21.15.177:0/236382584 learned_addr learned my addr 172.21.15.177:0/236382584 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f569946a700 1 --2- 172.21.15.177:0/236382584 >> v2:172.21.15.178:3300/0 conn(0x7f5694141bc0 0x7f569415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f56937fe700 1 -- 172.21.15.177:0/236382584 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032121836 0 0) 0x7f569415d140 con 0x7f569413ef60 2023-11-27T17:48:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f56937fe700 1 -- 172.21.15.177:0/236382584 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56840035b0 con 0x7f569413ef60 2023-11-27T17:48:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f56937fe700 1 -- 172.21.15.177:0/236382584 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746241955 0 0) 0x7f56840035b0 con 0x7f569413ef60 2023-11-27T17:48:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f569946a700 1 -- 172.21.15.177:0/236382584 >> v1:172.21.15.178:6789/0 conn(0x7f569413eb80 legacy=0x7f56940cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f569946a700 1 -- 172.21.15.177:0/236382584 >> v1:172.21.15.177:6789/0 conn(0x7f569413ef60 legacy=0x7f56941414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.571+0000 7f569946a700 1 -- 172.21.15.177:0/236382584 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940ce9e0 con 0x7f5694141bc0 2023-11-27T17:48:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f569946a700 1 --2- 172.21.15.177:0/236382584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5694141bc0 0x7f569415c3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f568c009d90 tx=0x7f568c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e050d5a5b4b52a91 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f56937fe700 1 -- 172.21.15.177:0/236382584 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00e070 con 0x7f5694141bc0 2023-11-27T17:48:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f56937fe700 1 -- 172.21.15.177:0/236382584 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c003a20 con 0x7f5694141bc0 2023-11-27T17:48:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f56937fe700 1 -- 172.21.15.177:0/236382584 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680001670 con 0x7f5694141bc0 2023-11-27T17:48:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f569aecd700 1 -- 172.21.15.177:0/236382584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5694141bc0 msgr2=0x7f569415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f569aecd700 1 --2- 172.21.15.177:0/236382584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5694141bc0 0x7f569415c3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f568c009d90 tx=0x7f568c00b330 comp rx=0 tx=0).stop 2023-11-27T17:48:49.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f569aecd700 1 -- 172.21.15.177:0/236382584 shutdown_connections 2023-11-27T17:48:49.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f569aecd700 1 --2- 172.21.15.177:0/236382584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5694141bc0 0x7f569415c3e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f569aecd700 1 -- 172.21.15.177:0/236382584 >> 172.21.15.177:0/236382584 conn(0x7f56940b31d0 msgr2=0x7f56940b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:49.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f569aecd700 1 -- 172.21.15.177:0/236382584 shutdown_connections 2023-11-27T17:48:49.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.572+0000 7f569aecd700 1 -- 172.21.15.177:0/236382584 wait complete. 2023-11-27T17:48:49.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.574+0000 7f569aecd700 1 Processor -- start 2023-11-27T17:48:49.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.574+0000 7f569aecd700 1 -- start start 2023-11-27T17:48:49.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.574+0000 7f569aecd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f569413eb80 0x7f56940b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.574+0000 7f569aecd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5694141bc0 0x7f56941548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.574+0000 7f569aecd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569415a750 0x7f569415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.574+0000 7f569aecd700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569415b140 con 0x7f5694141bc0 2023-11-27T17:48:49.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.574+0000 7f569aecd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5694154e30 con 0x7f569415a750 2023-11-27T17:48:49.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.574+0000 7f569aecd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56940b6ed0 con 0x7f569413eb80 2023-11-27T17:48:49.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5694141bc0 0x7f56941548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5694141bc0 0x7f56941548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52584/0 (socket says 172.21.15.177:52584) 2023-11-27T17:48:49.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 -- 172.21.15.177:0/2219217896 learned_addr learned my addr 172.21.15.177:0/2219217896 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:49.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f569946a700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569415a750 0x7f569415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5698c69700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f569413eb80 0x7f56940b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 -- 172.21.15.177:0/2219217896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f569413eb80 msgr2=0x7f56940b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f569413eb80 0x7f56940b66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 -- 172.21.15.177:0/2219217896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569415a750 msgr2=0x7f569415ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569415a750 0x7f569415ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 -- 172.21.15.177:0/2219217896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c009a70 con 0x7f5694141bc0 2023-11-27T17:48:49.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f5693fff700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5694141bc0 0x7f56941548f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f568000c7b0 tx=0x7f568000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f56917fa700 1 -- 172.21.15.177:0/2219217896 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680005d50 con 0x7f5694141bc0 2023-11-27T17:48:49.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f56917fa700 1 -- 172.21.15.177:0/2219217896 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56800070d0 con 0x7f5694141bc0 2023-11-27T17:48:49.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56940b71b0 con 0x7f5694141bc0 2023-11-27T17:48:49.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f56917fa700 1 -- 172.21.15.177:0/2219217896 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680007460 con 0x7f5694141bc0 2023-11-27T17:48:49.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.575+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56940b7770 con 0x7f5694141bc0 2023-11-27T17:48:49.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.576+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56940cfa10 con 0x7f5694141bc0 2023-11-27T17:48:49.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.577+0000 7f56917fa700 1 -- 172.21.15.177:0/2219217896 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f56800075c0 con 0x7f5694141bc0 2023-11-27T17:48:49.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.577+0000 7f56917fa700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f567806b250 0x7f567806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.577+0000 7f56917fa700 1 -- 172.21.15.177:0/2219217896 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5680088d30 con 0x7f5694141bc0 2023-11-27T17:48:49.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.577+0000 7f5698c69700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f567806b250 0x7f567806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.577+0000 7f5698c69700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f567806b250 0x7f567806d710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5688007fd0 tx=0x7f5688009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.581+0000 7f56917fa700 1 -- 172.21.15.177:0/2219217896 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5680053b20 con 0x7f5694141bc0 2023-11-27T17:48:49.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.772+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5694069400 con 0x7f5694141bc0 2023-11-27T17:48:49.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.772+0000 7f56917fa700 1 -- 172.21.15.177:0/2219217896 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5680057140 con 0x7f5694141bc0 2023-11-27T17:48:49.775 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:49.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f567806b250 msgr2=0x7f567806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f567806b250 0x7f567806d710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5688007fd0 tx=0x7f5688009040 comp rx=0 tx=0).stop 2023-11-27T17:48:49.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5694141bc0 msgr2=0x7f56941548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5694141bc0 0x7f56941548f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f568000c7b0 tx=0x7f568000cac0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 shutdown_connections 2023-11-27T17:48:49.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f567806b250 0x7f567806d710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569415a750 0x7f569415ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f569413eb80 0x7f56940b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 --2- 172.21.15.177:0/2219217896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5694141bc0 0x7f56941548f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 >> 172.21.15.177:0/2219217896 conn(0x7f56940b31d0 msgr2=0x7f56941414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:49.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 shutdown_connections 2023-11-27T17:48:49.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.774+0000 7f569aecd700 1 -- 172.21.15.177:0/2219217896 wait complete. 2023-11-27T17:48:49.789 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T17:48:49.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.909+0000 7f3445ef8700 1 Processor -- start 2023-11-27T17:48:49.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.909+0000 7f3445ef8700 1 -- start start 2023-11-27T17:48:49.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.909+0000 7f3445ef8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34400b2860 0x7f344015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.909+0000 7f3445ef8700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3440160180 0x7f3440144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.909+0000 7f3445ef8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34400d0f40 con 0x7f34400cf3c0 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.909+0000 7f3445ef8700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34401609e0 con 0x7f3440160180 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.909+0000 7f3445ef8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34400b7490 con 0x7f34400b2860 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.909+0000 7f343ffff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3440160180 0x7f3440144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343ffff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3440160180 0x7f3440144fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52590/0 (socket says 172.21.15.177:52590) 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343f7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f34400cf3c0 0x7f34400b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46908/0 (socket says 172.21.15.177:46908) 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343ffff700 1 -- 172.21.15.177:0/3491951283 learned_addr learned my addr 172.21.15.177:0/3491951283 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343effd700 1 --2- 172.21.15.177:0/3491951283 >> v2:172.21.15.178:3300/0 conn(0x7f34400b2860 0x7f344015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343ffff700 1 -- 172.21.15.177:0/3491951283 >> v2:172.21.15.178:3300/0 conn(0x7f34400b2860 msgr2=0x7f344015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343ffff700 1 --2- 172.21.15.177:0/3491951283 >> v2:172.21.15.178:3300/0 conn(0x7f34400b2860 0x7f344015fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343ffff700 1 -- 172.21.15.177:0/3491951283 >> v1:172.21.15.177:6789/0 conn(0x7f34400cf3c0 legacy=0x7f34400b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343ffff700 1 -- 172.21.15.177:0/3491951283 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34400d1220 con 0x7f3440160180 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343e7fc700 1 -- 172.21.15.177:0/3491951283 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167084395 0 0) 0x7f34400d0f40 con 0x7f34400cf3c0 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343ffff700 1 --2- 172.21.15.177:0/3491951283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3440160180 0x7f3440144fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3440073630 tx=0x7f343800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3ad574443cafc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343e7fc700 1 -- 172.21.15.177:0/3491951283 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343800e070 con 0x7f3440160180 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343e7fc700 1 -- 172.21.15.177:0/3491951283 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343800b9c0 con 0x7f3440160180 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.910+0000 7f343e7fc700 1 -- 172.21.15.177:0/3491951283 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343800bd70 con 0x7f3440160180 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.911+0000 7f3445ef8700 1 -- 172.21.15.177:0/3491951283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3440160180 msgr2=0x7f3440144fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.911+0000 7f3445ef8700 1 --2- 172.21.15.177:0/3491951283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3440160180 0x7f3440144fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3440073630 tx=0x7f343800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.911+0000 7f3445ef8700 1 -- 172.21.15.177:0/3491951283 shutdown_connections 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.911+0000 7f3445ef8700 1 --2- 172.21.15.177:0/3491951283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3440160180 0x7f3440144fe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.911+0000 7f3445ef8700 1 --2- 172.21.15.177:0/3491951283 >> v2:172.21.15.178:3300/0 conn(0x7f34400b2860 0x7f344015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.911+0000 7f3445ef8700 1 -- 172.21.15.177:0/3491951283 >> 172.21.15.177:0/3491951283 conn(0x7f3440072190 msgr2=0x7f34400725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:49.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.911+0000 7f3445ef8700 1 -- 172.21.15.177:0/3491951283 shutdown_connections 2023-11-27T17:48:49.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.911+0000 7f3445ef8700 1 -- 172.21.15.177:0/3491951283 wait complete. 2023-11-27T17:48:49.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.912+0000 7f3445ef8700 1 Processor -- start 2023-11-27T17:48:49.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.912+0000 7f3445ef8700 1 -- start start 2023-11-27T17:48:49.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3445ef8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34400b2860 0x7f34400af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3445ef8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34400cf3c0 0x7f34400ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3445ef8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3440160180 0x7f344014e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3445ef8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400aed30 con 0x7f34400b2860 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3445ef8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400ae0b0 con 0x7f34400cf3c0 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3445ef8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400ae390 con 0x7f3440160180 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34400b2860 0x7f34400af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34400b2860 0x7f34400af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52594/0 (socket says 172.21.15.177:52594) 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 -- 172.21.15.177:0/2128880859 learned_addr learned my addr 172.21.15.177:0/2128880859 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 -- 172.21.15.177:0/2128880859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3440160180 msgr2=0x7f344014e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3440160180 0x7f344014e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 -- 172.21.15.177:0/2128880859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34400cf3c0 msgr2=0x7f34400ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:49.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34400cf3c0 0x7f34400ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 -- 172.21.15.177:0/2128880859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438009b30 con 0x7f34400b2860 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f343f7fe700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34400b2860 0x7f34400af150 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f34300011e0 tx=0x7f343000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3427fff700 1 -- 172.21.15.177:0/2128880859 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430004c80 con 0x7f34400b2860 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3427fff700 1 -- 172.21.15.177:0/2128880859 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3430004e00 con 0x7f34400b2860 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34400ae670 con 0x7f34400b2860 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.913+0000 7f3427fff700 1 -- 172.21.15.177:0/2128880859 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430007310 con 0x7f34400b2860 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.914+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34400adda0 con 0x7f34400b2860 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.914+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3440073aa0 con 0x7f34400b2860 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.915+0000 7f3427fff700 1 -- 172.21.15.177:0/2128880859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3430007470 con 0x7f34400b2860 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.915+0000 7f3427fff700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f342c06b250 0x7f342c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:49.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.915+0000 7f3427fff700 1 -- 172.21.15.177:0/2128880859 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3430089800 con 0x7f34400b2860 2023-11-27T17:48:49.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.915+0000 7f343effd700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f342c06b250 0x7f342c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:49.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.916+0000 7f343effd700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f342c06b250 0x7f342c06d710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f343400a8d0 tx=0x7f3434008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:49.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:49.920+0000 7f3427fff700 1 -- 172.21.15.177:0/2128880859 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f34300544a0 con 0x7f34400b2860 2023-11-27T17:48:50.122 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:48:50.125 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:48:50.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.125+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f34400aee70 con 0x7f34400b2860 2023-11-27T17:48:50.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.126+0000 7f3427fff700 1 -- 172.21.15.177:0/2128880859 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f34400aee70 con 0x7f34400b2860 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f342c06b250 msgr2=0x7f342c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f342c06b250 0x7f342c06d710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f343400a8d0 tx=0x7f3434008040 comp rx=0 tx=0).stop 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34400b2860 msgr2=0x7f34400af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34400b2860 0x7f34400af150 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f34300011e0 tx=0x7f343000cae0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 shutdown_connections 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f342c06b250 0x7f342c06d710 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3440160180 0x7f344014e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34400b2860 0x7f34400af150 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 --2- 172.21.15.177:0/2128880859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34400cf3c0 0x7f34400ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 >> 172.21.15.177:0/2128880859 conn(0x7f3440072190 msgr2=0x7f344006ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:50.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 shutdown_connections 2023-11-27T17:48:50.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.128+0000 7f3445ef8700 1 -- 172.21.15.177:0/2128880859 wait complete. 2023-11-27T17:48:50.132 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-27T17:48:50.146 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-27T17:48:50.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:50.146 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-27T17:48:50.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-27T17:48:50.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:50.228 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T17:48:50.300 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:48:50.300 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:50.323 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:48:50.323 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:50.383 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:48:50.383 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:50.444 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:50.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.563+0000 7fcd31407700 1 Processor -- start 2023-11-27T17:48:50.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.563+0000 7fcd31407700 1 -- start start 2023-11-27T17:48:50.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd31407700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0aea40 0x7fcd2c0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd31407700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcd2c0cbcc0 0x7fcd2c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd31407700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c15fb80 con 0x7fcd2c0b3f80 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd31407700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c15c510 con 0x7fcd2c0cbcc0 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd31407700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06ed30 con 0x7fcd2c0aea40 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2a7fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcd2c0cbcc0 0x7fcd2c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2a7fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcd2c0cbcc0 0x7fcd2c0cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52602/0 (socket says 172.21.15.177:52602) 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2a7fc700 1 -- 172.21.15.177:0/4150958818 learned_addr learned my addr 172.21.15.177:0/4150958818 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2a7fc700 1 -- 172.21.15.177:0/4150958818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0aea40 msgr2=0x7fcd2c0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2affd700 1 --2- 172.21.15.177:0/4150958818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0aea40 0x7fcd2c0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2a7fc700 1 --2- 172.21.15.177:0/4150958818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0aea40 0x7fcd2c0cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2a7fc700 1 -- 172.21.15.177:0/4150958818 >> v1:172.21.15.178:6789/0 conn(0x7fcd2c0b3f80 legacy=0x7fcd2c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2a7fc700 1 -- 172.21.15.177:0/4150958818 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c06f010 con 0x7fcd2c0cbcc0 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd2a7fc700 1 --2- 172.21.15.177:0/4150958818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0cbcc0 0x7fcd2c0cccd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098f0 tx=0x7fcd20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e18c1b79e4af0c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.564+0000 7fcd29ffb700 1 -- 172.21.15.177:0/4150958818 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20004230 con 0x7fcd2c0cbcc0 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd29ffb700 1 -- 172.21.15.177:0/4150958818 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd20004390 con 0x7fcd2c0cbcc0 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd29ffb700 1 -- 172.21.15.177:0/4150958818 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200036a0 con 0x7fcd2c0cbcc0 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd31407700 1 -- 172.21.15.177:0/4150958818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0cbcc0 msgr2=0x7fcd2c0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd31407700 1 --2- 172.21.15.177:0/4150958818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0cbcc0 0x7fcd2c0cccd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098f0 tx=0x7fcd20009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd31407700 1 -- 172.21.15.177:0/4150958818 shutdown_connections 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd31407700 1 --2- 172.21.15.177:0/4150958818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0aea40 0x7fcd2c0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd31407700 1 --2- 172.21.15.177:0/4150958818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0cbcc0 0x7fcd2c0cccd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd31407700 1 -- 172.21.15.177:0/4150958818 >> 172.21.15.177:0/4150958818 conn(0x7fcd2c0b15d0 msgr2=0x7fcd2c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd31407700 1 -- 172.21.15.177:0/4150958818 shutdown_connections 2023-11-27T17:48:50.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.565+0000 7fcd31407700 1 -- 172.21.15.177:0/4150958818 wait complete. 2023-11-27T17:48:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.567+0000 7fcd31407700 1 Processor -- start 2023-11-27T17:48:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.567+0000 7fcd31407700 1 -- start start 2023-11-27T17:48:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd31407700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0aea40 0x7fcd2c151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd31407700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd2c0b3f80 0x7fcd2c06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd31407700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0cbcc0 0x7fcd2c0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd31407700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06d310 con 0x7fcd2c0aea40 2023-11-27T17:48:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd31407700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06d5f0 con 0x7fcd2c0b3f80 2023-11-27T17:48:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd31407700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06d8d0 con 0x7fcd2c0cbcc0 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0aea40 0x7fcd2c151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0aea40 0x7fcd2c151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52608/0 (socket says 172.21.15.177:52608) 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 -- 172.21.15.177:0/55706649 learned_addr learned my addr 172.21.15.177:0/55706649 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2a7fc700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd2c0b3f80 0x7fcd2c06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2b7fe700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0cbcc0 0x7fcd2c0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 -- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0cbcc0 msgr2=0x7fcd2c0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0cbcc0 0x7fcd2c0c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 -- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd2c0b3f80 msgr2=0x7fcd2c06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd2c0b3f80 0x7fcd2c06ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 -- 172.21.15.177:0/55706649 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009550 con 0x7fcd2c0aea40 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2a7fc700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd2c0b3f80 0x7fcd2c06ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd2affd700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0aea40 0x7fcd2c151fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c7f0 tx=0x7fcd1c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd137fe700 1 -- 172.21.15.177:0/55706649 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c011800 con 0x7fcd2c0aea40 2023-11-27T17:48:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd137fe700 1 -- 172.21.15.177:0/55706649 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c011960 con 0x7fcd2c0aea40 2023-11-27T17:48:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c06dbb0 con 0x7fcd2c0aea40 2023-11-27T17:48:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd137fe700 1 -- 172.21.15.177:0/55706649 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c011cf0 con 0x7fcd2c0aea40 2023-11-27T17:48:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.568+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c152520 con 0x7fcd2c0aea40 2023-11-27T17:48:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.569+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c069400 con 0x7fcd2c0aea40 2023-11-27T17:48:50.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.570+0000 7fcd137fe700 1 -- 172.21.15.177:0/55706649 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcd1c018360 con 0x7fcd2c0aea40 2023-11-27T17:48:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.570+0000 7fcd137fe700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcd1806b250 0x7fcd1806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.570+0000 7fcd137fe700 1 -- 172.21.15.177:0/55706649 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd1c089a70 con 0x7fcd2c0aea40 2023-11-27T17:48:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.570+0000 7fcd2a7fc700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcd1806b250 0x7fcd1806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.571+0000 7fcd2a7fc700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcd1806b250 0x7fcd1806d710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0cc0e0 tx=0x7fcd20008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:50.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.575+0000 7fcd137fe700 1 -- 172.21.15.177:0/55706649 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcd1c054710 con 0x7fcd2c0aea40 2023-11-27T17:48:50.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.768+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd2c070aa0 con 0x7fcd2c0aea40 2023-11-27T17:48:50.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.769+0000 7fcd137fe700 1 -- 172.21.15.177:0/55706649 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fcd1c057d30 con 0x7fcd2c0aea40 2023-11-27T17:48:50.772 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:50.772 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcd1806b250 msgr2=0x7fcd1806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcd1806b250 0x7fcd1806d710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0cc0e0 tx=0x7fcd20008030 comp rx=0 tx=0).stop 2023-11-27T17:48:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0aea40 msgr2=0x7fcd2c151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0aea40 0x7fcd2c151fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c7f0 tx=0x7fcd1c00cbb0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 shutdown_connections 2023-11-27T17:48:50.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcd1806b250 0x7fcd1806d710 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd2c0cbcc0 0x7fcd2c0c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd2c0aea40 0x7fcd2c151fe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 --2- 172.21.15.177:0/55706649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd2c0b3f80 0x7fcd2c06ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 >> 172.21.15.177:0/55706649 conn(0x7fcd2c0b15d0 msgr2=0x7fcd2c0ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 shutdown_connections 2023-11-27T17:48:50.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.771+0000 7fcd31407700 1 -- 172.21.15.177:0/55706649 wait complete. 2023-11-27T17:48:50.786 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:50.786 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:50.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.908+0000 7f273b26f700 1 Processor -- start 2023-11-27T17:48:50.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.908+0000 7f273b26f700 1 -- start start 2023-11-27T17:48:50.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.909+0000 7f273b26f700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f27340afc30 0x7f2734162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.909+0000 7f273b26f700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2734162bc0 con 0x7f27340cdff0 2023-11-27T17:48:50.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.909+0000 7f273b26f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27340b0110 con 0x7f2734146f00 2023-11-27T17:48:50.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.909+0000 7f273b26f700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27341472e0 con 0x7f27340afc30 2023-11-27T17:48:50.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.909+0000 7f273880a700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f27340cdff0 0x7f27340cef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46934/0 (socket says 172.21.15.177:46934) 2023-11-27T17:48:50.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.909+0000 7f273980c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f27340afc30 0x7f2734162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.909+0000 7f273880a700 1 -- 172.21.15.177:0/1094623547 learned_addr learned my addr 172.21.15.177:0/1094623547 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:50.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273980c700 1 -- 172.21.15.177:0/1094623547 >> v1:172.21.15.178:6789/0 conn(0x7f2734146f00 legacy=0x7f27340cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:50.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273980c700 1 -- 172.21.15.177:0/1094623547 >> v1:172.21.15.177:6789/0 conn(0x7f27340cdff0 legacy=0x7f27340cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273980c700 1 -- 172.21.15.177:0/1094623547 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340b03f0 con 0x7f27340afc30 2023-11-27T17:48:50.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f272bfff700 1 -- 172.21.15.177:0/1094623547 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877743568 0 0) 0x7f2734162bc0 con 0x7f27340cdff0 2023-11-27T17:48:50.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273980c700 1 --2- 172.21.15.177:0/1094623547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27340afc30 0x7f2734162680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f272c009d90 tx=0x7f272c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f050b1dcc3d690 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:50.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f272bfff700 1 -- 172.21.15.177:0/1094623547 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00e070 con 0x7f27340afc30 2023-11-27T17:48:50.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f272bfff700 1 -- 172.21.15.177:0/1094623547 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c00bb90 con 0x7f27340afc30 2023-11-27T17:48:50.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f272bfff700 1 -- 172.21.15.177:0/1094623547 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c003a20 con 0x7f27340afc30 2023-11-27T17:48:50.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273b26f700 1 -- 172.21.15.177:0/1094623547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27340afc30 msgr2=0x7f2734162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273b26f700 1 --2- 172.21.15.177:0/1094623547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27340afc30 0x7f2734162680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f272c009d90 tx=0x7f272c00b330 comp rx=0 tx=0).stop 2023-11-27T17:48:50.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273b26f700 1 -- 172.21.15.177:0/1094623547 shutdown_connections 2023-11-27T17:48:50.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273b26f700 1 --2- 172.21.15.177:0/1094623547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27340afc30 0x7f2734162680 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.910+0000 7f273b26f700 1 -- 172.21.15.177:0/1094623547 >> 172.21.15.177:0/1094623547 conn(0x7f27340b38b0 msgr2=0x7f27340b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:50.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.911+0000 7f273b26f700 1 -- 172.21.15.177:0/1094623547 shutdown_connections 2023-11-27T17:48:50.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.911+0000 7f273b26f700 1 -- 172.21.15.177:0/1094623547 wait complete. 2023-11-27T17:48:50.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.912+0000 7f273b26f700 1 Processor -- start 2023-11-27T17:48:50.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.912+0000 7f273b26f700 1 -- start start 2023-11-27T17:48:50.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.912+0000 7f273b26f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27340afc30 0x7f2734144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.912+0000 7f273b26f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27340cdff0 0x7f27340c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.912+0000 7f273b26f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2734146f00 0x7f27340cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.912+0000 7f273b26f700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27341f3800 con 0x7f2734146f00 2023-11-27T17:48:50.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.912+0000 7f273b26f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2734071140 con 0x7f27340afc30 2023-11-27T17:48:50.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.912+0000 7f273b26f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2734070e30 con 0x7f27340cdff0 2023-11-27T17:48:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2734146f00 0x7f27340cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2734146f00 0x7f27340cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52626/0 (socket says 172.21.15.177:52626) 2023-11-27T17:48:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 -- 172.21.15.177:0/3613696254 learned_addr learned my addr 172.21.15.177:0/3613696254 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273900b700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27340afc30 0x7f2734144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273880a700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27340cdff0 0x7f27340c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 -- 172.21.15.177:0/3613696254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27340cdff0 msgr2=0x7f27340c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27340cdff0 0x7f27340c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 -- 172.21.15.177:0/3613696254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27340afc30 msgr2=0x7f2734144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27340afc30 0x7f2734144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 -- 172.21.15.177:0/3613696254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c009a70 con 0x7f2734146f00 2023-11-27T17:48:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273980c700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2734146f00 0x7f27340cd410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27340ce910 tx=0x7f272c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f2729ffb700 1 -- 172.21.15.177:0/3613696254 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c003a20 con 0x7f2734146f00 2023-11-27T17:48:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f2729ffb700 1 -- 172.21.15.177:0/3613696254 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c012650 con 0x7f2734146f00 2023-11-27T17:48:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27341453f0 con 0x7f2734146f00 2023-11-27T17:48:50.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f2729ffb700 1 -- 172.21.15.177:0/3613696254 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c012a00 con 0x7f2734146f00 2023-11-27T17:48:50.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.913+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27341459a0 con 0x7f2734146f00 2023-11-27T17:48:50.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.914+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2734069400 con 0x7f2734146f00 2023-11-27T17:48:50.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.915+0000 7f2729ffb700 1 -- 172.21.15.177:0/3613696254 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f272c012b60 con 0x7f2734146f00 2023-11-27T17:48:50.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.915+0000 7f2729ffb700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f271806b250 0x7f271806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:50.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.915+0000 7f2729ffb700 1 -- 172.21.15.177:0/3613696254 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f272c08ba90 con 0x7f2734146f00 2023-11-27T17:48:50.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.915+0000 7f273900b700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f271806b250 0x7f271806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:50.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.916+0000 7f273900b700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f271806b250 0x7f271806d710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2724007fd0 tx=0x7f2724007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:50.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:50.919+0000 7f2729ffb700 1 -- 172.21.15.177:0/3613696254 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f272c056850 con 0x7f2734146f00 2023-11-27T17:48:51.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.112+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2734071280 con 0x7f2734146f00 2023-11-27T17:48:51.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.112+0000 7f2729ffb700 1 -- 172.21.15.177:0/3613696254 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f272c02a020 con 0x7f2734146f00 2023-11-27T17:48:51.115 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:51.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f271806b250 msgr2=0x7f271806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f271806b250 0x7f271806d710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2724007fd0 tx=0x7f2724007ec0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2734146f00 msgr2=0x7f27340cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2734146f00 0x7f27340cd410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27340ce910 tx=0x7f272c004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 shutdown_connections 2023-11-27T17:48:51.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f271806b250 0x7f271806d710 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2734146f00 0x7f27340cd410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27340afc30 0x7f2734144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 --2- 172.21.15.177:0/3613696254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27340cdff0 0x7f27340c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 >> 172.21.15.177:0/3613696254 conn(0x7f27340b38b0 msgr2=0x7f27340b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:51.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 shutdown_connections 2023-11-27T17:48:51.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.114+0000 7f273b26f700 1 -- 172.21.15.177:0/3613696254 wait complete. 2023-11-27T17:48:51.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:51.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.249+0000 7f49714e8700 1 Processor -- start 2023-11-27T17:48:51.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.249+0000 7f49714e8700 1 -- start start 2023-11-27T17:48:51.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.250+0000 7f49714e8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f496c072950 0x7f496c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.250+0000 7f49714e8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1626e0 0x7f496c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.250+0000 7f49714e8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0d0630 con 0x7f496c1479a0 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.250+0000 7f49714e8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c162b70 con 0x7f496c072950 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.250+0000 7f49714e8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c147d80 con 0x7f496c1626e0 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496b7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1626e0 0x7f496c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496a7fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f496c072950 0x7f496c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496affd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f496c1479a0 0x7f496c072240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45926/0 (socket says 172.21.15.177:45926) 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496affd700 1 -- 172.21.15.177:0/1961276463 learned_addr learned my addr 172.21.15.177:0/1961276463 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496a7fc700 1 -- 172.21.15.177:0/1961276463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1626e0 msgr2=0x7f496c0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496a7fc700 1 --2- 172.21.15.177:0/1961276463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1626e0 0x7f496c0d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496a7fc700 1 -- 172.21.15.177:0/1961276463 >> v1:172.21.15.178:6789/0 conn(0x7f496c1479a0 legacy=0x7f496c072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f4969ffb700 1 -- 172.21.15.177:0/1961276463 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973801720 0 0) 0x7f496c0d0630 con 0x7f496c1479a0 2023-11-27T17:48:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496a7fc700 1 -- 172.21.15.177:0/1961276463 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c06b9b0 con 0x7f496c072950 2023-11-27T17:48:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f496a7fc700 1 --2- 172.21.15.177:0/1961276463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c072950 0x7f496c06aff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f495c009840 tx=0x7f495c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fafd051a06c8fdc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f4969ffb700 1 -- 172.21.15.177:0/1961276463 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c011830 con 0x7f496c072950 2023-11-27T17:48:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f4969ffb700 1 -- 172.21.15.177:0/1961276463 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c011990 con 0x7f496c072950 2023-11-27T17:48:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.251+0000 7f4969ffb700 1 -- 172.21.15.177:0/1961276463 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c011d20 con 0x7f496c072950 2023-11-27T17:48:51.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.252+0000 7f49714e8700 1 -- 172.21.15.177:0/1961276463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c072950 msgr2=0x7f496c06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.252+0000 7f49714e8700 1 --2- 172.21.15.177:0/1961276463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c072950 0x7f496c06aff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f495c009840 tx=0x7f495c009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.252+0000 7f49714e8700 1 -- 172.21.15.177:0/1961276463 shutdown_connections 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.252+0000 7f49714e8700 1 --2- 172.21.15.177:0/1961276463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1626e0 0x7f496c0d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.252+0000 7f49714e8700 1 --2- 172.21.15.177:0/1961276463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c072950 0x7f496c06aff0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.252+0000 7f49714e8700 1 -- 172.21.15.177:0/1961276463 >> 172.21.15.177:0/1961276463 conn(0x7f496c0b3160 msgr2=0x7f496c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.252+0000 7f49714e8700 1 -- 172.21.15.177:0/1961276463 shutdown_connections 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.252+0000 7f49714e8700 1 -- 172.21.15.177:0/1961276463 wait complete. 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.253+0000 7f49714e8700 1 Processor -- start 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.253+0000 7f49714e8700 1 -- start start 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f49714e8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f496c072950 0x7f496c145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f49714e8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1479a0 0x7f496c1458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f49714e8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c1626e0 0x7f496c1f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f49714e8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c143540 con 0x7f496c072950 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f49714e8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c1431f0 con 0x7f496c1626e0 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f49714e8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c15f9a0 con 0x7f496c1479a0 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f496c072950 0x7f496c145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496affd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f496c072950 0x7f496c145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52638/0 (socket says 172.21.15.177:52638) 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496affd700 1 -- 172.21.15.177:0/1013256233 learned_addr learned my addr 172.21.15.177:0/1013256233 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496a7fc700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1479a0 0x7f496c1458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496b7fe700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c1626e0 0x7f496c1f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496affd700 1 -- 172.21.15.177:0/1013256233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1479a0 msgr2=0x7f496c1458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496affd700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1479a0 0x7f496c1458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496affd700 1 -- 172.21.15.177:0/1013256233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c1626e0 msgr2=0x7f496c1f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496affd700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c1626e0 0x7f496c1f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.254+0000 7f496affd700 1 -- 172.21.15.177:0/1013256233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c0094a0 con 0x7f496c072950 2023-11-27T17:48:51.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.255+0000 7f496affd700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f496c072950 0x7f496c145380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f49600011e0 tx=0x7f496000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.255+0000 7f49537fe700 1 -- 172.21.15.177:0/1013256233 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960004c80 con 0x7f496c072950 2023-11-27T17:48:51.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.255+0000 7f49537fe700 1 -- 172.21.15.177:0/1013256233 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4960004e00 con 0x7f496c072950 2023-11-27T17:48:51.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.255+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c15fc80 con 0x7f496c072950 2023-11-27T17:48:51.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.255+0000 7f49537fe700 1 -- 172.21.15.177:0/1013256233 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960007310 con 0x7f496c072950 2023-11-27T17:48:51.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.255+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c1f7350 con 0x7f496c072950 2023-11-27T17:48:51.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.256+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c069400 con 0x7f496c072950 2023-11-27T17:48:51.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.256+0000 7f49537fe700 1 -- 172.21.15.177:0/1013256233 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4960007470 con 0x7f496c072950 2023-11-27T17:48:51.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.256+0000 7f49537fe700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f495806b250 0x7f495806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.257+0000 7f49537fe700 1 -- 172.21.15.177:0/1013256233 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4960089620 con 0x7f496c072950 2023-11-27T17:48:51.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.257+0000 7f496a7fc700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f495806b250 0x7f495806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.257+0000 7f496a7fc700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f495806b250 0x7f495806d710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f495c000c00 tx=0x7f495c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.261+0000 7f49537fe700 1 -- 172.21.15.177:0/1013256233 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4960054350 con 0x7f496c072950 2023-11-27T17:48:51.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.449+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f496c15fe70 con 0x7f496c072950 2023-11-27T17:48:51.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.449+0000 7f49537fe700 1 -- 172.21.15.177:0/1013256233 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4960057970 con 0x7f496c072950 2023-11-27T17:48:51.452 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:51.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f495806b250 msgr2=0x7f495806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f495806b250 0x7f495806d710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f495c000c00 tx=0x7f495c008030 comp rx=0 tx=0).stop 2023-11-27T17:48:51.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f496c072950 msgr2=0x7f496c145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f496c072950 0x7f496c145380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f49600011e0 tx=0x7f496000ca30 comp rx=0 tx=0).stop 2023-11-27T17:48:51.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 shutdown_connections 2023-11-27T17:48:51.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f495806b250 0x7f495806d710 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f496c1626e0 0x7f496c1f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f496c072950 0x7f496c145380 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 --2- 172.21.15.177:0/1013256233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f496c1479a0 0x7f496c1458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.451+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 >> 172.21.15.177:0/1013256233 conn(0x7f496c0b3160 msgr2=0x7f496c06e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:51.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.452+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 shutdown_connections 2023-11-27T17:48:51.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.452+0000 7f49714e8700 1 -- 172.21.15.177:0/1013256233 wait complete. 2023-11-27T17:48:51.466 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:51.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.585+0000 7fc785110700 1 Processor -- start 2023-11-27T17:48:51.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.586+0000 7fc785110700 1 -- start start 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.586+0000 7fc785110700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070760 0x7fc7800cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.586+0000 7fc785110700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7800afa60 0x7fc78013e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.586+0000 7fc785110700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7801417d0 con 0x7fc780070b40 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.586+0000 7fc785110700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc780141ab0 con 0x7fc7800afa60 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.586+0000 7fc785110700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc780141d90 con 0x7fc780070760 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.586+0000 7fc77e59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7800afa60 0x7fc78013e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77e59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7800afa60 0x7fc78013e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52646/0 (socket says 172.21.15.177:52646) 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77e59c700 1 -- 172.21.15.177:0/162826271 learned_addr learned my addr 172.21.15.177:0/162826271 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77ed9d700 1 --2- 172.21.15.177:0/162826271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070760 0x7fc7800cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77e59c700 1 -- 172.21.15.177:0/162826271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070760 msgr2=0x7fc7800cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77e59c700 1 --2- 172.21.15.177:0/162826271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070760 0x7fc7800cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77e59c700 1 -- 172.21.15.177:0/162826271 >> v1:172.21.15.178:6789/0 conn(0x7fc780070b40 legacy=0x7fc78015fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77e59c700 1 -- 172.21.15.177:0/162826271 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780142070 con 0x7fc7800afa60 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77ed9d700 1 --2- 172.21.15.177:0/162826271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070760 0x7fc7800cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77e59c700 1 --2- 172.21.15.177:0/162826271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7800afa60 0x7fc78013e960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc7700098f0 tx=0x7fc770009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c260a5afa6eff5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77dd9b700 1 -- 172.21.15.177:0/162826271 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000b8a0 con 0x7fc7800afa60 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77dd9b700 1 -- 172.21.15.177:0/162826271 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77000ba00 con 0x7fc7800afa60 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.587+0000 7fc77dd9b700 1 -- 172.21.15.177:0/162826271 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000bd90 con 0x7fc7800afa60 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.588+0000 7fc785110700 1 -- 172.21.15.177:0/162826271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7800afa60 msgr2=0x7fc78013e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.588+0000 7fc785110700 1 --2- 172.21.15.177:0/162826271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7800afa60 0x7fc78013e960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc7700098f0 tx=0x7fc770009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.588+0000 7fc785110700 1 -- 172.21.15.177:0/162826271 shutdown_connections 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.588+0000 7fc785110700 1 --2- 172.21.15.177:0/162826271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070760 0x7fc7800cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.588+0000 7fc785110700 1 --2- 172.21.15.177:0/162826271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7800afa60 0x7fc78013e960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.588+0000 7fc785110700 1 -- 172.21.15.177:0/162826271 >> 172.21.15.177:0/162826271 conn(0x7fc7800b38b0 msgr2=0x7fc7800b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:51.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.588+0000 7fc785110700 1 -- 172.21.15.177:0/162826271 shutdown_connections 2023-11-27T17:48:51.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.588+0000 7fc785110700 1 -- 172.21.15.177:0/162826271 wait complete. 2023-11-27T17:48:51.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.589+0000 7fc785110700 1 Processor -- start 2023-11-27T17:48:51.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.589+0000 7fc785110700 1 -- start start 2023-11-27T17:48:51.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc785110700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc780070760 0x7fc7801f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc785110700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070b40 0x7fc78013cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc785110700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7800afa60 0x7fc78013d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc785110700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78013f5d0 con 0x7fc780070760 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc785110700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780140150 con 0x7fc7800afa60 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc785110700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78013c380 con 0x7fc780070b40 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77ed9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc780070760 0x7fc7801f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77ed9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc780070760 0x7fc7801f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52650/0 (socket says 172.21.15.177:52650) 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77ed9d700 1 -- 172.21.15.177:0/3016608027 learned_addr learned my addr 172.21.15.177:0/3016608027 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77e59c700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070b40 0x7fc78013cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77f59e700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7800afa60 0x7fc78013d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77ed9d700 1 -- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070b40 msgr2=0x7fc78013cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77ed9d700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070b40 0x7fc78013cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77ed9d700 1 -- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7800afa60 msgr2=0x7fc78013d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77ed9d700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7800afa60 0x7fc78013d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77ed9d700 1 -- 172.21.15.177:0/3016608027 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc770009550 con 0x7fc780070760 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.590+0000 7fc77e59c700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070b40 0x7fc78013cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.591+0000 7fc77ed9d700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc780070760 0x7fc7801f41f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc77400e840 tx=0x7fc77400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.591+0000 7fc7677fe700 1 -- 172.21.15.177:0/3016608027 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400c020 con 0x7fc780070760 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.591+0000 7fc7677fe700 1 -- 172.21.15.177:0/3016608027 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774004250 con 0x7fc780070760 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.591+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78013f820 con 0x7fc780070760 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.591+0000 7fc7677fe700 1 -- 172.21.15.177:0/3016608027 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7740036a0 con 0x7fc780070760 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.591+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78013fde0 con 0x7fc780070760 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.592+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc780140430 con 0x7fc780070760 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.592+0000 7fc7677fe700 1 -- 172.21.15.177:0/3016608027 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc774003800 con 0x7fc780070760 2023-11-27T17:48:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.592+0000 7fc7677fe700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc76c06b250 0x7fc76c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.593+0000 7fc77e59c700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc76c06b250 0x7fc76c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.593+0000 7fc7677fe700 1 -- 172.21.15.177:0/3016608027 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7740893a0 con 0x7fc780070760 2023-11-27T17:48:51.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.593+0000 7fc77e59c700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc76c06b250 0x7fc76c06d710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7800afe80 tx=0x7fc770008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.597+0000 7fc7677fe700 1 -- 172.21.15.177:0/3016608027 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc774054160 con 0x7fc780070760 2023-11-27T17:48:51.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.785+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc780069400 con 0x7fc780070760 2023-11-27T17:48:51.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.786+0000 7fc7677fe700 1 -- 172.21.15.177:0/3016608027 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc774057780 con 0x7fc780070760 2023-11-27T17:48:51.788 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc76c06b250 msgr2=0x7fc76c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc76c06b250 0x7fc76c06d710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7800afe80 tx=0x7fc770008030 comp rx=0 tx=0).stop 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc780070760 msgr2=0x7fc7801f41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc780070760 0x7fc7801f41f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc77400e840 tx=0x7fc77400eb50 comp rx=0 tx=0).stop 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 shutdown_connections 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc76c06b250 0x7fc76c06d710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7800afa60 0x7fc78013d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc780070760 0x7fc7801f41f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 --2- 172.21.15.177:0/3016608027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc780070b40 0x7fc78013cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 >> 172.21.15.177:0/3016608027 conn(0x7fc7800b38b0 msgr2=0x7fc78006b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:51.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 shutdown_connections 2023-11-27T17:48:51.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.788+0000 7fc785110700 1 -- 172.21.15.177:0/3016608027 wait complete. 2023-11-27T17:48:51.803 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T17:48:51.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.921+0000 7f828bf64700 1 Processor -- start 2023-11-27T17:48:51.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.922+0000 7f828bf64700 1 -- start start 2023-11-27T17:48:51.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.922+0000 7f828bf64700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f828406d910 0x7f828406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.922+0000 7f828bf64700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.922+0000 7f828bf64700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828406e520 con 0x7f828406dcf0 2023-11-27T17:48:51.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.922+0000 7f828bf64700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828406efc0 con 0x7f828406d910 2023-11-27T17:48:51.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.922+0000 7f828bf64700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828406f2a0 con 0x7f828415e880 2023-11-27T17:48:51.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f8289d00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f828406d910 0x7f828406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f82894ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f8289d00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f828406d910 0x7f828406e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:60680/0 (socket says 172.21.15.177:60680) 2023-11-27T17:48:51.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f828a501700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f828406dcf0 0x7f82840b0b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:45956/0 (socket says 172.21.15.177:45956) 2023-11-27T17:48:51.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f8289d00700 1 -- 172.21.15.177:0/2882214464 learned_addr learned my addr 172.21.15.177:0/2882214464 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:51.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f82894ff700 1 -- 172.21.15.177:0/2882214464 >> v2:172.21.15.178:3300/0 conn(0x7f828406d910 msgr2=0x7f828406e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:51.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f82894ff700 1 --2- 172.21.15.177:0/2882214464 >> v2:172.21.15.178:3300/0 conn(0x7f828406d910 0x7f828406e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f82894ff700 1 -- 172.21.15.177:0/2882214464 >> v1:172.21.15.178:6789/0 conn(0x7f828406dcf0 legacy=0x7f82840b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f82894ff700 1 -- 172.21.15.177:0/2882214464 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828406f580 con 0x7f828415e880 2023-11-27T17:48:51.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f8289d00700 1 --2- 172.21.15.177:0/2882214464 >> v2:172.21.15.178:3300/0 conn(0x7f828406d910 0x7f828406e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:51.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f82894ff700 1 --2- 172.21.15.177:0/2882214464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840b05f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8280009840 tx=0x7f8280009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77fdf50b23cf7b27 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f8288cfe700 1 -- 172.21.15.177:0/2882214464 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011830 con 0x7f828415e880 2023-11-27T17:48:51.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f8288cfe700 1 -- 172.21.15.177:0/2882214464 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280011990 con 0x7f828415e880 2023-11-27T17:48:51.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.923+0000 7f8288cfe700 1 -- 172.21.15.177:0/2882214464 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011d20 con 0x7f828415e880 2023-11-27T17:48:51.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.924+0000 7f828bf64700 1 -- 172.21.15.177:0/2882214464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 msgr2=0x7f82840b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.924+0000 7f828bf64700 1 --2- 172.21.15.177:0/2882214464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840b05f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8280009840 tx=0x7f8280009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:51.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.924+0000 7f828bf64700 1 -- 172.21.15.177:0/2882214464 shutdown_connections 2023-11-27T17:48:51.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.924+0000 7f828bf64700 1 --2- 172.21.15.177:0/2882214464 >> v2:172.21.15.178:3300/0 conn(0x7f828406d910 0x7f828406e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.924+0000 7f828bf64700 1 --2- 172.21.15.177:0/2882214464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840b05f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.924+0000 7f828bf64700 1 -- 172.21.15.177:0/2882214464 >> 172.21.15.177:0/2882214464 conn(0x7f82840b2130 msgr2=0x7f82840b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:51.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.924+0000 7f828bf64700 1 -- 172.21.15.177:0/2882214464 shutdown_connections 2023-11-27T17:48:51.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.924+0000 7f828bf64700 1 -- 172.21.15.177:0/2882214464 wait complete. 2023-11-27T17:48:51.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.925+0000 7f828bf64700 1 Processor -- start 2023-11-27T17:48:51.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.925+0000 7f828bf64700 1 -- start start 2023-11-27T17:48:51.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f828bf64700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f828406d910 0x7f82841498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f828bf64700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f828406dcf0 0x7f82840afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f828bf64700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f828bf64700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8284071b00 con 0x7f828406dcf0 2023-11-27T17:48:51.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f828bf64700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8284070a30 con 0x7f828406d910 2023-11-27T17:48:51.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f828bf64700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8284071510 con 0x7f828415e880 2023-11-27T17:48:51.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f828406dcf0 0x7f82840afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f828406dcf0 0x7f82840afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52666/0 (socket says 172.21.15.177:52666) 2023-11-27T17:48:51.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 -- 172.21.15.177:0/1467770095 learned_addr learned my addr 172.21.15.177:0/1467770095 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:51.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f8289d00700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f828406d910 0x7f82841498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f828a501700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 -- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 msgr2=0x7f82840704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 -- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f828406d910 msgr2=0x7f82841498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:51.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f828406d910 0x7f82841498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:51.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 -- 172.21.15.177:0/1467770095 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274009550 con 0x7f828406dcf0 2023-11-27T17:48:51.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f8289d00700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f828406d910 0x7f82841498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.926+0000 7f82894ff700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f828406dcf0 0x7f82840afad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8280014040 tx=0x7f8280004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.927+0000 7f827a7fc700 1 -- 172.21.15.177:0/1467770095 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800036a0 con 0x7f828406dcf0 2023-11-27T17:48:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.927+0000 7f827a7fc700 1 -- 172.21.15.177:0/1467770095 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828001f070 con 0x7f828406dcf0 2023-11-27T17:48:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.927+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82800094a0 con 0x7f828406dcf0 2023-11-27T17:48:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.927+0000 7f827a7fc700 1 -- 172.21.15.177:0/1467770095 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280003a00 con 0x7f828406dcf0 2023-11-27T17:48:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.927+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8284070f50 con 0x7f828406dcf0 2023-11-27T17:48:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.928+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8284071d70 con 0x7f828406dcf0 2023-11-27T17:48:51.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.928+0000 7f827a7fc700 1 -- 172.21.15.177:0/1467770095 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8280003b60 con 0x7f828406dcf0 2023-11-27T17:48:51.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.928+0000 7f827a7fc700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f826806b250 0x7f826806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:51.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.929+0000 7f8289d00700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f826806b250 0x7f826806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:51.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.929+0000 7f827a7fc700 1 -- 172.21.15.177:0/1467770095 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8280021070 con 0x7f828406dcf0 2023-11-27T17:48:51.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.929+0000 7f8289d00700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f826806b250 0x7f826806d710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8274009ce0 tx=0x7f8274008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:51.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:51.933+0000 7f827a7fc700 1 -- 172.21.15.177:0/1467770095 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8280056040 con 0x7f828406dcf0 2023-11-27T17:48:52.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.140+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8284073aa0 con 0x7f828406dcf0 2023-11-27T17:48:52.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.140+0000 7f827a7fc700 1 -- 172.21.15.177:0/1467770095 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8280059660 con 0x7f828406dcf0 2023-11-27T17:48:52.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f826806b250 msgr2=0x7f826806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f826806b250 0x7f826806d710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8274009ce0 tx=0x7f8274008040 comp rx=0 tx=0).stop 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f828406dcf0 msgr2=0x7f82840afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f828406dcf0 0x7f82840afad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8280014040 tx=0x7f8280004750 comp rx=0 tx=0).stop 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 shutdown_connections 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f826806b250 0x7f826806d710 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f828415e880 0x7f82840704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f828406d910 0x7f82841498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 --2- 172.21.15.177:0/1467770095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f828406dcf0 0x7f82840afad0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.142+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 >> 172.21.15.177:0/1467770095 conn(0x7f82840b2130 msgr2=0x7f82840cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.143+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 shutdown_connections 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.143+0000 7f828bf64700 1 -- 172.21.15.177:0/1467770095 wait complete. 2023-11-27T17:48:52.146 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-27T17:48:52.157 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-27T17:48:52.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:52.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-27T17:48:52.213 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2023-11-27T17:48:52.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:52.213 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T17:48:52.244 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:48:52.244 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:52.261 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:48:52.262 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:52.320 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:48:52.320 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:52.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:52.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.534+0000 7f0076a0e700 1 Processor -- start 2023-11-27T17:48:52.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.534+0000 7f0076a0e700 1 -- start start 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0076a0e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 0x7f00700cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0076a0e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f00700cf7c0 0x7f00700cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0076a0e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00700cd4a0 con 0x7f007015ae00 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0076a0e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00700cfc30 con 0x7f00700cf7c0 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0076a0e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00700ca990 con 0x7f0070071cc0 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0074fab700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f00700cf7c0 0x7f00700cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f006ffff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f007015ae00 0x7f00700ccd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46990/0 (socket says 172.21.15.177:46990) 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f006ffff700 1 -- 172.21.15.177:0/796762393 learned_addr learned my addr 172.21.15.177:0/796762393 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0074fab700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f00700cf7c0 0x7f00700cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52676/0 (socket says 172.21.15.177:52676) 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f006f7fe700 1 --2- 172.21.15.177:0/796762393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 0x7f00700cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0074fab700 1 -- 172.21.15.177:0/796762393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 msgr2=0x7f00700cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0074fab700 1 --2- 172.21.15.177:0/796762393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 0x7f00700cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0074fab700 1 -- 172.21.15.177:0/796762393 >> v1:172.21.15.177:6789/0 conn(0x7f007015ae00 legacy=0x7f00700ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0074fab700 1 -- 172.21.15.177:0/796762393 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00700cd730 con 0x7f00700cf7c0 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f006effd700 1 -- 172.21.15.177:0/796762393 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664934607 0 0) 0x7f00700cd4a0 con 0x7f007015ae00 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f0074fab700 1 --2- 172.21.15.177:0/796762393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00700cf7c0 0x7f00700cb730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0068009d90 tx=0x7f006800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e2f2173f7e679c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.535+0000 7f006effd700 1 -- 172.21.15.177:0/796762393 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800e070 con 0x7f00700cf7c0 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f006effd700 1 -- 172.21.15.177:0/796762393 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006800bbd0 con 0x7f00700cf7c0 2023-11-27T17:48:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f006effd700 1 -- 172.21.15.177:0/796762393 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068012430 con 0x7f00700cf7c0 2023-11-27T17:48:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f0076a0e700 1 -- 172.21.15.177:0/796762393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00700cf7c0 msgr2=0x7f00700cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f0076a0e700 1 --2- 172.21.15.177:0/796762393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00700cf7c0 0x7f00700cb730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0068009d90 tx=0x7f006800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f0076a0e700 1 -- 172.21.15.177:0/796762393 shutdown_connections 2023-11-27T17:48:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f0076a0e700 1 --2- 172.21.15.177:0/796762393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00700cf7c0 0x7f00700cb730 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f0076a0e700 1 --2- 172.21.15.177:0/796762393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 0x7f00700cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f0076a0e700 1 -- 172.21.15.177:0/796762393 >> 172.21.15.177:0/796762393 conn(0x7f00700b15d0 msgr2=0x7f00700b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f0076a0e700 1 -- 172.21.15.177:0/796762393 shutdown_connections 2023-11-27T17:48:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.536+0000 7f0076a0e700 1 -- 172.21.15.177:0/796762393 wait complete. 2023-11-27T17:48:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.538+0000 7f0076a0e700 1 Processor -- start 2023-11-27T17:48:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.538+0000 7f0076a0e700 1 -- start start 2023-11-27T17:48:52.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0076a0e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 0x7f007013abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0076a0e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00700cf7c0 0x7f007013dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0076a0e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007015ae00 0x7f00700cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0076a0e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007014ccd0 con 0x7f007015ae00 2023-11-27T17:48:52.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0076a0e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007013e2e0 con 0x7f00700cf7c0 2023-11-27T17:48:52.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0076a0e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007014fd10 con 0x7f0070071cc0 2023-11-27T17:48:52.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007015ae00 0x7f00700cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007015ae00 0x7f00700cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52682/0 (socket says 172.21.15.177:52682) 2023-11-27T17:48:52.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 -- 172.21.15.177:0/4026967336 learned_addr learned my addr 172.21.15.177:0/4026967336 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:52.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f006ffff700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 0x7f007013abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f006f7fe700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00700cf7c0 0x7f007013dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 -- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 msgr2=0x7f007013abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 0x7f007013abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 -- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00700cf7c0 msgr2=0x7f007013dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00700cf7c0 0x7f007013dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 -- 172.21.15.177:0/4026967336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068009a70 con 0x7f007015ae00 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f006f7fe700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00700cf7c0 0x7f007013dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f0074fab700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007015ae00 0x7f00700cde90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f00700cdb70 tx=0x7f0068004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.539+0000 7f006cff9700 1 -- 172.21.15.177:0/4026967336 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068012430 con 0x7f007015ae00 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.540+0000 7f006cff9700 1 -- 172.21.15.177:0/4026967336 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068020070 con 0x7f007015ae00 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.540+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007014f750 con 0x7f007015ae00 2023-11-27T17:48:52.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.540+0000 7f006cff9700 1 -- 172.21.15.177:0/4026967336 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068004280 con 0x7f007015ae00 2023-11-27T17:48:52.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.540+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007006c7c0 con 0x7f007015ae00 2023-11-27T17:48:52.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.540+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0070069400 con 0x7f007015ae00 2023-11-27T17:48:52.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.541+0000 7f006cff9700 1 -- 172.21.15.177:0/4026967336 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f00680043e0 con 0x7f007015ae00 2023-11-27T17:48:52.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.541+0000 7f006cff9700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f005c06b250 0x7f005c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.541+0000 7f006cff9700 1 -- 172.21.15.177:0/4026967336 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0068022070 con 0x7f007015ae00 2023-11-27T17:48:52.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.541+0000 7f006ffff700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f005c06b250 0x7f005c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.542+0000 7f006ffff700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f005c06b250 0x7f005c06d710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0064000f60 tx=0x7f0064007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:52.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.546+0000 7f006cff9700 1 -- 172.21.15.177:0/4026967336 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0068056840 con 0x7f007015ae00 2023-11-27T17:48:52.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.735+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0070159d70 con 0x7f007015ae00 2023-11-27T17:48:52.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.736+0000 7f006cff9700 1 -- 172.21.15.177:0/4026967336 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f0068059e60 con 0x7f007015ae00 2023-11-27T17:48:52.739 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:52.739 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:52.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.738+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f005c06b250 msgr2=0x7f005c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.738+0000 7f0076a0e700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f005c06b250 0x7f005c06d710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0064000f60 tx=0x7f0064007e70 comp rx=0 tx=0).stop 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007015ae00 msgr2=0x7f00700cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007015ae00 0x7f00700cde90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f00700cdb70 tx=0x7f0068004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 shutdown_connections 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f005c06b250 0x7f005c06d710 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007015ae00 0x7f00700cde90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070071cc0 0x7f007013abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 --2- 172.21.15.177:0/4026967336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00700cf7c0 0x7f007013dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 >> 172.21.15.177:0/4026967336 conn(0x7f00700b15d0 msgr2=0x7f0070159570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 shutdown_connections 2023-11-27T17:48:52.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.739+0000 7f0076a0e700 1 -- 172.21.15.177:0/4026967336 wait complete. 2023-11-27T17:48:52.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:52.754 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:52.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.876+0000 7f1aeccc7700 1 Processor -- start 2023-11-27T17:48:52.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.876+0000 7f1aeccc7700 1 -- start start 2023-11-27T17:48:52.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.877+0000 7f1aeccc7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ae813eb80 0x7f1ae80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.877+0000 7f1aeccc7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae8141bc0 0x7f1ae815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.877+0000 7f1aeccc7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae80cf720 con 0x7f1ae813ef60 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.877+0000 7f1aeccc7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae815d420 con 0x7f1ae813eb80 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.877+0000 7f1aeccc7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae815d140 con 0x7f1ae8141bc0 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.877+0000 7f1ae659c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ae813eb80 0x7f1ae80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.877+0000 7f1ae6d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae8141bc0 0x7f1ae815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae6d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae8141bc0 0x7f1ae815c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:40156/0 (socket says 172.21.15.177:40156) 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae659c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ae813eb80 0x7f1ae80cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:60708/0 (socket says 172.21.15.177:60708) 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae6d9d700 1 -- 172.21.15.177:0/4220712713 learned_addr learned my addr 172.21.15.177:0/4220712713 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae6d9d700 1 -- 172.21.15.177:0/4220712713 >> v2:172.21.15.178:3300/0 conn(0x7f1ae813eb80 msgr2=0x7f1ae80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae6d9d700 1 --2- 172.21.15.177:0/4220712713 >> v2:172.21.15.178:3300/0 conn(0x7f1ae813eb80 0x7f1ae80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae6d9d700 1 -- 172.21.15.177:0/4220712713 >> v1:172.21.15.178:6789/0 conn(0x7f1ae813ef60 legacy=0x7f1ae81414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae6d9d700 1 -- 172.21.15.177:0/4220712713 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80ce700 con 0x7f1ae8141bc0 2023-11-27T17:48:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae6d9d700 1 --2- 172.21.15.177:0/4220712713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae8141bc0 0x7f1ae815c3e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009e50 tx=0x7f1ae000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a371e83e88e135a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae559a700 1 -- 172.21.15.177:0/4220712713 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000e070 con 0x7f1ae8141bc0 2023-11-27T17:48:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae559a700 1 -- 172.21.15.177:0/4220712713 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000b910 con 0x7f1ae8141bc0 2023-11-27T17:48:52.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.878+0000 7f1ae559a700 1 -- 172.21.15.177:0/4220712713 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000bcc0 con 0x7f1ae8141bc0 2023-11-27T17:48:52.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.879+0000 7f1aeccc7700 1 -- 172.21.15.177:0/4220712713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae8141bc0 msgr2=0x7f1ae815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.879+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/4220712713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae8141bc0 0x7f1ae815c3e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009e50 tx=0x7f1ae000b330 comp rx=0 tx=0).stop 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.879+0000 7f1aeccc7700 1 -- 172.21.15.177:0/4220712713 shutdown_connections 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.879+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/4220712713 >> v2:172.21.15.178:3300/0 conn(0x7f1ae813eb80 0x7f1ae80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.879+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/4220712713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae8141bc0 0x7f1ae815c3e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.879+0000 7f1aeccc7700 1 -- 172.21.15.177:0/4220712713 >> 172.21.15.177:0/4220712713 conn(0x7f1ae80b31d0 msgr2=0x7f1ae80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.879+0000 7f1aeccc7700 1 -- 172.21.15.177:0/4220712713 shutdown_connections 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.879+0000 7f1aeccc7700 1 -- 172.21.15.177:0/4220712713 wait complete. 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.880+0000 7f1aeccc7700 1 Processor -- start 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.880+0000 7f1aeccc7700 1 -- start start 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1aeccc7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae813eb80 0x7f1ae8155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1aeccc7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ae8141bc0 0x7f1ae8154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1aeccc7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae8152ff0 0x7f1ae813a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1aeccc7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8154590 con 0x7f1ae8141bc0 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1aeccc7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae81553d0 con 0x7f1ae8152ff0 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1aeccc7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8072fc0 con 0x7f1ae813eb80 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1ae5d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ae8141bc0 0x7f1ae8154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1ae5d9b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ae8141bc0 0x7f1ae8154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52694/0 (socket says 172.21.15.177:52694) 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1ae5d9b700 1 -- 172.21.15.177:0/2335129193 learned_addr learned my addr 172.21.15.177:0/2335129193 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1ae659c700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae813eb80 0x7f1ae8155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.881+0000 7f1ae6d9d700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae8152ff0 0x7f1ae813a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ae5d9b700 1 -- 172.21.15.177:0/2335129193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae813eb80 msgr2=0x7f1ae8155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ae5d9b700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae813eb80 0x7f1ae8155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ae5d9b700 1 -- 172.21.15.177:0/2335129193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae8152ff0 msgr2=0x7f1ae813a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ae5d9b700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae8152ff0 0x7f1ae813a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:52.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ae5d9b700 1 -- 172.21.15.177:0/2335129193 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0009b30 con 0x7f1ae8141bc0 2023-11-27T17:48:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ae5d9b700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ae8141bc0 0x7f1ae8154050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c480 tx=0x7f1ad800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ad6ffd700 1 -- 172.21.15.177:0/2335129193 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80052d0 con 0x7f1ae8141bc0 2023-11-27T17:48:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae81547c0 con 0x7f1ae8141bc0 2023-11-27T17:48:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ad6ffd700 1 -- 172.21.15.177:0/2335129193 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8005430 con 0x7f1ae8141bc0 2023-11-27T17:48:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1ad6ffd700 1 -- 172.21.15.177:0/2335129193 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80038c0 con 0x7f1ae8141bc0 2023-11-27T17:48:52.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.882+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae8154d80 con 0x7f1ae8141bc0 2023-11-27T17:48:52.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.883+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae8069400 con 0x7f1ae8141bc0 2023-11-27T17:48:52.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.883+0000 7f1ad6ffd700 1 -- 172.21.15.177:0/2335129193 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1ad8003a20 con 0x7f1ae8141bc0 2023-11-27T17:48:52.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.884+0000 7f1ad6ffd700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1ac806b250 0x7f1ac806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:52.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.884+0000 7f1ad6ffd700 1 -- 172.21.15.177:0/2335129193 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ad8088d30 con 0x7f1ae8141bc0 2023-11-27T17:48:52.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.884+0000 7f1ae659c700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1ac806b250 0x7f1ac806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:52.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.884+0000 7f1ae659c700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1ac806b250 0x7f1ac806d710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009be0 tx=0x7f1adc009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:52.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:52.888+0000 7f1ad6ffd700 1 -- 172.21.15.177:0/2335129193 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1ad80539e0 con 0x7f1ae8141bc0 2023-11-27T17:48:53.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.077+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ae8155510 con 0x7f1ae8141bc0 2023-11-27T17:48:53.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.077+0000 7f1ad6ffd700 1 -- 172.21.15.177:0/2335129193 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ad8057000 con 0x7f1ae8141bc0 2023-11-27T17:48:53.080 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1ac806b250 msgr2=0x7f1ac806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1ac806b250 0x7f1ac806d710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009be0 tx=0x7f1adc009210 comp rx=0 tx=0).stop 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ae8141bc0 msgr2=0x7f1ae8154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ae8141bc0 0x7f1ae8154050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c480 tx=0x7f1ad800c790 comp rx=0 tx=0).stop 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 shutdown_connections 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f1ac806b250 0x7f1ac806d710 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae8152ff0 0x7f1ae813a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae813eb80 0x7f1ae8155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 --2- 172.21.15.177:0/2335129193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ae8141bc0 0x7f1ae8154050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 >> 172.21.15.177:0/2335129193 conn(0x7f1ae80b31d0 msgr2=0x7f1ae813f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:53.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 shutdown_connections 2023-11-27T17:48:53.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.079+0000 7f1aeccc7700 1 -- 172.21.15.177:0/2335129193 wait complete. 2023-11-27T17:48:53.093 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.214+0000 7f2b730d0700 1 Processor -- start 2023-11-27T17:48:53.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.214+0000 7f2b730d0700 1 -- start start 2023-11-27T17:48:53.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b730d0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2b6c0cdff0 0x7f2b6c162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b730d0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c162bc0 con 0x7f2b6c146f00 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b730d0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c0b0110 con 0x7f2b6c0afc30 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b730d0700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c1472e0 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6bfff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2b6c0cdff0 0x7f2b6c162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b70e6c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2b6c146f00 0x7f2b6c0cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47018/0 (socket says 172.21.15.177:47018) 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6bfff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2b6c0cdff0 0x7f2b6c162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52702/0 (socket says 172.21.15.177:52702) 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b70e6c700 1 -- 172.21.15.177:0/107378460 learned_addr learned my addr 172.21.15.177:0/107378460 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6bfff700 1 -- 172.21.15.177:0/107378460 >> v1:172.21.15.178:6789/0 conn(0x7f2b6c0afc30 legacy=0x7f2b6c0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6bfff700 1 -- 172.21.15.177:0/107378460 >> v1:172.21.15.177:6789/0 conn(0x7f2b6c146f00 legacy=0x7f2b6c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6bfff700 1 -- 172.21.15.177:0/107378460 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c0b03f0 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6b7fe700 1 -- 172.21.15.177:0/107378460 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611245666 0 0) 0x7f2b6c162bc0 con 0x7f2b6c146f00 2023-11-27T17:48:53.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6bfff700 1 --2- 172.21.15.177:0/107378460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c162680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009840 tx=0x7f2b58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d0a823c85b70e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6b7fe700 1 -- 172.21.15.177:0/107378460 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58011830 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6b7fe700 1 -- 172.21.15.177:0/107378460 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b58011990 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.215+0000 7f2b6b7fe700 1 -- 172.21.15.177:0/107378460 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58011d20 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.216+0000 7f2b730d0700 1 -- 172.21.15.177:0/107378460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 msgr2=0x7f2b6c162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.216+0000 7f2b730d0700 1 --2- 172.21.15.177:0/107378460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c162680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009840 tx=0x7f2b58009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.216+0000 7f2b730d0700 1 -- 172.21.15.177:0/107378460 shutdown_connections 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.216+0000 7f2b730d0700 1 --2- 172.21.15.177:0/107378460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c162680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.216+0000 7f2b730d0700 1 -- 172.21.15.177:0/107378460 >> 172.21.15.177:0/107378460 conn(0x7f2b6c0b38b0 msgr2=0x7f2b6c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.216+0000 7f2b730d0700 1 -- 172.21.15.177:0/107378460 shutdown_connections 2023-11-27T17:48:53.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.216+0000 7f2b730d0700 1 -- 172.21.15.177:0/107378460 wait complete. 2023-11-27T17:48:53.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.217+0000 7f2b730d0700 1 Processor -- start 2023-11-27T17:48:53.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.217+0000 7f2b730d0700 1 -- start start 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b730d0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b6c0afc30 0x7f2b6c145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b730d0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c1407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b730d0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b6c146f00 0x7f2b6c140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b730d0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c146190 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b730d0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c140ce0 con 0x7f2b6c146f00 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b730d0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c145bd0 con 0x7f2b6c0afc30 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b6bfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c1407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b6bfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c1407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52708/0 (socket says 172.21.15.177:52708) 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b6bfff700 1 -- 172.21.15.177:0/2238187567 learned_addr learned my addr 172.21.15.177:0/2238187567 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:53.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b70e6c700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b6c0afc30 0x7f2b6c145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b7166d700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b6c146f00 0x7f2b6c140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b6bfff700 1 -- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b6c0afc30 msgr2=0x7f2b6c145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b6bfff700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b6c0afc30 0x7f2b6c145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b6bfff700 1 -- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b6c146f00 msgr2=0x7f2b6c140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b6bfff700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b6c146f00 0x7f2b6c140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b6bfff700 1 -- 172.21.15.177:0/2238187567 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580094a0 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b70e6c700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b6c0afc30 0x7f2b6c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.218+0000 7f2b7166d700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b6c146f00 0x7f2b6c140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.219+0000 7f2b6bfff700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c1407a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2b58014040 tx=0x7f2b58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.219+0000 7f2b697fa700 1 -- 172.21.15.177:0/2238187567 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5801a980 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.219+0000 7f2b697fa700 1 -- 172.21.15.177:0/2238187567 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5801ab00 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.219+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c145eb0 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.219+0000 7f2b697fa700 1 -- 172.21.15.177:0/2238187567 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58024420 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.219+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c0723d0 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.220+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c071f50 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.220+0000 7f2b697fa700 1 -- 172.21.15.177:0/2238187567 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2b58022070 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.221+0000 7f2b697fa700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b5006b250 0x7f2b5006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.221+0000 7f2b697fa700 1 -- 172.21.15.177:0/2238187567 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b5808abc0 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.221+0000 7f2b70e6c700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b5006b250 0x7f2b5006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.221+0000 7f2b70e6c700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b5006b250 0x7f2b5006d710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000f60 tx=0x7f2b60007ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.225+0000 7f2b697fa700 1 -- 172.21.15.177:0/2238187567 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2b6c071f50 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.415+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b6c071f50 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.416+0000 7f2b697fa700 1 -- 172.21.15.177:0/2238187567 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b58029020 con 0x7f2b6c0cdff0 2023-11-27T17:48:53.418 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:53.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.417+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b5006b250 msgr2=0x7f2b5006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.417+0000 7f2b730d0700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b5006b250 0x7f2b5006d710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000f60 tx=0x7f2b60007ce0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.417+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 msgr2=0x7f2b6c1407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.417+0000 7f2b730d0700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c1407a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2b58014040 tx=0x7f2b58004750 comp rx=0 tx=0).stop 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.418+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 shutdown_connections 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.418+0000 7f2b730d0700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b5006b250 0x7f2b5006d710 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.418+0000 7f2b730d0700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b6c146f00 0x7f2b6c140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.418+0000 7f2b730d0700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b6c0afc30 0x7f2b6c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.418+0000 7f2b730d0700 1 --2- 172.21.15.177:0/2238187567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b6c0cdff0 0x7f2b6c1407a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.418+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 >> 172.21.15.177:0/2238187567 conn(0x7f2b6c0b38b0 msgr2=0x7f2b6c1601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.418+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 shutdown_connections 2023-11-27T17:48:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.418+0000 7f2b730d0700 1 -- 172.21.15.177:0/2238187567 wait complete. 2023-11-27T17:48:53.433 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:53.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.554+0000 7feda870e700 1 Processor -- start 2023-11-27T17:48:53.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.554+0000 7feda870e700 1 -- start start 2023-11-27T17:48:53.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.555+0000 7feda870e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda0070c00 0x7feda0072650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.555+0000 7feda870e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00ce2f0 con 0x7feda00afa60 2023-11-27T17:48:53.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.555+0000 7feda870e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda0142450 con 0x7feda013ee30 2023-11-27T17:48:53.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.555+0000 7feda870e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda0141840 con 0x7feda0070c00 2023-11-27T17:48:53.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.555+0000 7feda5ca9700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7feda00afa60 0x7feda00704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47034/0 (socket says 172.21.15.177:47034) 2023-11-27T17:48:53.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda5ca9700 1 -- 172.21.15.177:0/1240999400 learned_addr learned my addr 172.21.15.177:0/1240999400 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:53.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102195394 0 0) 0x7feda00ce2f0 con 0x7feda00afa60 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed8c0035b0 con 0x7feda00afa60 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda6cab700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda0070c00 0x7feda0072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2458477851 0 0) 0x7fed8c0035b0 con 0x7feda00afa60 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda0070c00 msgr2=0x7feda0072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda0070c00 0x7feda0072650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 >> v1:172.21.15.178:6789/0 conn(0x7feda013ee30 legacy=0x7feda00cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0141b20 con 0x7feda00afa60 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fed9c001670 con 0x7feda00afa60 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 >> v1:172.21.15.177:6789/0 conn(0x7feda00afa60 legacy=0x7feda00704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed8c003a30 0x7fed8c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda0070c00 0x7fed8c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7fed8c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda0141840 con 0x7fed8c004d90 2023-11-27T17:48:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c00bb70 con 0x7fed8c003a30 2023-11-27T17:48:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c00bd30 con 0x7feda0070c00 2023-11-27T17:48:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda6cab700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7fed8c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda5ca9700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda0070c00 0x7fed8c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda64aa700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed8c003a30 0x7fed8c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda6cab700 1 -- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda0070c00 msgr2=0x7fed8c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:53.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda6cab700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda0070c00 0x7fed8c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda6cab700 1 -- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed8c003a30 msgr2=0x7fed8c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda6cab700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed8c003a30 0x7fed8c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.556+0000 7feda6cab700 1 -- 172.21.15.177:0/1240999400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0035b0 con 0x7fed8c004d90 2023-11-27T17:48:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda6cab700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7fed8c005210 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feda00ceae0 tx=0x7fed8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9a7409980708e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9800ebd0 con 0x7fed8c004d90 2023-11-27T17:48:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9800f040 con 0x7fed8c004d90 2023-11-27T17:48:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda54a8700 1 -- 172.21.15.177:0/1240999400 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98014480 con 0x7fed8c004d90 2023-11-27T17:48:53.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda870e700 1 -- 172.21.15.177:0/1240999400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 msgr2=0x7fed8c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda870e700 1 --2- 172.21.15.177:0/1240999400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7fed8c005210 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feda00ceae0 tx=0x7fed8c005880 comp rx=0 tx=0).stop 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda6cab700 1 -- 172.21.15.177:0/1240999400 reap_dead start 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda870e700 1 -- 172.21.15.177:0/1240999400 shutdown_connections 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda870e700 1 -- 172.21.15.177:0/1240999400 >> 172.21.15.177:0/1240999400 conn(0x7feda00b38b0 msgr2=0x7feda00b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda870e700 1 -- 172.21.15.177:0/1240999400 shutdown_connections 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.557+0000 7feda870e700 1 -- 172.21.15.177:0/1240999400 wait complete. 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda870e700 1 Processor -- start 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda870e700 1 -- start start 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda870e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7feda013dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda870e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda015ba30 0x7feda015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda870e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feda01f6fb0 0x7feda01f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda870e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda015c3f0 con 0x7fed8c004d90 2023-11-27T17:48:53.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda870e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda006e2e0 con 0x7feda01f6fb0 2023-11-27T17:48:53.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda870e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda006d740 con 0x7feda015ba30 2023-11-27T17:48:53.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda64aa700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7feda013dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.559+0000 7feda64aa700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7feda013dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52726/0 (socket says 172.21.15.177:52726) 2023-11-27T17:48:53.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda64aa700 1 -- 172.21.15.177:0/1656904187 learned_addr learned my addr 172.21.15.177:0/1656904187 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:53.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda6cab700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feda01f6fb0 0x7feda01f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda5ca9700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda015ba30 0x7feda015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda64aa700 1 -- 172.21.15.177:0/1656904187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda015ba30 msgr2=0x7feda015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda64aa700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda015ba30 0x7feda015beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda64aa700 1 -- 172.21.15.177:0/1656904187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feda01f6fb0 msgr2=0x7feda01f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda64aa700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feda01f6fb0 0x7feda01f7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda64aa700 1 -- 172.21.15.177:0/1656904187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda006d9b0 con 0x7fed8c004d90 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda64aa700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7feda013dc30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed9000f7f0 tx=0x7fed9000fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7fed96ffd700 1 -- 172.21.15.177:0/1656904187 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900052e0 con 0x7fed8c004d90 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7fed96ffd700 1 -- 172.21.15.177:0/1656904187 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90005440 con 0x7fed8c004d90 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda006dc90 con 0x7fed8c004d90 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7fed96ffd700 1 -- 172.21.15.177:0/1656904187 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900038c0 con 0x7fed8c004d90 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.560+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda01f79a0 con 0x7fed8c004d90 2023-11-27T17:48:53.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.561+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda006e5c0 con 0x7fed8c004d90 2023-11-27T17:48:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.562+0000 7fed96ffd700 1 -- 172.21.15.177:0/1656904187 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fed90003a20 con 0x7fed8c004d90 2023-11-27T17:48:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.562+0000 7fed96ffd700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed8406b250 0x7fed8406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.562+0000 7fed96ffd700 1 -- 172.21.15.177:0/1656904187 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed9008a220 con 0x7fed8c004d90 2023-11-27T17:48:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.562+0000 7feda5ca9700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed8406b250 0x7fed8406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.563+0000 7feda5ca9700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed8406b250 0x7fed8406d710 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feda013f610 tx=0x7fed9c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.566+0000 7fed96ffd700 1 -- 172.21.15.177:0/1656904187 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fed90054f30 con 0x7fed8c004d90 2023-11-27T17:48:53.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.756+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feda0069400 con 0x7fed8c004d90 2023-11-27T17:48:53.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.756+0000 7fed96ffd700 1 -- 172.21.15.177:0/1656904187 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed90058550 con 0x7fed8c004d90 2023-11-27T17:48:53.759 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:53.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed8406b250 msgr2=0x7fed8406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed8406b250 0x7fed8406d710 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feda013f610 tx=0x7fed9c007980 comp rx=0 tx=0).stop 2023-11-27T17:48:53.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 msgr2=0x7feda013dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7feda013dc30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed9000f7f0 tx=0x7fed9000fb00 comp rx=0 tx=0).stop 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 shutdown_connections 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fed8406b250 0x7fed8406d710 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feda01f6fb0 0x7feda01f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed8c004d90 0x7feda013dc30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 --2- 172.21.15.177:0/1656904187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feda015ba30 0x7feda015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 >> 172.21.15.177:0/1656904187 conn(0x7feda00b38b0 msgr2=0x7feda00cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 shutdown_connections 2023-11-27T17:48:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.759+0000 7feda870e700 1 -- 172.21.15.177:0/1656904187 wait complete. 2023-11-27T17:48:53.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T17:48:53.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.892+0000 7ff89d0c0700 1 Processor -- start 2023-11-27T17:48:53.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.892+0000 7ff89d0c0700 1 -- start start 2023-11-27T17:48:53.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.892+0000 7ff89d0c0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8980cf3c0 0x7ff8980b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff89d0c0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8980b2af0 con 0x7ff8980b2690 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff89d0c0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8981607a0 con 0x7ff898160350 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff89d0c0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8981609e0 con 0x7ff8980cf3c0 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff89659c700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff8980b2690 0x7ff89815fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47054/0 (socket says 172.21.15.177:47054) 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff89659c700 1 -- 172.21.15.177:0/2467320268 learned_addr learned my addr 172.21.15.177:0/2467320268 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff896d9d700 1 --2- 172.21.15.177:0/2467320268 >> v2:172.21.15.178:3300/0 conn(0x7ff8980cf3c0 0x7ff8980b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff895d9b700 1 -- 172.21.15.177:0/2467320268 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915370440 0 0) 0x7ff8980b2af0 con 0x7ff8980b2690 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff895d9b700 1 -- 172.21.15.177:0/2467320268 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8800035b0 con 0x7ff8980b2690 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff895d9b700 1 -- 172.21.15.177:0/2467320268 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3374260293 0 0) 0x7ff8800035b0 con 0x7ff8980b2690 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff896d9d700 1 -- 172.21.15.177:0/2467320268 >> v1:172.21.15.178:6789/0 conn(0x7ff898160350 legacy=0x7ff898144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff896d9d700 1 -- 172.21.15.177:0/2467320268 >> v1:172.21.15.177:6789/0 conn(0x7ff8980b2690 legacy=0x7ff89815fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff896d9d700 1 -- 172.21.15.177:0/2467320268 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8980b7490 con 0x7ff8980cf3c0 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.893+0000 7ff896d9d700 1 --2- 172.21.15.177:0/2467320268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980cf3c0 0x7ff8980b2150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff888009840 tx=0x7ff888009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4df97acab3f4749d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff895d9b700 1 -- 172.21.15.177:0/2467320268 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c001670 con 0x7ff8980cf3c0 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff895d9b700 1 -- 172.21.15.177:0/2467320268 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888004030 con 0x7ff8980cf3c0 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff895d9b700 1 -- 172.21.15.177:0/2467320268 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880043a0 con 0x7ff8980cf3c0 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff89d0c0700 1 -- 172.21.15.177:0/2467320268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980cf3c0 msgr2=0x7ff8980b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff89d0c0700 1 --2- 172.21.15.177:0/2467320268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980cf3c0 0x7ff8980b2150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff888009840 tx=0x7ff888009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff89d0c0700 1 -- 172.21.15.177:0/2467320268 shutdown_connections 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff89d0c0700 1 --2- 172.21.15.177:0/2467320268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980cf3c0 0x7ff8980b2150 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff89d0c0700 1 -- 172.21.15.177:0/2467320268 >> 172.21.15.177:0/2467320268 conn(0x7ff898072190 msgr2=0x7ff8980725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff89d0c0700 1 -- 172.21.15.177:0/2467320268 shutdown_connections 2023-11-27T17:48:53.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.894+0000 7ff89d0c0700 1 -- 172.21.15.177:0/2467320268 wait complete. 2023-11-27T17:48:53.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89d0c0700 1 Processor -- start 2023-11-27T17:48:53.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89d0c0700 1 -- start start 2023-11-27T17:48:53.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89d0c0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980b2690 0x7ff89814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89d0c0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8980cf3c0 0x7ff898152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89d0c0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff898160350 0x7ff8981f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89d0c0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89814f870 con 0x7ff8980cf3c0 2023-11-27T17:48:53.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89d0c0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89814f280 con 0x7ff8980b2690 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89d0c0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981f25e0 con 0x7ff898160350 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89659c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8980cf3c0 0x7ff898152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89659c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8980cf3c0 0x7ff898152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52740/0 (socket says 172.21.15.177:52740) 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.896+0000 7ff89659c700 1 -- 172.21.15.177:0/3755556317 learned_addr learned my addr 172.21.15.177:0/3755556317 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff896d9d700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980b2690 0x7ff89814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89759e700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff898160350 0x7ff8981f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89659c700 1 -- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff898160350 msgr2=0x7ff8981f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89659c700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff898160350 0x7ff8981f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89659c700 1 -- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980b2690 msgr2=0x7ff89814fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89659c700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980b2690 0x7ff89814fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:53.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89659c700 1 -- 172.21.15.177:0/3755556317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880094a0 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff896d9d700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980b2690 0x7ff89814fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89659c700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8980cf3c0 0x7ff898152020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00c520 tx=0x7ff88c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff87f7fe700 1 -- 172.21.15.177:0/3755556317 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c004c80 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff87f7fe700 1 -- 172.21.15.177:0/3755556317 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c004e20 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8981f28c0 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff87f7fe700 1 -- 172.21.15.177:0/3755556317 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c007310 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.897+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8981501d0 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.898+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff898073aa0 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.898+0000 7ff87f7fe700 1 -- 172.21.15.177:0/3755556317 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff88c007470 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.899+0000 7ff87f7fe700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff88406b250 0x7ff88406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.899+0000 7ff87f7fe700 1 -- 172.21.15.177:0/3755556317 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff88c0898c0 con 0x7ff8980cf3c0 2023-11-27T17:48:53.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.899+0000 7ff896d9d700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff88406b250 0x7ff88406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:53.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.899+0000 7ff896d9d700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff88406b250 0x7ff88406d710 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8880090b0 tx=0x7ff888008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:53.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:53.903+0000 7ff87f7fe700 1 -- 172.21.15.177:0/3755556317 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff88c054550 con 0x7ff8980cf3c0 2023-11-27T17:48:54.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.111+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff89814f9b0 con 0x7ff8980cf3c0 2023-11-27T17:48:54.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.112+0000 7ff87f7fe700 1 -- 172.21.15.177:0/3755556317 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff89814f9b0 con 0x7ff8980cf3c0 2023-11-27T17:48:54.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.113+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff88406b250 msgr2=0x7ff88406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff88406b250 0x7ff88406d710 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8880090b0 tx=0x7ff888008030 comp rx=0 tx=0).stop 2023-11-27T17:48:54.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8980cf3c0 msgr2=0x7ff898152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8980cf3c0 0x7ff898152020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00c520 tx=0x7ff88c00c8e0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 shutdown_connections 2023-11-27T17:48:54.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff88406b250 0x7ff88406d710 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff898160350 0x7ff8981f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8980b2690 0x7ff89814fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 --2- 172.21.15.177:0/3755556317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8980cf3c0 0x7ff898152020 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 >> 172.21.15.177:0/3755556317 conn(0x7ff898072190 msgr2=0x7ff89806d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:54.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 shutdown_connections 2023-11-27T17:48:54.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.114+0000 7ff89d0c0700 1 -- 172.21.15.177:0/3755556317 wait complete. 2023-11-27T17:48:54.119 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-27T17:48:54.128 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-27T17:48:54.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:54.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-27T17:48:54.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-11-27T17:48:54.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:54.165 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-27T17:48:54.222 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:48:54.222 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:54.243 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:48:54.243 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:54.303 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-27T17:48:54.304 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:48:54.364 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:54.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.482+0000 7f5e45baf700 1 Processor -- start 2023-11-27T17:48:54.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.482+0000 7f5e45baf700 1 -- start start 2023-11-27T17:48:54.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.482+0000 7f5e45baf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5e40160350 0x7f5e40144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.482+0000 7f5e45baf700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e40160780 con 0x7f5e400cf3c0 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.482+0000 7f5e45baf700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400b7490 con 0x7f5e400b2860 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.482+0000 7f5e45baf700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e401609e0 con 0x7f5e40160350 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3f7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5e400cf3c0 0x7f5e400b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47066/0 (socket says 172.21.15.177:47066) 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3f7fe700 1 -- 172.21.15.177:0/1166368332 learned_addr learned my addr 172.21.15.177:0/1166368332 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3ffff700 1 --2- 172.21.15.177:0/1166368332 >> v2:172.21.15.178:3300/0 conn(0x7f5e40160350 0x7f5e40144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633370533 0 0) 0x7f5e40160780 con 0x7f5e400cf3c0 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e2c0035b0 con 0x7f5e400cf3c0 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246823009 0 0) 0x7f5e400b7490 con 0x7f5e400b2860 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e40160780 con 0x7f5e400b2860 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2950038692 0 0) 0x7f5e2c0035b0 con 0x7f5e400cf3c0 2023-11-27T17:48:54.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 >> v2:172.21.15.178:3300/0 conn(0x7f5e40160350 msgr2=0x7f5e40144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 --2- 172.21.15.177:0/1166368332 >> v2:172.21.15.178:3300/0 conn(0x7f5e40160350 0x7f5e40144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 >> v1:172.21.15.178:6789/0 conn(0x7f5e400b2860 legacy=0x7f5e4015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400d0f40 con 0x7f5e400cf3c0 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f5e30001670 con 0x7f5e400cf3c0 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 >> v1:172.21.15.177:6789/0 conn(0x7f5e400cf3c0 legacy=0x7f5e400b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2c003b90 0x7f5e2c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c004850 0x7f5e2c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e2c005210 0x7f5e2c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401609e0 con 0x7f5e2c005210 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c00c090 con 0x7f5e2c003b90 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c00c250 con 0x7f5e2c004850 2023-11-27T17:48:54.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3ffff700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e2c005210 0x7f5e2c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e3f7fe700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2c003b90 0x7f5e2c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.483+0000 7f5e37fff700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c004850 0x7f5e2c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3ffff700 1 -- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c004850 msgr2=0x7f5e2c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3ffff700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c004850 0x7f5e2c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3ffff700 1 -- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2c003b90 msgr2=0x7f5e2c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3ffff700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2c003b90 0x7f5e2c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3ffff700 1 -- 172.21.15.177:0/1166368332 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0035b0 con 0x7f5e2c005210 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e37fff700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c004850 0x7f5e2c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3ffff700 1 -- 172.21.15.177:0/1166368332 reap_dead start 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3ffff700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e2c005210 0x7f5e2c00ba10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009fc0 tx=0x7f5e2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684c792dc81f02e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38003a20 con 0x7f5e2c005210 2023-11-27T17:48:54.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800f040 con 0x7f5e2c005210 2023-11-27T17:48:54.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e3effd700 1 -- 172.21.15.177:0/1166368332 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38003da0 con 0x7f5e2c005210 2023-11-27T17:48:54.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e45baf700 1 -- 172.21.15.177:0/1166368332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e2c005210 msgr2=0x7f5e2c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e45baf700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e2c005210 0x7f5e2c00ba10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009fc0 tx=0x7f5e2c005880 comp rx=0 tx=0).stop 2023-11-27T17:48:54.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e45baf700 1 -- 172.21.15.177:0/1166368332 shutdown_connections 2023-11-27T17:48:54.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.484+0000 7f5e45baf700 1 --2- 172.21.15.177:0/1166368332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e2c005210 0x7f5e2c00ba10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.485+0000 7f5e45baf700 1 -- 172.21.15.177:0/1166368332 >> 172.21.15.177:0/1166368332 conn(0x7f5e40072190 msgr2=0x7f5e400725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:54.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.485+0000 7f5e45baf700 1 -- 172.21.15.177:0/1166368332 shutdown_connections 2023-11-27T17:48:54.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.485+0000 7f5e45baf700 1 -- 172.21.15.177:0/1166368332 wait complete. 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.486+0000 7f5e45baf700 1 Processor -- start 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.486+0000 7f5e45baf700 1 -- start start 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.486+0000 7f5e45baf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c005210 0x7f5e4015f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.486+0000 7f5e45baf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4015fb20 0x7f5e401f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.486+0000 7f5e45baf700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e401f24f0 0x7f5e401f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.486+0000 7f5e45baf700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40150970 con 0x7f5e401f24f0 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.486+0000 7f5e45baf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4015ffa0 con 0x7f5e4015fb20 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.486+0000 7f5e45baf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4014e190 con 0x7f5e2c005210 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e401f24f0 0x7f5e401f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e401f24f0 0x7f5e401f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52764/0 (socket says 172.21.15.177:52764) 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 -- 172.21.15.177:0/3790977699 learned_addr learned my addr 172.21.15.177:0/3790977699 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e37fff700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4015fb20 0x7f5e401f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3f7fe700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c005210 0x7f5e4015f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 -- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c005210 msgr2=0x7f5e4015f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c005210 0x7f5e4015f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 -- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4015fb20 msgr2=0x7f5e401f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4015fb20 0x7f5e401f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 -- 172.21.15.177:0/3790977699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40157dd0 con 0x7f5e401f24f0 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3f7fe700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c005210 0x7f5e4015f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3ffff700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e401f24f0 0x7f5e401f5090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800e700 tx=0x7f5e38009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3cff9700 1 -- 172.21.15.177:0/3790977699 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38024070 con 0x7f5e401f24f0 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3cff9700 1 -- 172.21.15.177:0/3790977699 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e38003e90 con 0x7f5e401f24f0 2023-11-27T17:48:54.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e3cff9700 1 -- 172.21.15.177:0/3790977699 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38004250 con 0x7f5e401f24f0 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4014fcf0 con 0x7f5e401f24f0 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.487+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e401502b0 con 0x7f5e401f24f0 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.488+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e40150be0 con 0x7f5e401f24f0 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.489+0000 7f5e3cff9700 1 -- 172.21.15.177:0/3790977699 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5e380043b0 con 0x7f5e401f24f0 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.489+0000 7f5e3cff9700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5e2006b250 0x7f5e2006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.489+0000 7f5e3cff9700 1 -- 172.21.15.177:0/3790977699 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e3808a990 con 0x7f5e401f24f0 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.489+0000 7f5e3f7fe700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5e2006b250 0x7f5e2006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.489+0000 7f5e3f7fe700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5e2006b250 0x7f5e2006d710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000c00 tx=0x7f5e30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:54.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.493+0000 7f5e3cff9700 1 -- 172.21.15.177:0/3790977699 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5e38055750 con 0x7f5e401f24f0 2023-11-27T17:48:54.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.686+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e40073aa0 con 0x7f5e401f24f0 2023-11-27T17:48:54.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.687+0000 7f5e3cff9700 1 -- 172.21.15.177:0/3790977699 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f5e38018020 con 0x7f5e401f24f0 2023-11-27T17:48:54.689 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:54.689 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:54.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5e2006b250 msgr2=0x7f5e2006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5e2006b250 0x7f5e2006d710 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000c00 tx=0x7f5e30009040 comp rx=0 tx=0).stop 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e401f24f0 msgr2=0x7f5e401f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e401f24f0 0x7f5e401f5090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800e700 tx=0x7f5e38009750 comp rx=0 tx=0).stop 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 shutdown_connections 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5e2006b250 0x7f5e2006d710 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e401f24f0 0x7f5e401f5090 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e2c005210 0x7f5e4015f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 --2- 172.21.15.177:0/3790977699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4015fb20 0x7f5e401f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 >> 172.21.15.177:0/3790977699 conn(0x7f5e40072190 msgr2=0x7f5e4006dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 shutdown_connections 2023-11-27T17:48:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.689+0000 7f5e45baf700 1 -- 172.21.15.177:0/3790977699 wait complete. 2023-11-27T17:48:54.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:54.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:54.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.825+0000 7f5c7846d700 1 Processor -- start 2023-11-27T17:48:54.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.825+0000 7f5c7846d700 1 -- start start 2023-11-27T17:48:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.826+0000 7f5c7846d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7015b3d0 0x7f5c700b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.826+0000 7f5c7846d700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5c700cd850 0x7f5c700cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.826+0000 7f5c7846d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c700ce220 con 0x7f5c700afa50 2023-11-27T17:48:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.826+0000 7f5c7846d700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c700afe30 con 0x7f5c700cd850 2023-11-27T17:48:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.826+0000 7f5c7846d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7015b870 con 0x7f5c7015b3d0 2023-11-27T17:48:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.826+0000 7f5c76209700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5c700afa50 0x7f5c7015e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47086/0 (socket says 172.21.15.177:47086) 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.826+0000 7f5c76209700 1 -- 172.21.15.177:0/3528365717 learned_addr learned my addr 172.21.15.177:0/3528365717 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.826+0000 7f5c76a0a700 1 --2- 172.21.15.177:0/3528365717 >> v2:172.21.15.177:3300/0 conn(0x7f5c700cd850 0x7f5c700cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c75a08700 1 --2- 172.21.15.177:0/3528365717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7015b3d0 0x7f5c700b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c76a0a700 1 -- 172.21.15.177:0/3528365717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7015b3d0 msgr2=0x7f5c700b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c76a0a700 1 --2- 172.21.15.177:0/3528365717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7015b3d0 0x7f5c700b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c76a0a700 1 -- 172.21.15.177:0/3528365717 >> v1:172.21.15.177:6789/0 conn(0x7f5c700afa50 legacy=0x7f5c7015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c76a0a700 1 -- 172.21.15.177:0/3528365717 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7015bb50 con 0x7f5c700cd850 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c75207700 1 -- 172.21.15.177:0/3528365717 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208041099 0 0) 0x7f5c700ce220 con 0x7f5c700afa50 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c76a0a700 1 --2- 172.21.15.177:0/3528365717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c700cd850 0x7f5c700cdce0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009d90 tx=0x7f5c6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2049e49b27a6e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c75207700 1 -- 172.21.15.177:0/3528365717 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800e070 con 0x7f5c700cd850 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c75207700 1 -- 172.21.15.177:0/3528365717 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800bbd0 con 0x7f5c700cd850 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.827+0000 7f5c75207700 1 -- 172.21.15.177:0/3528365717 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68012430 con 0x7f5c700cd850 2023-11-27T17:48:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.828+0000 7f5c7846d700 1 -- 172.21.15.177:0/3528365717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c700cd850 msgr2=0x7f5c700cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.828+0000 7f5c7846d700 1 --2- 172.21.15.177:0/3528365717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c700cd850 0x7f5c700cdce0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009d90 tx=0x7f5c6800b330 comp rx=0 tx=0).stop 2023-11-27T17:48:54.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.828+0000 7f5c7846d700 1 -- 172.21.15.177:0/3528365717 shutdown_connections 2023-11-27T17:48:54.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.828+0000 7f5c7846d700 1 --2- 172.21.15.177:0/3528365717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c700cd850 0x7f5c700cdce0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.828+0000 7f5c7846d700 1 --2- 172.21.15.177:0/3528365717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7015b3d0 0x7f5c700b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.828+0000 7f5c7846d700 1 -- 172.21.15.177:0/3528365717 >> 172.21.15.177:0/3528365717 conn(0x7f5c700b38b0 msgr2=0x7f5c700b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:54.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.828+0000 7f5c7846d700 1 -- 172.21.15.177:0/3528365717 shutdown_connections 2023-11-27T17:48:54.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.828+0000 7f5c7846d700 1 -- 172.21.15.177:0/3528365717 wait complete. 2023-11-27T17:48:54.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.829+0000 7f5c7846d700 1 Processor -- start 2023-11-27T17:48:54.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.829+0000 7f5c7846d700 1 -- start start 2023-11-27T17:48:54.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c7846d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c700afa50 0x7f5c70141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c7846d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c700cd850 0x7f5c701e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c7846d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c7015b3d0 0x7f5c701e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c7846d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701e7bd0 con 0x7f5c7015b3d0 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c7846d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701e6fc0 con 0x7f5c700cd850 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c7846d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701e72a0 con 0x7f5c700afa50 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c7015b3d0 0x7f5c701e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c7015b3d0 0x7f5c701e43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52778/0 (socket says 172.21.15.177:52778) 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 -- 172.21.15.177:0/175266014 learned_addr learned my addr 172.21.15.177:0/175266014 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76209700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c700afa50 0x7f5c70141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c75a08700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c700cd850 0x7f5c701e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 -- 172.21.15.177:0/175266014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c700afa50 msgr2=0x7f5c70141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c700afa50 0x7f5c70141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 -- 172.21.15.177:0/175266014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c700cd850 msgr2=0x7f5c701e3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c700cd850 0x7f5c701e3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:54.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 -- 172.21.15.177:0/175266014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68009a70 con 0x7f5c7015b3d0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c76a0a700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c7015b3d0 0x7f5c701e43c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5c700ce910 tx=0x7f5c68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c66ffd700 1 -- 172.21.15.177:0/175266014 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68012430 con 0x7f5c7015b3d0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c66ffd700 1 -- 172.21.15.177:0/175266014 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c68020070 con 0x7f5c7015b3d0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c701e7580 con 0x7f5c7015b3d0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c66ffd700 1 -- 172.21.15.177:0/175266014 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68004280 con 0x7f5c7015b3d0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.830+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70141ea0 con 0x7f5c7015b3d0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.832+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7015adb0 con 0x7f5c7015b3d0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.832+0000 7f5c66ffd700 1 -- 172.21.15.177:0/175266014 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5c680043e0 con 0x7f5c7015b3d0 2023-11-27T17:48:54.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.832+0000 7f5c66ffd700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c5406b250 0x7f5c5406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:54.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.832+0000 7f5c66ffd700 1 -- 172.21.15.177:0/175266014 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c68022070 con 0x7f5c7015b3d0 2023-11-27T17:48:54.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.832+0000 7f5c76209700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c5406b250 0x7f5c5406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:54.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.833+0000 7f5c76209700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c5406b250 0x7f5c5406d710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5c60000f60 tx=0x7f5c60007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:54.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:54.837+0000 7f5c66ffd700 1 -- 172.21.15.177:0/175266014 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5c68056af0 con 0x7f5c7015b3d0 2023-11-27T17:48:55.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.026+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c701e7d10 con 0x7f5c7015b3d0 2023-11-27T17:48:55.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.027+0000 7f5c66ffd700 1 -- 172.21.15.177:0/175266014 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c701e7d10 con 0x7f5c7015b3d0 2023-11-27T17:48:55.029 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:55.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c5406b250 msgr2=0x7f5c5406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c5406b250 0x7f5c5406d710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5c60000f60 tx=0x7f5c60007be0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c7015b3d0 msgr2=0x7f5c701e43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c7015b3d0 0x7f5c701e43c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5c700ce910 tx=0x7f5c68004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 shutdown_connections 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5c5406b250 0x7f5c5406d710 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c7015b3d0 0x7f5c701e43c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c700afa50 0x7f5c70141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 --2- 172.21.15.177:0/175266014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c700cd850 0x7f5c701e3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 >> 172.21.15.177:0/175266014 conn(0x7f5c700b38b0 msgr2=0x7f5c7015ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 shutdown_connections 2023-11-27T17:48:55.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.029+0000 7f5c7846d700 1 -- 172.21.15.177:0/175266014 wait complete. 2023-11-27T17:48:55.044 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:55.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.164+0000 7f147e114700 1 Processor -- start 2023-11-27T17:48:55.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.164+0000 7f147e114700 1 -- start start 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f147e114700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1478141bc0 0x7f147815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f147e114700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147815d140 con 0x7f147813ef60 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f147e114700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14780ce700 con 0x7f147813eb80 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f147e114700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147815d420 con 0x7f1478141bc0 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f1477fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1478141bc0 0x7f147815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f1476ffd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f147813ef60 0x7f14781414b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47102/0 (socket says 172.21.15.177:47102) 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f1477fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1478141bc0 0x7f147815c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52786/0 (socket says 172.21.15.177:52786) 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f1476ffd700 1 -- 172.21.15.177:0/3590474391 learned_addr learned my addr 172.21.15.177:0/3590474391 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f1477fff700 1 -- 172.21.15.177:0/3590474391 >> v1:172.21.15.178:6789/0 conn(0x7f147813eb80 legacy=0x7f14780cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f1477fff700 1 -- 172.21.15.177:0/3590474391 >> v1:172.21.15.177:6789/0 conn(0x7f147813ef60 legacy=0x7f14781414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f1477fff700 1 -- 172.21.15.177:0/3590474391 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14780ce9e0 con 0x7f1478141bc0 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f14767fc700 1 -- 172.21.15.177:0/3590474391 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483335088 0 0) 0x7f147815d140 con 0x7f147813ef60 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.165+0000 7f1477fff700 1 --2- 172.21.15.177:0/3590474391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1478141bc0 0x7f147815c3e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1470009d90 tx=0x7f147000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a432279d20c77fff server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f14767fc700 1 -- 172.21.15.177:0/3590474391 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147000e070 con 0x7f1478141bc0 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f14767fc700 1 -- 172.21.15.177:0/3590474391 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147000bbd0 con 0x7f1478141bc0 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f14767fc700 1 -- 172.21.15.177:0/3590474391 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470012430 con 0x7f1478141bc0 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f147e114700 1 -- 172.21.15.177:0/3590474391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1478141bc0 msgr2=0x7f147815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f147e114700 1 --2- 172.21.15.177:0/3590474391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1478141bc0 0x7f147815c3e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1470009d90 tx=0x7f147000b330 comp rx=0 tx=0).stop 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f147e114700 1 -- 172.21.15.177:0/3590474391 shutdown_connections 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f147e114700 1 --2- 172.21.15.177:0/3590474391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1478141bc0 0x7f147815c3e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f147e114700 1 -- 172.21.15.177:0/3590474391 >> 172.21.15.177:0/3590474391 conn(0x7f14780b31d0 msgr2=0x7f14780b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:55.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f147e114700 1 -- 172.21.15.177:0/3590474391 shutdown_connections 2023-11-27T17:48:55.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.166+0000 7f147e114700 1 -- 172.21.15.177:0/3590474391 wait complete. 2023-11-27T17:48:55.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.167+0000 7f147e114700 1 Processor -- start 2023-11-27T17:48:55.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f147e114700 1 -- start start 2023-11-27T17:48:55.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f147e114700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f147813eb80 0x7f1478159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f147e114700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1478141bc0 0x7f14780b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f147e114700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14780b6110 0x7f14781f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f147e114700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14781f5e90 con 0x7f14780b6110 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f147e114700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14780b65c0 con 0x7f1478141bc0 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f147e114700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14780b6820 con 0x7f147813eb80 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f1477fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14780b6110 0x7f14781f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f1477fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14780b6110 0x7f14781f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52790/0 (socket says 172.21.15.177:52790) 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.168+0000 7f1477fff700 1 -- 172.21.15.177:0/1525767542 learned_addr learned my addr 172.21.15.177:0/1525767542 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f1476ffd700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1478141bc0 0x7f14780b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f14777fe700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f147813eb80 0x7f1478159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f1477fff700 1 -- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f147813eb80 msgr2=0x7f1478159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f1477fff700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f147813eb80 0x7f1478159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f1477fff700 1 -- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1478141bc0 msgr2=0x7f14780b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f1477fff700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1478141bc0 0x7f14780b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f1477fff700 1 -- 172.21.15.177:0/1525767542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009a70 con 0x7f14780b6110 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f1476ffd700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1478141bc0 0x7f14780b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f14777fe700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f147813eb80 0x7f1478159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f1477fff700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14780b6110 0x7f14781f5950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1470014040 tx=0x7f1470004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f145ffff700 1 -- 172.21.15.177:0/1525767542 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147001b810 con 0x7f14780b6110 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f145ffff700 1 -- 172.21.15.177:0/1525767542 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470020070 con 0x7f14780b6110 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1478157450 con 0x7f14780b6110 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f145ffff700 1 -- 172.21.15.177:0/1525767542 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147001bbb0 con 0x7f14780b6110 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.169+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1478157a10 con 0x7f14780b6110 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.170+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1478157ba0 con 0x7f14780b6110 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.170+0000 7f145ffff700 1 -- 172.21.15.177:0/1525767542 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f147001bd10 con 0x7f14780b6110 2023-11-27T17:48:55.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.171+0000 7f145ffff700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f146406b250 0x7f146406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.171+0000 7f145ffff700 1 -- 172.21.15.177:0/1525767542 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1470022070 con 0x7f14780b6110 2023-11-27T17:48:55.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.171+0000 7f14777fe700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f146406b250 0x7f146406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.171+0000 7f14777fe700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f146406b250 0x7f146406d710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f146c000f60 tx=0x7f146c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.175+0000 7f145ffff700 1 -- 172.21.15.177:0/1525767542 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f147005ab20 con 0x7f14780b6110 2023-11-27T17:48:55.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.365+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1478069400 con 0x7f14780b6110 2023-11-27T17:48:55.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.365+0000 7f145ffff700 1 -- 172.21.15.177:0/1525767542 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f147005a6b0 con 0x7f14780b6110 2023-11-27T17:48:55.368 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:55.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f146406b250 msgr2=0x7f146406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f146406b250 0x7f146406d710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f146c000f60 tx=0x7f146c009040 comp rx=0 tx=0).stop 2023-11-27T17:48:55.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14780b6110 msgr2=0x7f14781f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14780b6110 0x7f14781f5950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1470014040 tx=0x7f1470004ad0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 shutdown_connections 2023-11-27T17:48:55.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f146406b250 0x7f146406d710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14780b6110 0x7f14781f5950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f147813eb80 0x7f1478159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 --2- 172.21.15.177:0/1525767542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1478141bc0 0x7f14780b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 >> 172.21.15.177:0/1525767542 conn(0x7f14780b31d0 msgr2=0x7f14781414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:55.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 shutdown_connections 2023-11-27T17:48:55.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.368+0000 7f147e114700 1 -- 172.21.15.177:0/1525767542 wait complete. 2023-11-27T17:48:55.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:55.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.506+0000 7f0aaf9e0700 1 Processor -- start 2023-11-27T17:48:55.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.506+0000 7f0aaf9e0700 1 -- start start 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aaf9e0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0aa8162240 0x7f0aa80b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aaf9e0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa80b0e70 con 0x7f0aa80b0600 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aaf9e0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa80b1150 con 0x7f0aa8147930 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aaf9e0700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa80b1430 con 0x7f0aa8162240 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aacf7b700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0aa8162240 0x7f0aa80b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aacf7b700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0aa8162240 0x7f0aa80b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52798/0 (socket says 172.21.15.177:52798) 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aadf7d700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0aa80b0600 0x7f0aa80cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47118/0 (socket says 172.21.15.177:47118) 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aacf7b700 1 -- 172.21.15.177:0/1288200443 learned_addr learned my addr 172.21.15.177:0/1288200443 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:55.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aacf7b700 1 -- 172.21.15.177:0/1288200443 >> v1:172.21.15.178:6789/0 conn(0x7f0aa8147930 legacy=0x7f0aa8161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aacf7b700 1 -- 172.21.15.177:0/1288200443 >> v1:172.21.15.177:6789/0 conn(0x7f0aa80b0600 legacy=0x7f0aa80cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0a9ffff700 1 -- 172.21.15.177:0/1288200443 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517508760 0 0) 0x7f0aa80b0e70 con 0x7f0aa80b0600 2023-11-27T17:48:55.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aacf7b700 1 -- 172.21.15.177:0/1288200443 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80b1710 con 0x7f0aa8162240 2023-11-27T17:48:55.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0aacf7b700 1 --2- 172.21.15.177:0/1288200443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa80b00c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40098f0 tx=0x7f0aa4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104b72585152a973 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0a9ffff700 1 -- 172.21.15.177:0/1288200443 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400b8a0 con 0x7f0aa8162240 2023-11-27T17:48:55.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0a9ffff700 1 -- 172.21.15.177:0/1288200443 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa400ba00 con 0x7f0aa8162240 2023-11-27T17:48:55.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.507+0000 7f0a9ffff700 1 -- 172.21.15.177:0/1288200443 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400bd90 con 0x7f0aa8162240 2023-11-27T17:48:55.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.508+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/1288200443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 msgr2=0x7f0aa80b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.508+0000 7f0aaf9e0700 1 --2- 172.21.15.177:0/1288200443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa80b00c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40098f0 tx=0x7f0aa4009c00 comp rx=0 tx=0).stop 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.508+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/1288200443 shutdown_connections 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.508+0000 7f0aaf9e0700 1 --2- 172.21.15.177:0/1288200443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa80b00c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.508+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/1288200443 >> 172.21.15.177:0/1288200443 conn(0x7f0aa80b3420 msgr2=0x7f0aa80b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.508+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/1288200443 shutdown_connections 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.508+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/1288200443 wait complete. 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.509+0000 7f0aaf9e0700 1 Processor -- start 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.509+0000 7f0aaf9e0700 1 -- start start 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aaf9e0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aa80b0600 0x7f0aa813bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aaf9e0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aa8147930 0x7f0aa806e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aaf9e0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aaf9e0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80719b0 con 0x7f0aa8162240 2023-11-27T17:48:55.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aaf9e0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8070a50 con 0x7f0aa80b0600 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aaf9e0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8070d30 con 0x7f0aa8147930 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aadf7d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aadf7d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa806eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52806/0 (socket says 172.21.15.177:52806) 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aadf7d700 1 -- 172.21.15.177:0/539378333 learned_addr learned my addr 172.21.15.177:0/539378333 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aad77c700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aa80b0600 0x7f0aa813bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aacf7b700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aa8147930 0x7f0aa806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aadf7d700 1 -- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aa8147930 msgr2=0x7f0aa806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aadf7d700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aa8147930 0x7f0aa806e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aadf7d700 1 -- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aa80b0600 msgr2=0x7f0aa813bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aadf7d700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aa80b0600 0x7f0aa813bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aadf7d700 1 -- 172.21.15.177:0/539378333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4009550 con 0x7f0aa8162240 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aad77c700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aa80b0600 0x7f0aa813bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.510+0000 7f0aacf7b700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aa8147930 0x7f0aa806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:55.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.511+0000 7f0aadf7d700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa806eda0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0002230 tx=0x7f0aa000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.511+0000 7f0a9dffb700 1 -- 172.21.15.177:0/539378333 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000ac20 con 0x7f0aa8162240 2023-11-27T17:48:55.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.511+0000 7f0a9dffb700 1 -- 172.21.15.177:0/539378333 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000ada0 con 0x7f0aa8162240 2023-11-27T17:48:55.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.511+0000 7f0a9dffb700 1 -- 172.21.15.177:0/539378333 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0007310 con 0x7f0aa8162240 2023-11-27T17:48:55.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.511+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa8071010 con 0x7f0aa8162240 2023-11-27T17:48:55.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.511+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa80715d0 con 0x7f0aa8162240 2023-11-27T17:48:55.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.512+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa8069400 con 0x7f0aa8162240 2023-11-27T17:48:55.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.512+0000 7f0a9dffb700 1 -- 172.21.15.177:0/539378333 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0aa0007470 con 0x7f0aa8162240 2023-11-27T17:48:55.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.512+0000 7f0a9dffb700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0a8c06b250 0x7f0a8c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.513+0000 7f0a9dffb700 1 -- 172.21.15.177:0/539378333 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0aa0089520 con 0x7f0aa8162240 2023-11-27T17:48:55.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.513+0000 7f0aad77c700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0a8c06b250 0x7f0a8c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.513+0000 7f0aad77c700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0a8c06b250 0x7f0a8c06d710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a98000f60 tx=0x7f0a98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.517+0000 7f0a9dffb700 1 -- 172.21.15.177:0/539378333 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0aa0054250 con 0x7f0aa8162240 2023-11-27T17:48:55.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.708+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0aa80cf030 con 0x7f0aa8162240 2023-11-27T17:48:55.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.708+0000 7f0a9dffb700 1 -- 172.21.15.177:0/539378333 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0aa0057870 con 0x7f0aa8162240 2023-11-27T17:48:55.711 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:55.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0a8c06b250 msgr2=0x7f0a8c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0a8c06b250 0x7f0a8c06d710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a98000f60 tx=0x7f0a98009040 comp rx=0 tx=0).stop 2023-11-27T17:48:55.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 msgr2=0x7f0aa806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa806eda0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0002230 tx=0x7f0aa000a060 comp rx=0 tx=0).stop 2023-11-27T17:48:55.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 shutdown_connections 2023-11-27T17:48:55.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0a8c06b250 0x7f0a8c06d710 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aa8162240 0x7f0aa806eda0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aa80b0600 0x7f0aa813bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 --2- 172.21.15.177:0/539378333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aa8147930 0x7f0aa806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 >> 172.21.15.177:0/539378333 conn(0x7f0aa80b3420 msgr2=0x7f0aa8145a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:55.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.710+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 shutdown_connections 2023-11-27T17:48:55.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.711+0000 7f0aaf9e0700 1 -- 172.21.15.177:0/539378333 wait complete. 2023-11-27T17:48:55.725 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T17:48:55.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.844+0000 7f8bde794700 1 Processor -- start 2023-11-27T17:48:55.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.844+0000 7f8bde794700 1 -- start start 2023-11-27T17:48:55.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bde794700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8bd815e160 0x7f8bd8066e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bde794700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8bd80cdb30 0x7f8bd815f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bde794700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cf420 0x7f8bd80cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bde794700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd806f1e0 con 0x7f8bd80cdb30 2023-11-27T17:48:55.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bde794700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd815fe80 con 0x7f8bd815e160 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bde794700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd80cfd70 con 0x7f8bd80cf420 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bd77fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8bd80cdb30 0x7f8bd815f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bd77fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8bd80cdb30 0x7f8bd815f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52812/0 (socket says 172.21.15.177:52812) 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.845+0000 7f8bd77fe700 1 -- 172.21.15.177:0/3036150999 learned_addr learned my addr 172.21.15.177:0/3036150999 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bdcd31700 1 --2- 172.21.15.177:0/3036150999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cf420 0x7f8bd80cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd7fff700 1 --2- 172.21.15.177:0/3036150999 >> v2:172.21.15.178:3300/0 conn(0x7f8bd815e160 0x7f8bd8066e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd77fe700 1 -- 172.21.15.177:0/3036150999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cf420 msgr2=0x7f8bd80cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd77fe700 1 --2- 172.21.15.177:0/3036150999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cf420 0x7f8bd80cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd77fe700 1 -- 172.21.15.177:0/3036150999 >> v2:172.21.15.178:3300/0 conn(0x7f8bd815e160 msgr2=0x7f8bd8066e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd77fe700 1 --2- 172.21.15.177:0/3036150999 >> v2:172.21.15.178:3300/0 conn(0x7f8bd815e160 0x7f8bd8066e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd77fe700 1 -- 172.21.15.177:0/3036150999 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd80ad860 con 0x7f8bd80cdb30 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd77fe700 1 --2- 172.21.15.177:0/3036150999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd80cdb30 0x7f8bd815f940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8074d10 tx=0x7f8bc8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b4fd5f79fc765e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd6ffd700 1 -- 172.21.15.177:0/3036150999 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800b870 con 0x7f8bd80cdb30 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd6ffd700 1 -- 172.21.15.177:0/3036150999 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc800b9d0 con 0x7f8bd80cdb30 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bd6ffd700 1 -- 172.21.15.177:0/3036150999 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800bd60 con 0x7f8bd80cdb30 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bde794700 1 -- 172.21.15.177:0/3036150999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd80cdb30 msgr2=0x7f8bd815f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.846+0000 7f8bde794700 1 --2- 172.21.15.177:0/3036150999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd80cdb30 0x7f8bd815f940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8074d10 tx=0x7f8bc8009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.847+0000 7f8bde794700 1 -- 172.21.15.177:0/3036150999 shutdown_connections 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.847+0000 7f8bde794700 1 --2- 172.21.15.177:0/3036150999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cf420 0x7f8bd80cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.847+0000 7f8bde794700 1 --2- 172.21.15.177:0/3036150999 >> v2:172.21.15.178:3300/0 conn(0x7f8bd815e160 0x7f8bd8066e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.847+0000 7f8bde794700 1 --2- 172.21.15.177:0/3036150999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd80cdb30 0x7f8bd815f940 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.847+0000 7f8bde794700 1 -- 172.21.15.177:0/3036150999 >> 172.21.15.177:0/3036150999 conn(0x7f8bd80cd010 msgr2=0x7f8bd80cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.847+0000 7f8bde794700 1 -- 172.21.15.177:0/3036150999 shutdown_connections 2023-11-27T17:48:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.847+0000 7f8bde794700 1 -- 172.21.15.177:0/3036150999 wait complete. 2023-11-27T17:48:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.848+0000 7f8bde794700 1 Processor -- start 2023-11-27T17:48:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.848+0000 7f8bde794700 1 -- start start 2023-11-27T17:48:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bde794700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cdb30 0x7f8bd8156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bde794700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd80cf420 0x7f8bd814b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bde794700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815e160 0x7f8bd80b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bde794700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8155980 con 0x7f8bd815e160 2023-11-27T17:48:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bde794700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8155c60 con 0x7f8bd80cf420 2023-11-27T17:48:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bde794700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8155f40 con 0x7f8bd80cdb30 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815e160 0x7f8bd80b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815e160 0x7f8bd80b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52820/0 (socket says 172.21.15.177:52820) 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 -- 172.21.15.177:0/1947390424 learned_addr learned my addr 172.21.15.177:0/1947390424 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bd7fff700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cdb30 0x7f8bd8156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bd77fe700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd80cf420 0x7f8bd814b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 -- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cdb30 msgr2=0x7f8bd8156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cdb30 0x7f8bd8156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 -- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd80cf420 msgr2=0x7f8bd814b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd80cf420 0x7f8bd814b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 -- 172.21.15.177:0/1947390424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc8009550 con 0x7f8bd815e160 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bd77fe700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd80cf420 0x7f8bd814b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bdcd31700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815e160 0x7f8bd80b05f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0007e60 tx=0x7f8bd000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bd4ff9700 1 -- 172.21.15.177:0/1947390424 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000ede0 con 0x7f8bd815e160 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bd4ff9700 1 -- 172.21.15.177:0/1947390424 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd0014420 con 0x7f8bd815e160 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd8156220 con 0x7f8bd815e160 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bd4ff9700 1 -- 172.21.15.177:0/1947390424 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd00147d0 con 0x7f8bd815e160 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.849+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd814b570 con 0x7f8bd815e160 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.850+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd8073aa0 con 0x7f8bd815e160 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.851+0000 7f8bd4ff9700 1 -- 172.21.15.177:0/1947390424 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8bd0014930 con 0x7f8bd815e160 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.851+0000 7f8bd4ff9700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8bc406b250 0x7f8bc406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.851+0000 7f8bd4ff9700 1 -- 172.21.15.177:0/1947390424 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bd008a0f0 con 0x7f8bd815e160 2023-11-27T17:48:55.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.851+0000 7f8bd7fff700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8bc406b250 0x7f8bc406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:55.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.852+0000 7f8bd7fff700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8bc406b250 0x7f8bc406d710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc006b20 tx=0x7f8bcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:55.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:55.856+0000 7f8bd4ff9700 1 -- 172.21.15.177:0/1947390424 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8bd0054e30 con 0x7f8bd815e160 2023-11-27T17:48:56.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.061+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8bd80cd620 con 0x7f8bd815e160 2023-11-27T17:48:56.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.062+0000 7f8bd4ff9700 1 -- 172.21.15.177:0/1947390424 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8bd0058450 con 0x7f8bd815e160 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8bc406b250 msgr2=0x7f8bc406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8bc406b250 0x7f8bc406d710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc006b20 tx=0x7f8bcc008040 comp rx=0 tx=0).stop 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815e160 msgr2=0x7f8bd80b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815e160 0x7f8bd80b05f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0007e60 tx=0x7f8bd000e3c0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 shutdown_connections 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f8bc406b250 0x7f8bc406d710 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8bd815e160 0x7f8bd80b05f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd80cdb30 0x7f8bd8156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 --2- 172.21.15.177:0/1947390424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd80cf420 0x7f8bd814b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 >> 172.21.15.177:0/1947390424 conn(0x7f8bd80cd010 msgr2=0x7f8bd815e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:56.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 shutdown_connections 2023-11-27T17:48:56.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.064+0000 7f8bde794700 1 -- 172.21.15.177:0/1947390424 wait complete. 2023-11-27T17:48:56.068 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-11-27T17:48:56.078 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-27T17:48:56.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:56.079 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-27T17:48:56.120 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2023-11-27T17:48:56.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:48:56.120 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-27T17:48:56.180 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-27T17:48:56.180 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:56.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.297+0000 7fcff3111700 1 Processor -- start 2023-11-27T17:48:56.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.297+0000 7fcff3111700 1 -- start start 2023-11-27T17:48:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcff3111700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcfec13ec40 0x7fcfec0d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcff3111700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec13f020 con 0x7fcfec13f9c0 2023-11-27T17:48:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcff3111700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0d0930 con 0x7fcfec0ce960 2023-11-27T17:48:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcff3111700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec160840 con 0x7fcfec13ec40 2023-11-27T17:48:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcff16ae700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fcfec13f9c0 0x7fcfec15f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47146/0 (socket says 172.21.15.177:47146) 2023-11-27T17:48:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcff16ae700 1 -- 172.21.15.177:0/561795093 learned_addr learned my addr 172.21.15.177:0/561795093 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:56.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcff0ead700 1 --2- 172.21.15.177:0/561795093 >> v2:172.21.15.178:3300/0 conn(0x7fcfec13ec40 0x7fcfec0d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049841912 0 0) 0x7fcfec13f020 con 0x7fcfec13f9c0 2023-11-27T17:48:56.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfdc0035b0 con 0x7fcfec13f9c0 2023-11-27T17:48:56.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823693326 0 0) 0x7fcfdc0035b0 con 0x7fcfec13f9c0 2023-11-27T17:48:56.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 >> v2:172.21.15.178:3300/0 conn(0x7fcfec13ec40 msgr2=0x7fcfec0d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:56.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 --2- 172.21.15.177:0/561795093 >> v2:172.21.15.178:3300/0 conn(0x7fcfec13ec40 0x7fcfec0d1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 >> v1:172.21.15.178:6789/0 conn(0x7fcfec0ce960 legacy=0x7fcfec13f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec160560 con 0x7fcfec13f9c0 2023-11-27T17:48:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fcfe40019f0 con 0x7fcfec13f9c0 2023-11-27T17:48:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 >> v1:172.21.15.177:6789/0 conn(0x7fcfec13f9c0 legacy=0x7fcfec15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.298+0000 7fcfeb7fe700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003a00 0x7fcfdc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfeb7fe700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc004850 0x7fcfdc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfeb7fe700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfdc005210 0x7fcfdc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec160840 con 0x7fcfdc003a00 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc00c0b0 con 0x7fcfdc005210 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc00c270 con 0x7fcfdc004850 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff0ead700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003a00 0x7fcfdc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff16ae700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfdc005210 0x7fcfdc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfebfff700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc004850 0x7fcfdc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff0ead700 1 -- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc004850 msgr2=0x7fcfdc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff0ead700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc004850 0x7fcfdc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff0ead700 1 -- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfdc005210 msgr2=0x7fcfdc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff0ead700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfdc005210 0x7fcfdc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff0ead700 1 -- 172.21.15.177:0/561795093 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0035b0 con 0x7fcfdc003a00 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff16ae700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfdc005210 0x7fcfdc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:56.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff16ae700 1 -- 172.21.15.177:0/561795093 reap_dead start 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcff0ead700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003a00 0x7fcfdc003e20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009b60 tx=0x7fcfdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e7959bae802577 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000e6c0 con 0x7fcfdc003a00 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000e820 con 0x7fcfdc003a00 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.299+0000 7fcfeb7fe700 1 -- 172.21.15.177:0/561795093 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000eb90 con 0x7fcfdc003a00 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.300+0000 7fcff3111700 1 -- 172.21.15.177:0/561795093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003a00 msgr2=0x7fcfdc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.300+0000 7fcff3111700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003a00 0x7fcfdc003e20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009b60 tx=0x7fcfdc005880 comp rx=0 tx=0).stop 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.300+0000 7fcff3111700 1 -- 172.21.15.177:0/561795093 shutdown_connections 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.300+0000 7fcff3111700 1 --2- 172.21.15.177:0/561795093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003a00 0x7fcfdc003e20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.300+0000 7fcff3111700 1 -- 172.21.15.177:0/561795093 >> 172.21.15.177:0/561795093 conn(0x7fcfec0b30d0 msgr2=0x7fcfec0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.300+0000 7fcff3111700 1 -- 172.21.15.177:0/561795093 shutdown_connections 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.300+0000 7fcff3111700 1 -- 172.21.15.177:0/561795093 wait complete. 2023-11-27T17:48:56.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.301+0000 7fcff3111700 1 Processor -- start 2023-11-27T17:48:56.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.301+0000 7fcff3111700 1 -- start start 2023-11-27T17:48:56.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff3111700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc003a00 0x7fcfec13a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff3111700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec13ceb0 0x7fcfec15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff3111700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec15b230 0x7fcfec06b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff3111700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec15b6b0 con 0x7fcfec15b230 2023-11-27T17:48:56.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff3111700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec13d730 con 0x7fcfec13ceb0 2023-11-27T17:48:56.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff3111700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec13da10 con 0x7fcfdc003a00 2023-11-27T17:48:56.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec15b230 0x7fcfec06b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec15b230 0x7fcfec06b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52840/0 (socket says 172.21.15.177:52840) 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 -- 172.21.15.177:0/4218981596 learned_addr learned my addr 172.21.15.177:0/4218981596 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcfebfff700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec13ceb0 0x7fcfec15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff0ead700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc003a00 0x7fcfec13a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 -- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc003a00 msgr2=0x7fcfec13a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc003a00 0x7fcfec13a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 -- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec13ceb0 msgr2=0x7fcfec15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec13ceb0 0x7fcfec15acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 -- 172.21.15.177:0/4218981596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec13dcf0 con 0x7fcfec15b230 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcfebfff700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec13ceb0 0x7fcfec15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcff16ae700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec15b230 0x7fcfec06b230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ce8b0 tx=0x7fcfe400e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:56.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.302+0000 7fcfe97fa700 1 -- 172.21.15.177:0/4218981596 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400ec50 con 0x7fcfec15b230 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.303+0000 7fcfe97fa700 1 -- 172.21.15.177:0/4218981596 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400edb0 con 0x7fcfec15b230 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.303+0000 7fcfe97fa700 1 -- 172.21.15.177:0/4218981596 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4013660 con 0x7fcfec15b230 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.303+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec13dfd0 con 0x7fcfec15b230 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.303+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec13d330 con 0x7fcfec15b230 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.303+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec06b080 con 0x7fcfec15b230 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.304+0000 7fcfe97fa700 1 -- 172.21.15.177:0/4218981596 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcfe40137c0 con 0x7fcfec15b230 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.304+0000 7fcfe97fa700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcfd006b250 0x7fcfd006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.304+0000 7fcfe97fa700 1 -- 172.21.15.177:0/4218981596 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfe408a040 con 0x7fcfec15b230 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.304+0000 7fcff0ead700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcfd006b250 0x7fcfd006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.305+0000 7fcff0ead700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcfd006b250 0x7fcfd006d710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00090b0 tx=0x7fcfe0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:56.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.309+0000 7fcfe97fa700 1 -- 172.21.15.177:0/4218981596 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcfe4054ce0 con 0x7fcfec15b230 2023-11-27T17:48:56.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.540+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfec073aa0 con 0x7fcfec15b230 2023-11-27T17:48:56.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.540+0000 7fcfe97fa700 1 -- 172.21.15.177:0/4218981596 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fcfe4058300 con 0x7fcfec15b230 2023-11-27T17:48:56.543 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:56.543 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:48:16.563848+0000","modified":"2023-11-27T17:48:19.576268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:48:56.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcfd006b250 msgr2=0x7fcfd006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcfd006b250 0x7fcfd006d710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00090b0 tx=0x7fcfe0008030 comp rx=0 tx=0).stop 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec15b230 msgr2=0x7fcfec06b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec15b230 0x7fcfec06b230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ce8b0 tx=0x7fcfe400e440 comp rx=0 tx=0).stop 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 shutdown_connections 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcfd006b250 0x7fcfd006d710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfec15b230 0x7fcfec06b230 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfdc003a00 0x7fcfec13a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 --2- 172.21.15.177:0/4218981596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec13ceb0 0x7fcfec15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 >> 172.21.15.177:0/4218981596 conn(0x7fcfec0b30d0 msgr2=0x7fcfec06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 shutdown_connections 2023-11-27T17:48:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.543+0000 7fcff3111700 1 -- 172.21.15.177:0/4218981596 wait complete. 2023-11-27T17:48:56.547 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-27T17:48:56.558 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:56.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.676+0000 7f80e9573700 1 Processor -- start 2023-11-27T17:48:56.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.676+0000 7f80e9573700 1 -- start start 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e9573700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f80e4072ca0 0x7f80e4161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e9573700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e4141230 con 0x7f80e41586c0 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e9573700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e4070550 con 0x7f80e415ee80 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e9573700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e4162040 con 0x7f80e4072ca0 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e27fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f80e4072ca0 0x7f80e4161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e2ffd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f80e41586c0 0x7f80e4072590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47162/0 (socket says 172.21.15.177:47162) 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e2ffd700 1 -- 172.21.15.177:0/2599424542 learned_addr learned my addr 172.21.15.177:0/2599424542 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e27fc700 1 -- 172.21.15.177:0/2599424542 >> v1:172.21.15.178:6789/0 conn(0x7f80e415ee80 legacy=0x7f80e4070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e27fc700 1 -- 172.21.15.177:0/2599424542 >> v1:172.21.15.177:6789/0 conn(0x7f80e41586c0 legacy=0x7f80e4072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e1ffb700 1 -- 172.21.15.177:0/2599424542 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991600983 0 0) 0x7f80e4141230 con 0x7f80e41586c0 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.677+0000 7f80e27fc700 1 -- 172.21.15.177:0/2599424542 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4162320 con 0x7f80e4072ca0 2023-11-27T17:48:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e27fc700 1 --2- 172.21.15.177:0/2599424542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4161a40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009840 tx=0x7f80d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0cf0e385026bb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e1ffb700 1 -- 172.21.15.177:0/2599424542 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8004230 con 0x7f80e4072ca0 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e1ffb700 1 -- 172.21.15.177:0/2599424542 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8004390 con 0x7f80e4072ca0 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e1ffb700 1 -- 172.21.15.177:0/2599424542 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80036a0 con 0x7f80e4072ca0 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e9573700 1 -- 172.21.15.177:0/2599424542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 msgr2=0x7f80e4161a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e9573700 1 --2- 172.21.15.177:0/2599424542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4161a40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009840 tx=0x7f80d8009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e9573700 1 -- 172.21.15.177:0/2599424542 shutdown_connections 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e9573700 1 --2- 172.21.15.177:0/2599424542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4161a40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e9573700 1 -- 172.21.15.177:0/2599424542 >> 172.21.15.177:0/2599424542 conn(0x7f80e40b6110 msgr2=0x7f80e40b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e9573700 1 -- 172.21.15.177:0/2599424542 shutdown_connections 2023-11-27T17:48:56.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.678+0000 7f80e9573700 1 -- 172.21.15.177:0/2599424542 wait complete. 2023-11-27T17:48:56.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.680+0000 7f80e9573700 1 Processor -- start 2023-11-27T17:48:56.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.680+0000 7f80e9573700 1 -- start start 2023-11-27T17:48:56.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.680+0000 7f80e9573700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.680+0000 7f80e9573700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e41586c0 0x7f80e40b8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.680+0000 7f80e9573700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e415ee80 0x7f80e415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.680+0000 7f80e9573700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40b72b0 con 0x7f80e4072ca0 2023-11-27T17:48:56.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.680+0000 7f80e9573700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40b7550 con 0x7f80e415ee80 2023-11-27T17:48:56.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.680+0000 7f80e9573700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40b7830 con 0x7f80e41586c0 2023-11-27T17:48:56.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4140b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52850/0 (socket says 172.21.15.177:52850) 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 -- 172.21.15.177:0/575371302 learned_addr learned my addr 172.21.15.177:0/575371302 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e27fc700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e41586c0 0x7f80e40b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e37fe700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e415ee80 0x7f80e415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 -- 172.21.15.177:0/575371302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e41586c0 msgr2=0x7f80e40b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e41586c0 0x7f80e40b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 -- 172.21.15.177:0/575371302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e415ee80 msgr2=0x7f80e415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e415ee80 0x7f80e415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 -- 172.21.15.177:0/575371302 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80094a0 con 0x7f80e4072ca0 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e2ffd700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4140b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f80d400c520 tx=0x7f80d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80cb7fe700 1 -- 172.21.15.177:0/575371302 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d4004c80 con 0x7f80e4072ca0 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80cb7fe700 1 -- 172.21.15.177:0/575371302 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d4004e00 con 0x7f80e4072ca0 2023-11-27T17:48:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e40b7b10 con 0x7f80e4072ca0 2023-11-27T17:48:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80cb7fe700 1 -- 172.21.15.177:0/575371302 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d4007310 con 0x7f80e4072ca0 2023-11-27T17:48:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.681+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e40b8850 con 0x7f80e4072ca0 2023-11-27T17:48:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.682+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e40b8160 con 0x7f80e4072ca0 2023-11-27T17:48:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.683+0000 7f80cb7fe700 1 -- 172.21.15.177:0/575371302 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f80d4007470 con 0x7f80e4072ca0 2023-11-27T17:48:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.683+0000 7f80cb7fe700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f80d006b250 0x7f80d006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.683+0000 7f80e27fc700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f80d006b250 0x7f80d006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.683+0000 7f80cb7fe700 1 -- 172.21.15.177:0/575371302 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80d40895d0 con 0x7f80e4072ca0 2023-11-27T17:48:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.684+0000 7f80e27fc700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f80d006b250 0x7f80d006d710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80d80090b0 tx=0x7f80d801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:56.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.688+0000 7f80cb7fe700 1 -- 172.21.15.177:0/575371302 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f80d4054300 con 0x7f80e4072ca0 2023-11-27T17:48:56.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.880+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80e40b8a40 con 0x7f80e4072ca0 2023-11-27T17:48:56.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.881+0000 7f80cb7fe700 1 -- 172.21.15.177:0/575371302 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f80d4057920 con 0x7f80e4072ca0 2023-11-27T17:48:56.884 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:56.884 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f80d006b250 msgr2=0x7f80d006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f80d006b250 0x7f80d006d710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80d80090b0 tx=0x7f80d801c040 comp rx=0 tx=0).stop 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 msgr2=0x7f80e4140b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4140b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f80d400c520 tx=0x7f80d400c830 comp rx=0 tx=0).stop 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 shutdown_connections 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f80d006b250 0x7f80d006d710 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e415ee80 0x7f80e415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80e4072ca0 0x7f80e4140b10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 --2- 172.21.15.177:0/575371302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e41586c0 0x7f80e40b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 >> 172.21.15.177:0/575371302 conn(0x7f80e40b6110 msgr2=0x7f80e415c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:56.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 shutdown_connections 2023-11-27T17:48:56.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:56.884+0000 7f80e9573700 1 -- 172.21.15.177:0/575371302 wait complete. 2023-11-27T17:48:56.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:48:14.458670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:48:15.532637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:48:56.903 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:48:57.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.024+0000 7f0d1d3d0700 1 Processor -- start 2023-11-27T17:48:57.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.024+0000 7f0d1d3d0700 1 -- start start 2023-11-27T17:48:57.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d1d3d0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d1813eb80 0x7f0d180cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d1d3d0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d1813ef60 0x7f0d181414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d1d3d0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d181419f0 0x7f0d1815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d1d3d0700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1815d420 con 0x7f0d1813ef60 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d1d3d0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d18141e60 con 0x7f0d1813eb80 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d1d3d0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180cf720 con 0x7f0d181419f0 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d167fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d1813ef60 0x7f0d181414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d167fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d1813ef60 0x7f0d181414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52858/0 (socket says 172.21.15.177:52858) 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.025+0000 7f0d167fc700 1 -- 172.21.15.177:0/2229066981 learned_addr learned my addr 172.21.15.177:0/2229066981 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d16ffd700 1 --2- 172.21.15.177:0/2229066981 >> v2:172.21.15.178:3300/0 conn(0x7f0d1813eb80 0x7f0d180cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d167fc700 1 -- 172.21.15.177:0/2229066981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d181419f0 msgr2=0x7f0d1815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d177fe700 1 --2- 172.21.15.177:0/2229066981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d181419f0 0x7f0d1815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d167fc700 1 --2- 172.21.15.177:0/2229066981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d181419f0 0x7f0d1815c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d167fc700 1 -- 172.21.15.177:0/2229066981 >> v2:172.21.15.178:3300/0 conn(0x7f0d1813eb80 msgr2=0x7f0d180cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:57.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d167fc700 1 --2- 172.21.15.177:0/2229066981 >> v2:172.21.15.178:3300/0 conn(0x7f0d1813eb80 0x7f0d180cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d167fc700 1 -- 172.21.15.177:0/2229066981 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1815d140 con 0x7f0d1813ef60 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d16ffd700 1 --2- 172.21.15.177:0/2229066981 >> v2:172.21.15.178:3300/0 conn(0x7f0d1813eb80 0x7f0d180cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d167fc700 1 --2- 172.21.15.177:0/2229066981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d1813ef60 0x7f0d181414b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0d180b57d0 tx=0x7f0d08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc8d3929653cddc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d15ffb700 1 -- 172.21.15.177:0/2229066981 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800b870 con 0x7f0d1813ef60 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d15ffb700 1 -- 172.21.15.177:0/2229066981 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0800b9d0 con 0x7f0d1813ef60 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.026+0000 7f0d15ffb700 1 -- 172.21.15.177:0/2229066981 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800bd60 con 0x7f0d1813ef60 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/2229066981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d1813ef60 msgr2=0x7f0d181414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/2229066981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d1813ef60 0x7f0d181414b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0d180b57d0 tx=0x7f0d08009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/2229066981 shutdown_connections 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/2229066981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d181419f0 0x7f0d1815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/2229066981 >> v2:172.21.15.178:3300/0 conn(0x7f0d1813eb80 0x7f0d180cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/2229066981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d1813ef60 0x7f0d181414b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/2229066981 >> 172.21.15.177:0/2229066981 conn(0x7f0d180b31d0 msgr2=0x7f0d180b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:57.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/2229066981 shutdown_connections 2023-11-27T17:48:57.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.027+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/2229066981 wait complete. 2023-11-27T17:48:57.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.028+0000 7f0d1d3d0700 1 Processor -- start 2023-11-27T17:48:57.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.028+0000 7f0d1d3d0700 1 -- start start 2023-11-27T17:48:57.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d1d3d0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1813eb80 0x7f0d18156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d1d3d0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d181419f0 0x7f0d181f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d1d3d0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1815b6b0 0x7f0d181e28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d1d3d0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181f4840 con 0x7f0d181419f0 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d1d3d0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181f3cc0 con 0x7f0d1815b6b0 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d1d3d0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181f3fa0 con 0x7f0d1813eb80 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d181419f0 0x7f0d181f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d181419f0 0x7f0d181f3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52866/0 (socket says 172.21.15.177:52866) 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 -- 172.21.15.177:0/1880664368 learned_addr learned my addr 172.21.15.177:0/1880664368 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d16ffd700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1813eb80 0x7f0d18156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d177fe700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1815b6b0 0x7f0d181e28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 -- 172.21.15.177:0/1880664368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1813eb80 msgr2=0x7f0d18156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1813eb80 0x7f0d18156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 -- 172.21.15.177:0/1880664368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1815b6b0 msgr2=0x7f0d181e28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1815b6b0 0x7f0d181e28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 -- 172.21.15.177:0/1880664368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08009550 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d167fc700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d181419f0 0x7f0d181f3350 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0d08013000 tx=0x7f0d08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0cff7fe700 1 -- 172.21.15.177:0/1880664368 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08004310 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0cff7fe700 1 -- 172.21.15.177:0/1880664368 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0801f070 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d181f4280 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.029+0000 7f0cff7fe700 1 -- 172.21.15.177:0/1880664368 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d080036a0 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.030+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d18156550 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.030+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d181566e0 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.031+0000 7f0cff7fe700 1 -- 172.21.15.177:0/1880664368 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0d08021030 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.031+0000 7f0cff7fe700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0d0406b280 0x7f0d0406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.031+0000 7f0cff7fe700 1 -- 172.21.15.177:0/1880664368 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d0808add0 con 0x7f0d181419f0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.031+0000 7f0d16ffd700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0d0406b280 0x7f0d0406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.032+0000 7f0d16ffd700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0d0406b280 0x7f0d0406d740 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c008870 tx=0x7f0d0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.036+0000 7f0cff7fe700 1 -- 172.21.15.177:0/1880664368 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0d0808f070 con 0x7f0d181419f0 2023-11-27T17:48:57.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.230+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d18069400 con 0x7f0d181419f0 2023-11-27T17:48:57.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.230+0000 7f0cff7fe700 1 -- 172.21.15.177:0/1880664368 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d080150a0 con 0x7f0d181419f0 2023-11-27T17:48:57.233 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0d0406b280 msgr2=0x7f0d0406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0d0406b280 0x7f0d0406d740 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c008870 tx=0x7f0d0c008040 comp rx=0 tx=0).stop 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d181419f0 msgr2=0x7f0d181f3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d181419f0 0x7f0d181f3350 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0d08013000 tx=0x7f0d08004750 comp rx=0 tx=0).stop 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 shutdown_connections 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f0d0406b280 0x7f0d0406d740 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1815b6b0 0x7f0d181e28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1813eb80 0x7f0d18156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 --2- 172.21.15.177:0/1880664368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d181419f0 0x7f0d181f3350 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 >> 172.21.15.177:0/1880664368 conn(0x7f0d180b31d0 msgr2=0x7f0d1806d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:57.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 shutdown_connections 2023-11-27T17:48:57.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.232+0000 7f0d1d3d0700 1 -- 172.21.15.177:0/1880664368 wait complete. 2023-11-27T17:48:57.247 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:48:57.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.368+0000 7f32e2ef7700 1 Processor -- start 2023-11-27T17:48:57.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.368+0000 7f32e2ef7700 1 -- start start 2023-11-27T17:48:57.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32e2ef7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f32dc13ef60 0x7f32dc1414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32e2ef7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1419f0 0x7f32dc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32e2ef7700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32dc15d140 con 0x7f32dc13eb80 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32e2ef7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32dc15d420 con 0x7f32dc13ef60 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32e2ef7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc141ea0 con 0x7f32dc1419f0 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32e0c93700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f32dc13eb80 0x7f32dc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47190/0 (socket says 172.21.15.177:47190) 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32e0c93700 1 -- 172.21.15.177:0/140568836 learned_addr learned my addr 172.21.15.177:0/140568836 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32dbfff700 1 --2- 172.21.15.177:0/140568836 >> v2:172.21.15.178:3300/0 conn(0x7f32dc13ef60 0x7f32dc1414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32e1494700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1419f0 0x7f32dc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906873087 0 0) 0x7f32dc15d140 con 0x7f32dc13eb80 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32cc0035b0 con 0x7f32dc13eb80 2023-11-27T17:48:57.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4267464423 0 0) 0x7f32cc0035b0 con 0x7f32dc13eb80 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1419f0 msgr2=0x7f32dc15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1419f0 0x7f32dc15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 >> v2:172.21.15.178:3300/0 conn(0x7f32dc13ef60 msgr2=0x7f32dc1414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 --2- 172.21.15.177:0/140568836 >> v2:172.21.15.178:3300/0 conn(0x7f32dc13ef60 0x7f32dc1414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc0ce700 con 0x7f32dc13eb80 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f32d0001670 con 0x7f32dc13eb80 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 >> v1:172.21.15.177:6789/0 conn(0x7f32dc13eb80 legacy=0x7f32dc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1419f0 0x7f32cc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc003f80 0x7f32cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc004d90 0x7f32cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.369+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc15d420 con 0x7f32cc003f80 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc141ea0 con 0x7f32cc004d90 2023-11-27T17:48:57.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc00ff00 con 0x7f32dc1419f0 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32dbfff700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc003f80 0x7f32cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32e0c93700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1419f0 0x7f32cc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32e1494700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc004d90 0x7f32cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32dbfff700 1 -- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1419f0 msgr2=0x7f32cc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32dbfff700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1419f0 0x7f32cc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32dbfff700 1 -- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc004d90 msgr2=0x7f32cc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32dbfff700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc004d90 0x7f32cc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32dbfff700 1 -- 172.21.15.177:0/140568836 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0035b0 con 0x7f32cc003f80 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32dbfff700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc003f80 0x7f32cc004850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0b5330 tx=0x7f32cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa76c43c0cc22963 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800e6c0 con 0x7f32cc003f80 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c800e820 con 0x7f32cc003f80 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.370+0000 7f32db7fe700 1 -- 172.21.15.177:0/140568836 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800ebb0 con 0x7f32cc003f80 2023-11-27T17:48:57.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.371+0000 7f32e2ef7700 1 -- 172.21.15.177:0/140568836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc003f80 msgr2=0x7f32cc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.371+0000 7f32e2ef7700 1 --2- 172.21.15.177:0/140568836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32cc003f80 0x7f32cc004850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0b5330 tx=0x7f32cc005880 comp rx=0 tx=0).stop 2023-11-27T17:48:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.371+0000 7f32e1494700 1 -- 172.21.15.177:0/140568836 reap_dead start 2023-11-27T17:48:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.371+0000 7f32e2ef7700 1 -- 172.21.15.177:0/140568836 shutdown_connections 2023-11-27T17:48:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.371+0000 7f32e2ef7700 1 -- 172.21.15.177:0/140568836 >> 172.21.15.177:0/140568836 conn(0x7f32dc0b31d0 msgr2=0x7f32dc0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.371+0000 7f32e2ef7700 1 -- 172.21.15.177:0/140568836 shutdown_connections 2023-11-27T17:48:57.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.371+0000 7f32e2ef7700 1 -- 172.21.15.177:0/140568836 wait complete. 2023-11-27T17:48:57.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.372+0000 7f32e2ef7700 1 Processor -- start 2023-11-27T17:48:57.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.372+0000 7f32e2ef7700 1 -- start start 2023-11-27T17:48:57.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e2ef7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc003f80 0x7f32dc06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e2ef7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32dc153600 0x7f32dc1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e2ef7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1404d0 0x7f32dc140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e2ef7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc06cf10 con 0x7f32dc153600 2023-11-27T17:48:57.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e2ef7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc140ec0 con 0x7f32cc003f80 2023-11-27T17:48:57.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e2ef7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc06c040 con 0x7f32dc1404d0 2023-11-27T17:48:57.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32dc153600 0x7f32dc1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32dc153600 0x7f32dc1521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52886/0 (socket says 172.21.15.177:52886) 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 -- 172.21.15.177:0/129509513 learned_addr learned my addr 172.21.15.177:0/129509513 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e0c93700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc003f80 0x7f32dc06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e1494700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1404d0 0x7f32dc140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 -- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1404d0 msgr2=0x7f32dc140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1404d0 0x7f32dc140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 -- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc003f80 msgr2=0x7f32dc06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc003f80 0x7f32dc06ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 -- 172.21.15.177:0/129509513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc06ef80 con 0x7f32dc153600 2023-11-27T17:48:57.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e0c93700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc003f80 0x7f32dc06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32dbfff700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32dc153600 0x7f32dc1521d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00fe50 tx=0x7f32c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32d97fa700 1 -- 172.21.15.177:0/129509513 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800e6c0 con 0x7f32dc153600 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32d97fa700 1 -- 172.21.15.177:0/129509513 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8003ab0 con 0x7f32dc153600 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc06c290 con 0x7f32dc153600 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.373+0000 7f32d97fa700 1 -- 172.21.15.177:0/129509513 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8006e60 con 0x7f32dc153600 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.374+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc06c850 con 0x7f32dc153600 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.375+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc069400 con 0x7f32dc153600 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.375+0000 7f32d97fa700 1 -- 172.21.15.177:0/129509513 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f32c8013470 con 0x7f32dc153600 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.375+0000 7f32d97fa700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f32c006b250 0x7f32c006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.375+0000 7f32d97fa700 1 -- 172.21.15.177:0/129509513 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32c808b540 con 0x7f32dc153600 2023-11-27T17:48:57.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.375+0000 7f32e0c93700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f32c006b250 0x7f32c006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.376+0000 7f32e0c93700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f32c006b250 0x7f32c006d710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f32d0001120 tx=0x7f32d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.380+0000 7f32d97fa700 1 -- 172.21.15.177:0/129509513 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f32c8056420 con 0x7f32dc153600 2023-11-27T17:48:57.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.570+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32dc13e190 con 0x7f32dc153600 2023-11-27T17:48:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.571+0000 7f32d97fa700 1 -- 172.21.15.177:0/129509513 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32c8059a40 con 0x7f32dc153600 2023-11-27T17:48:57.573 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-11-27T17:48:57.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f32c006b250 msgr2=0x7f32c006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f32c006b250 0x7f32c006d710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f32d0001120 tx=0x7f32d0009040 comp rx=0 tx=0).stop 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32dc153600 msgr2=0x7f32dc1521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32dc153600 0x7f32dc1521d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00fe50 tx=0x7f32c80047c0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 shutdown_connections 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f32c006b250 0x7f32c006d710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32dc1404d0 0x7f32dc140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc003f80 0x7f32dc06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 --2- 172.21.15.177:0/129509513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32dc153600 0x7f32dc1521d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 >> 172.21.15.177:0/129509513 conn(0x7f32dc0b31d0 msgr2=0x7f32dc15a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 shutdown_connections 2023-11-27T17:48:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.573+0000 7f32e2ef7700 1 -- 172.21.15.177:0/129509513 wait complete. 2023-11-27T17:48:57.587 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:48:57.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.708+0000 7f2e69046700 1 Processor -- start 2023-11-27T17:48:57.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.708+0000 7f2e69046700 1 -- start start 2023-11-27T17:48:57.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.708+0000 7f2e69046700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e6413ddf0 0x7f2e6415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.708+0000 7f2e69046700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6406d910 0x7f2e640725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.708+0000 7f2e69046700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6413e1d0 con 0x7f2e64072b10 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.708+0000 7f2e69046700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e640ccf50 con 0x7f2e6413ddf0 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.708+0000 7f2e69046700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e640cfc20 con 0x7f2e6406d910 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e62d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e6413ddf0 0x7f2e6415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e6359e700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2e64072b10 0x7f2e64140530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:46190/0 (socket says 172.21.15.177:46190) 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e6359e700 1 -- 172.21.15.177:0/2320322728 learned_addr learned my addr 172.21.15.177:0/2320322728 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e6259c700 1 --2- 172.21.15.177:0/2320322728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6406d910 0x7f2e640725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e62d9d700 1 -- 172.21.15.177:0/2320322728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6406d910 msgr2=0x7f2e640725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:57.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e62d9d700 1 --2- 172.21.15.177:0/2320322728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6406d910 0x7f2e640725d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e62d9d700 1 -- 172.21.15.177:0/2320322728 >> v1:172.21.15.178:6789/0 conn(0x7f2e64072b10 legacy=0x7f2e64140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e62d9d700 1 -- 172.21.15.177:0/2320322728 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64072f20 con 0x7f2e6413ddf0 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e61d9b700 1 -- 172.21.15.177:0/2320322728 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604634121 0 0) 0x7f2e6413e1d0 con 0x7f2e64072b10 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e62d9d700 1 --2- 172.21.15.177:0/2320322728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6413ddf0 0x7f2e6415b1d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400bae0 tx=0x7f2e5400bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67f7220983de736 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e61d9b700 1 -- 172.21.15.177:0/2320322728 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400dc70 con 0x7f2e6413ddf0 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e61d9b700 1 -- 172.21.15.177:0/2320322728 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400ddd0 con 0x7f2e6413ddf0 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.709+0000 7f2e61d9b700 1 -- 172.21.15.177:0/2320322728 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54010690 con 0x7f2e6413ddf0 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.710+0000 7f2e69046700 1 -- 172.21.15.177:0/2320322728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6413ddf0 msgr2=0x7f2e6415b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.710+0000 7f2e69046700 1 --2- 172.21.15.177:0/2320322728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6413ddf0 0x7f2e6415b1d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400bae0 tx=0x7f2e5400bdf0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.710+0000 7f2e69046700 1 -- 172.21.15.177:0/2320322728 shutdown_connections 2023-11-27T17:48:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.710+0000 7f2e69046700 1 --2- 172.21.15.177:0/2320322728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6413ddf0 0x7f2e6415b1d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.710+0000 7f2e69046700 1 --2- 172.21.15.177:0/2320322728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6406d910 0x7f2e640725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.710+0000 7f2e69046700 1 -- 172.21.15.177:0/2320322728 >> 172.21.15.177:0/2320322728 conn(0x7f2e640b1d50 msgr2=0x7f2e640b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:57.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.710+0000 7f2e69046700 1 -- 172.21.15.177:0/2320322728 shutdown_connections 2023-11-27T17:48:57.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.710+0000 7f2e69046700 1 -- 172.21.15.177:0/2320322728 wait complete. 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e69046700 1 Processor -- start 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e69046700 1 -- start start 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e69046700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e6406d910 0x7f2e64154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e69046700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e64072b10 0x7f2e6413cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e69046700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6413ddf0 0x7f2e64152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e69046700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64154e70 con 0x7f2e6406d910 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e69046700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64150050 con 0x7f2e64072b10 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e69046700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64150330 con 0x7f2e6413ddf0 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e62d9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e6406d910 0x7f2e64154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e62d9d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e6406d910 0x7f2e64154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52898/0 (socket says 172.21.15.177:52898) 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e62d9d700 1 -- 172.21.15.177:0/4146458554 learned_addr learned my addr 172.21.15.177:0/4146458554 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.712+0000 7f2e6259c700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e64072b10 0x7f2e6413cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e6359e700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6413ddf0 0x7f2e64152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e62d9d700 1 -- 172.21.15.177:0/4146458554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6413ddf0 msgr2=0x7f2e64152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e62d9d700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6413ddf0 0x7f2e64152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e62d9d700 1 -- 172.21.15.177:0/4146458554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e64072b10 msgr2=0x7f2e6413cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e62d9d700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e64072b10 0x7f2e6413cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e62d9d700 1 -- 172.21.15.177:0/4146458554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5400b740 con 0x7f2e6406d910 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e62d9d700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e6406d910 0x7f2e64154930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400b2c0 tx=0x7f2e54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e4b7fe700 1 -- 172.21.15.177:0/4146458554 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5401d070 con 0x7f2e6406d910 2023-11-27T17:48:57.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e4b7fe700 1 -- 172.21.15.177:0/4146458554 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5401e040 con 0x7f2e6406d910 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e64150610 con 0x7f2e6406d910 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e4b7fe700 1 -- 172.21.15.177:0/4146458554 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54010c80 con 0x7f2e6406d910 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.713+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e641532c0 con 0x7f2e6406d910 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.714+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e64069400 con 0x7f2e6406d910 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.714+0000 7f2e4b7fe700 1 -- 172.21.15.177:0/4146458554 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2e540036a0 con 0x7f2e6406d910 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.715+0000 7f2e4b7fe700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2e5006b250 0x7f2e5006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.715+0000 7f2e4b7fe700 1 -- 172.21.15.177:0/4146458554 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e5408da40 con 0x7f2e6406d910 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.715+0000 7f2e6259c700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2e5006b250 0x7f2e5006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:57.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.715+0000 7f2e6259c700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2e5006b250 0x7f2e5006d710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e64072ac0 tx=0x7f2e58009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:57.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.719+0000 7f2e4b7fe700 1 -- 172.21.15.177:0/4146458554 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2e5408fe60 con 0x7f2e6406d910 2023-11-27T17:48:57.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.910+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e640ae6b0 con 0x7f2e6406d910 2023-11-27T17:48:57.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.911+0000 7f2e4b7fe700 1 -- 172.21.15.177:0/4146458554 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e54058920 con 0x7f2e6406d910 2023-11-27T17:48:57.913 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2e5006b250 msgr2=0x7f2e5006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2e5006b250 0x7f2e5006d710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e64072ac0 tx=0x7f2e58009210 comp rx=0 tx=0).stop 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e6406d910 msgr2=0x7f2e64154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e6406d910 0x7f2e64154930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400b2c0 tx=0x7f2e54004750 comp rx=0 tx=0).stop 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 shutdown_connections 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2e5006b250 0x7f2e5006d710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6413ddf0 0x7f2e64152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e6406d910 0x7f2e64154930 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 --2- 172.21.15.177:0/4146458554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e64072b10 0x7f2e6413cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 >> 172.21.15.177:0/4146458554 conn(0x7f2e640b1d50 msgr2=0x7f2e6415de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:57.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 shutdown_connections 2023-11-27T17:48:57.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:57.913+0000 7f2e69046700 1 -- 172.21.15.177:0/4146458554 wait complete. 2023-11-27T17:48:57.927 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:58.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.046+0000 7f2dfe03d700 1 Processor -- start 2023-11-27T17:48:58.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.046+0000 7f2dfe03d700 1 -- start start 2023-11-27T17:48:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.046+0000 7f2dfe03d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df815abf0 0x7f2df8072610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.046+0000 7f2dfe03d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df80b0850 con 0x7f2df8072b50 2023-11-27T17:48:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.046+0000 7f2dfe03d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df815afd0 con 0x7f2df815f100 2023-11-27T17:48:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.046+0000 7f2dfe03d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8072fd0 con 0x7f2df815abf0 2023-11-27T17:48:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df6ffd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2df8072b50 0x7f2df815e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47224/0 (socket says 172.21.15.177:47224) 2023-11-27T17:48:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df6ffd700 1 -- 172.21.15.177:0/2611562366 learned_addr learned my addr 172.21.15.177:0/2611562366 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df77fe700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df815abf0 0x7f2df8072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652661038 0 0) 0x7f2df80b0850 con 0x7f2df8072b50 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de40035b0 con 0x7f2df8072b50 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953614423 0 0) 0x7f2df815afd0 con 0x7f2df815f100 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df80b0850 con 0x7f2df815f100 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780121009 0 0) 0x7f2de40035b0 con 0x7f2df8072b50 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df815abf0 msgr2=0x7f2df8072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df815abf0 0x7f2df8072610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 >> v1:172.21.15.178:6789/0 conn(0x7f2df815f100 legacy=0x7f2df80ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80aff60 con 0x7f2df8072b50 2023-11-27T17:48:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f2de0001670 con 0x7f2df8072b50 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 >> v1:172.21.15.177:6789/0 conn(0x7f2df8072b50 legacy=0x7f2df815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2de4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de4004850 0x7f2de4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df815abf0 0x7f2de4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8072fd0 con 0x7f2de4003bc0 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de400dcd0 con 0x7f2de4004850 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de400bb40 con 0x7f2df815abf0 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df77fe700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2de4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df6ffd700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de4004850 0x7f2de4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.047+0000 7f2df7fff700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df815abf0 0x7f2de4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df77fe700 1 -- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df815abf0 msgr2=0x7f2de4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df77fe700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df815abf0 0x7f2de4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df77fe700 1 -- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de4004850 msgr2=0x7f2de4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df77fe700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de4004850 0x7f2de4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df77fe700 1 -- 172.21.15.177:0/2611562366 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40035b0 con 0x7f2de4003bc0 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df77fe700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2de4003fc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2de8014f00 tx=0x7f2de4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb60768726c1097 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8019070 con 0x7f2de4003bc0 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8009dd0 con 0x7f2de4003bc0 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df67fc700 1 -- 172.21.15.177:0/2611562366 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de801d610 con 0x7f2de4003bc0 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2611562366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 msgr2=0x7f2de4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2dfe03d700 1 --2- 172.21.15.177:0/2611562366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2de4003fc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2de8014f00 tx=0x7f2de4005880 comp rx=0 tx=0).stop 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.048+0000 7f2df7fff700 1 -- 172.21.15.177:0/2611562366 reap_dead start 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.049+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2611562366 shutdown_connections 2023-11-27T17:48:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.049+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2611562366 >> 172.21.15.177:0/2611562366 conn(0x7f2df806aff0 msgr2=0x7f2df806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.049+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2611562366 shutdown_connections 2023-11-27T17:48:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.049+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2611562366 wait complete. 2023-11-27T17:48:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.050+0000 7f2dfe03d700 1 Processor -- start 2023-11-27T17:48:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.050+0000 7f2dfe03d700 1 -- start start 2023-11-27T17:48:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2dfe03d700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2df815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2dfe03d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df81525a0 0x7f2df815c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2dfe03d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df8151e90 0x7f2df815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2dfe03d700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81596e0 con 0x7f2de4003bc0 2023-11-27T17:48:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2dfe03d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df815cb90 con 0x7f2df81525a0 2023-11-27T17:48:58.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2dfe03d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df815b5b0 con 0x7f2df8151e90 2023-11-27T17:48:58.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2df815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2df815afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52916/0 (socket says 172.21.15.177:52916) 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 -- 172.21.15.177:0/2252699711 learned_addr learned my addr 172.21.15.177:0/2252699711 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df7fff700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df8151e90 0x7f2df815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df6ffd700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df81525a0 0x7f2df815c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 -- 172.21.15.177:0/2252699711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df8151e90 msgr2=0x7f2df815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df8151e90 0x7f2df815d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 -- 172.21.15.177:0/2252699711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df81525a0 msgr2=0x7f2df815c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df81525a0 0x7f2df815c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 -- 172.21.15.177:0/2252699711 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df815b890 con 0x7f2de4003bc0 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2df77fe700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2df815afd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2de4005830 tx=0x7f2de8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2deffff700 1 -- 172.21.15.177:0/2252699711 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8004460 con 0x7f2de4003bc0 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2deffff700 1 -- 172.21.15.177:0/2252699711 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de80045c0 con 0x7f2de4003bc0 2023-11-27T17:48:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df815bb70 con 0x7f2de4003bc0 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2deffff700 1 -- 172.21.15.177:0/2252699711 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de80038c0 con 0x7f2de4003bc0 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.051+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df815c130 con 0x7f2de4003bc0 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.052+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df815c2f0 con 0x7f2de4003bc0 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.053+0000 7f2deffff700 1 -- 172.21.15.177:0/2252699711 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2de8024040 con 0x7f2de4003bc0 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.053+0000 7f2deffff700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2dd806b250 0x7f2dd806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.053+0000 7f2deffff700 1 -- 172.21.15.177:0/2252699711 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2de8092ce0 con 0x7f2de4003bc0 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.053+0000 7f2df6ffd700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2dd806b250 0x7f2dd806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.053+0000 7f2df6ffd700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2dd806b250 0x7f2dd806d710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2de0001050 tx=0x7f2de0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.058+0000 7f2deffff700 1 -- 172.21.15.177:0/2252699711 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2de805da20 con 0x7f2de4003bc0 2023-11-27T17:48:58.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.290+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2df8073aa0 con 0x7f2de4003bc0 2023-11-27T17:48:58.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.291+0000 7f2deffff700 1 -- 172.21.15.177:0/2252699711 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f2de8061040 con 0x7f2de4003bc0 2023-11-27T17:48:58.293 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:58.293 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:48:16.563848+0000","modified":"2023-11-27T17:48:19.576268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:48:58.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2dd806b250 msgr2=0x7f2dd806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2dd806b250 0x7f2dd806d710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2de0001050 tx=0x7f2de0009040 comp rx=0 tx=0).stop 2023-11-27T17:48:58.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 msgr2=0x7f2df815afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2df815afd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2de4005830 tx=0x7f2de8004750 comp rx=0 tx=0).stop 2023-11-27T17:48:58.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 shutdown_connections 2023-11-27T17:48:58.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2dd806b250 0x7f2dd806d710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df8151e90 0x7f2df815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2de4003bc0 0x7f2df815afd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 --2- 172.21.15.177:0/2252699711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df81525a0 0x7f2df815c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 >> 172.21.15.177:0/2252699711 conn(0x7f2df806aff0 msgr2=0x7f2df80b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:58.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 shutdown_connections 2023-11-27T17:48:58.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.293+0000 7f2dfe03d700 1 -- 172.21.15.177:0/2252699711 wait complete. 2023-11-27T17:48:58.296 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-27T17:48:58.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:58.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.424+0000 7f5fe7ea2700 1 Processor -- start 2023-11-27T17:48:58.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.425+0000 7f5fe7ea2700 1 -- start start 2023-11-27T17:48:58.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.425+0000 7f5fe7ea2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe01434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.425+0000 7f5fe7ea2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5fe0072e30 0x7f5fe01416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.425+0000 7f5fe7ea2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe0143a30 con 0x7f5fe0143f00 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.425+0000 7f5fe7ea2700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe015e6b0 con 0x7f5fe0072e30 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.425+0000 7f5fe7ea2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015e990 con 0x7f5fe0143110 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe543d700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5fe0143f00 0x7f5fe0072720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47242/0 (socket says 172.21.15.177:47242) 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe543d700 1 -- 172.21.15.177:0/2878577334 learned_addr learned my addr 172.21.15.177:0/2878577334 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe5c3e700 1 --2- 172.21.15.177:0/2878577334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe01434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe643f700 1 --2- 172.21.15.177:0/2878577334 >> v2:172.21.15.178:3300/0 conn(0x7f5fe0072e30 0x7f5fe01416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe4c3c700 1 -- 172.21.15.177:0/2878577334 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124681637 0 0) 0x7f5fe0143a30 con 0x7f5fe0143f00 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe4c3c700 1 -- 172.21.15.177:0/2878577334 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fcc0035b0 con 0x7f5fe0143f00 2023-11-27T17:48:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe5c3e700 1 -- 172.21.15.177:0/2878577334 >> v2:172.21.15.178:3300/0 conn(0x7f5fe0072e30 msgr2=0x7f5fe01416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe5c3e700 1 --2- 172.21.15.177:0/2878577334 >> v2:172.21.15.178:3300/0 conn(0x7f5fe0072e30 0x7f5fe01416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe5c3e700 1 -- 172.21.15.177:0/2878577334 >> v1:172.21.15.177:6789/0 conn(0x7f5fe0143f00 legacy=0x7f5fe0072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe4c3c700 1 -- 172.21.15.177:0/2878577334 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2675455069 0 0) 0x7f5fcc0035b0 con 0x7f5fe0143f00 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe5c3e700 1 -- 172.21.15.177:0/2878577334 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe015ec70 con 0x7f5fe0143110 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe5c3e700 1 --2- 172.21.15.177:0/2878577334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe01434f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009840 tx=0x7f5fd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29bb8e900a2b93bb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe4c3c700 1 -- 172.21.15.177:0/2878577334 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc001670 con 0x7f5fe0143110 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe4c3c700 1 -- 172.21.15.177:0/2878577334 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0004030 con 0x7f5fe0143110 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.426+0000 7f5fe4c3c700 1 -- 172.21.15.177:0/2878577334 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00043c0 con 0x7f5fe0143110 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.427+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/2878577334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 msgr2=0x7f5fe01434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.427+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/2878577334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe01434f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009840 tx=0x7f5fd0009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.427+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/2878577334 shutdown_connections 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.427+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/2878577334 >> v2:172.21.15.178:3300/0 conn(0x7f5fe0072e30 0x7f5fe01416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.427+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/2878577334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe01434f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.427+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/2878577334 >> 172.21.15.177:0/2878577334 conn(0x7f5fe0066e20 msgr2=0x7f5fe0067230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.427+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/2878577334 shutdown_connections 2023-11-27T17:48:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.427+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/2878577334 wait complete. 2023-11-27T17:48:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.428+0000 7f5fe7ea2700 1 Processor -- start 2023-11-27T17:48:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.428+0000 7f5fe7ea2700 1 -- start start 2023-11-27T17:48:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe7ea2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fe0072e30 0x7f5fe006ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe7ea2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe013d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe7ea2700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fe0143f00 0x7f5fe015fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe7ea2700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe006f110 con 0x7f5fe0143f00 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe7ea2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe006d3c0 con 0x7f5fe0072e30 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe7ea2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe006d6a0 con 0x7f5fe0143110 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe643f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fe0143f00 0x7f5fe015fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe643f700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fe0143f00 0x7f5fe015fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52934/0 (socket says 172.21.15.177:52934) 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe643f700 1 -- 172.21.15.177:0/3406574671 learned_addr learned my addr 172.21.15.177:0/3406574671 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe543d700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe013d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe5c3e700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fe0072e30 0x7f5fe006ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe643f700 1 -- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 msgr2=0x7f5fe013d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe643f700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe013d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe643f700 1 -- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fe0072e30 msgr2=0x7f5fe006ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe643f700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fe0072e30 0x7f5fe006ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe643f700 1 -- 172.21.15.177:0/3406574671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00094a0 con 0x7f5fe0143f00 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe543d700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe013d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.429+0000 7f5fe5c3e700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fe0072e30 0x7f5fe006ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.430+0000 7f5fe643f700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fe0143f00 0x7f5fe015fce0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800ef90 tx=0x7f5fd800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.430+0000 7f5fd67fc700 1 -- 172.21.15.177:0/3406574671 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8009b20 con 0x7f5fe0143f00 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.430+0000 7f5fd67fc700 1 -- 172.21.15.177:0/3406574671 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800f040 con 0x7f5fe0143f00 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.430+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe006d980 con 0x7f5fe0143f00 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.430+0000 7f5fd67fc700 1 -- 172.21.15.177:0/3406574671 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8009e50 con 0x7f5fe0143f00 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.430+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe006df40 con 0x7f5fe0143f00 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.431+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe0069400 con 0x7f5fe0143f00 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.431+0000 7f5fd67fc700 1 -- 172.21.15.177:0/3406574671 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5fd8014480 con 0x7f5fe0143f00 2023-11-27T17:48:58.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.432+0000 7f5fd67fc700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fc406b250 0x7f5fc406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.432+0000 7f5fd67fc700 1 -- 172.21.15.177:0/3406574671 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fd808a490 con 0x7f5fe0143f00 2023-11-27T17:48:58.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.432+0000 7f5fe5c3e700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fc406b250 0x7f5fc406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.432+0000 7f5fe5c3e700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fc406b250 0x7f5fc406d710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5fe01552c0 tx=0x7f5fd0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.436+0000 7f5fd67fc700 1 -- 172.21.15.177:0/3406574671 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5fd8055250 con 0x7f5fe0143f00 2023-11-27T17:48:58.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.625+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fe00b42a0 con 0x7f5fe0143f00 2023-11-27T17:48:58.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.626+0000 7f5fd67fc700 1 -- 172.21.15.177:0/3406574671 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f5fd8058870 con 0x7f5fe0143f00 2023-11-27T17:48:58.629 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:58.629 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:58.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.628+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fc406b250 msgr2=0x7f5fc406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.628+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fc406b250 0x7f5fc406d710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5fe01552c0 tx=0x7f5fd0008030 comp rx=0 tx=0).stop 2023-11-27T17:48:58.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.628+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fe0143f00 msgr2=0x7f5fe015fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.628+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fe0143f00 0x7f5fe015fce0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800ef90 tx=0x7f5fd800c3a0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.628+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 shutdown_connections 2023-11-27T17:48:58.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.628+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f5fc406b250 0x7f5fc406d710 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.629+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fe0143f00 0x7f5fe015fce0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.629+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fe0072e30 0x7f5fe006ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.629+0000 7f5fe7ea2700 1 --2- 172.21.15.177:0/3406574671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fe0143110 0x7f5fe013d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.629+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 >> 172.21.15.177:0/3406574671 conn(0x7f5fe0066e20 msgr2=0x7f5fe00b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:58.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.629+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 shutdown_connections 2023-11-27T17:48:58.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.629+0000 7f5fe7ea2700 1 -- 172.21.15.177:0/3406574671 wait complete. 2023-11-27T17:48:58.643 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T17:48:58.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:58.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.761+0000 7f9783780700 1 Processor -- start 2023-11-27T17:48:58.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.761+0000 7f9783780700 1 -- start start 2023-11-27T17:48:58.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9783780700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f977c147650 0x7f977c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9783780700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f977c147a30 0x7f977c0b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9783780700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c162940 con 0x7f977c0aeaa0 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9783780700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0af640 con 0x7f977c147a30 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9783780700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c161d30 con 0x7f977c147650 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9780d1b700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f977c147a30 0x7f977c0b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9781d1d700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f977c0aeaa0 0x7f977c0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47258/0 (socket says 172.21.15.177:47258) 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9781d1d700 1 -- 172.21.15.177:0/3814988694 learned_addr learned my addr 172.21.15.177:0/3814988694 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9780d1b700 1 -- 172.21.15.177:0/3814988694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f977c147650 msgr2=0x7f977c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9780d1b700 1 --2- 172.21.15.177:0/3814988694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f977c147650 0x7f977c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9780d1b700 1 -- 172.21.15.177:0/3814988694 >> v1:172.21.15.177:6789/0 conn(0x7f977c0aeaa0 legacy=0x7f977c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9780d1b700 1 -- 172.21.15.177:0/3814988694 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c162010 con 0x7f977c147a30 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9773fff700 1 -- 172.21.15.177:0/3814988694 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833140719 0 0) 0x7f977c162940 con 0x7f977c0aeaa0 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9780d1b700 1 --2- 172.21.15.177:0/3814988694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147a30 0x7f977c0b6720 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f976c009840 tx=0x7f976c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d72ad04b1e2b8c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9773fff700 1 -- 172.21.15.177:0/3814988694 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c011830 con 0x7f977c147a30 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9773fff700 1 -- 172.21.15.177:0/3814988694 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c011990 con 0x7f977c147a30 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.762+0000 7f9773fff700 1 -- 172.21.15.177:0/3814988694 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c011d20 con 0x7f977c147a30 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.763+0000 7f9783780700 1 -- 172.21.15.177:0/3814988694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147a30 msgr2=0x7f977c0b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.763+0000 7f9783780700 1 --2- 172.21.15.177:0/3814988694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147a30 0x7f977c0b6720 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f976c009840 tx=0x7f976c009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.763+0000 7f9783780700 1 -- 172.21.15.177:0/3814988694 shutdown_connections 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.763+0000 7f9783780700 1 --2- 172.21.15.177:0/3814988694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f977c147650 0x7f977c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.763+0000 7f9783780700 1 --2- 172.21.15.177:0/3814988694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147a30 0x7f977c0b6720 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.763+0000 7f9783780700 1 -- 172.21.15.177:0/3814988694 >> 172.21.15.177:0/3814988694 conn(0x7f977c0b3590 msgr2=0x7f977c0b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.763+0000 7f9783780700 1 -- 172.21.15.177:0/3814988694 shutdown_connections 2023-11-27T17:48:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.763+0000 7f9783780700 1 -- 172.21.15.177:0/3814988694 wait complete. 2023-11-27T17:48:58.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.764+0000 7f9783780700 1 Processor -- start 2023-11-27T17:48:58.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.764+0000 7f9783780700 1 -- start start 2023-11-27T17:48:58.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9783780700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f977c0aeaa0 0x7f977c13d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9783780700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147650 0x7f977c0719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9783780700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f977c147a30 0x7f977c071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9783780700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c141850 con 0x7f977c147650 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9783780700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c13e690 con 0x7f977c0aeaa0 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9783780700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c146430 con 0x7f977c147a30 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147650 0x7f977c0719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147650 0x7f977c0719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52946/0 (socket says 172.21.15.177:52946) 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 -- 172.21.15.177:0/1694511448 learned_addr learned my addr 172.21.15.177:0/1694511448 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 -- 172.21.15.177:0/1694511448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f977c147a30 msgr2=0x7f977c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f977c147a30 0x7f977c071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 -- 172.21.15.177:0/1694511448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f977c0aeaa0 msgr2=0x7f977c13d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f977c0aeaa0 0x7f977c13d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:58.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 -- 172.21.15.177:0/1694511448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0094a0 con 0x7f977c147650 2023-11-27T17:48:58.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.765+0000 7f9780d1b700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147650 0x7f977c0719a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f976c014040 tx=0x7f976c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.766+0000 7f9771ffb700 1 -- 172.21.15.177:0/1694511448 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0045f0 con 0x7f977c147650 2023-11-27T17:48:58.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.766+0000 7f9771ffb700 1 -- 172.21.15.177:0/1694511448 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c01e070 con 0x7f977c147650 2023-11-27T17:48:58.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.766+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c141aa0 con 0x7f977c147650 2023-11-27T17:48:58.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.766+0000 7f9771ffb700 1 -- 172.21.15.177:0/1694511448 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c003b00 con 0x7f977c147650 2023-11-27T17:48:58.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.766+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c142060 con 0x7f977c147650 2023-11-27T17:48:58.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.767+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c073aa0 con 0x7f977c147650 2023-11-27T17:48:58.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.767+0000 7f9771ffb700 1 -- 172.21.15.177:0/1694511448 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f976c003c60 con 0x7f977c147650 2023-11-27T17:48:58.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.768+0000 7f9771ffb700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f976006b250 0x7f976006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:58.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.768+0000 7f9771ffb700 1 -- 172.21.15.177:0/1694511448 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f976c08ab60 con 0x7f977c147650 2023-11-27T17:48:58.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.768+0000 7f978151c700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f976006b250 0x7f976006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:58.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.768+0000 7f978151c700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f976006b250 0x7f976006d710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f977c146d30 tx=0x7f9778006d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:58.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:58.772+0000 7f9771ffb700 1 -- 172.21.15.177:0/1694511448 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f976c055920 con 0x7f977c147650 2023-11-27T17:48:59.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.007+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f977c068450 con 0x7f977c147650 2023-11-27T17:48:59.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.008+0000 7f9771ffb700 1 -- 172.21.15.177:0/1694511448 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f976c020070 con 0x7f977c147650 2023-11-27T17:48:59.010 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:59.010 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:48:16.563848+0000","modified":"2023-11-27T17:48:19.576268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:48:59.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f976006b250 msgr2=0x7f976006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f976006b250 0x7f976006d710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f977c146d30 tx=0x7f9778006d20 comp rx=0 tx=0).stop 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147650 msgr2=0x7f977c0719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147650 0x7f977c0719a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f976c014040 tx=0x7f976c004750 comp rx=0 tx=0).stop 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 shutdown_connections 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f976006b250 0x7f976006d710 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f977c147a30 0x7f977c071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f977c0aeaa0 0x7f977c13d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 --2- 172.21.15.177:0/1694511448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c147650 0x7f977c0719a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 >> 172.21.15.177:0/1694511448 conn(0x7f977c0b3590 msgr2=0x7f977c0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 shutdown_connections 2023-11-27T17:48:59.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.010+0000 7f9783780700 1 -- 172.21.15.177:0/1694511448 wait complete. 2023-11-27T17:48:59.014 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-27T17:48:59.024 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:48:59.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.142+0000 7f3b720d8700 1 Processor -- start 2023-11-27T17:48:59.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.142+0000 7f3b720d8700 1 -- start start 2023-11-27T17:48:59.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.143+0000 7f3b720d8700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3b6c147880 0x7f3b6c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.143+0000 7f3b720d8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3b6c0b6170 0x7f3b6c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.143+0000 7f3b720d8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c0b5ce0 con 0x7f3b6c0b6600 2023-11-27T17:48:59.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.143+0000 7f3b720d8700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6c0b5700 con 0x7f3b6c147880 2023-11-27T17:48:59.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.143+0000 7f3b720d8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6c06e230 con 0x7f3b6c0b6170 2023-11-27T17:48:59.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.143+0000 7f3b6b7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3b6c147880 0x7f3b6c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.143+0000 7f3b6b7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3b6c147880 0x7f3b6c06d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52952/0 (socket says 172.21.15.177:52952) 2023-11-27T17:48:59.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.143+0000 7f3b6b7fe700 1 -- 172.21.15.177:0/762462990 learned_addr learned my addr 172.21.15.177:0/762462990 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6affd700 1 --2- 172.21.15.177:0/762462990 >> v2:172.21.15.178:3300/0 conn(0x7f3b6c0b6170 0x7f3b6c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6b7fe700 1 -- 172.21.15.177:0/762462990 >> v2:172.21.15.178:3300/0 conn(0x7f3b6c0b6170 msgr2=0x7f3b6c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6b7fe700 1 --2- 172.21.15.177:0/762462990 >> v2:172.21.15.178:3300/0 conn(0x7f3b6c0b6170 0x7f3b6c0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6b7fe700 1 -- 172.21.15.177:0/762462990 >> v1:172.21.15.178:6789/0 conn(0x7f3b6c0b6600 legacy=0x7f3b6c161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6b7fe700 1 -- 172.21.15.177:0/762462990 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0b5970 con 0x7f3b6c147880 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6b7fe700 1 --2- 172.21.15.177:0/762462990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c06d910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c161be0 tx=0x7f3b60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348097cc7ada3fc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6a7fc700 1 -- 172.21.15.177:0/762462990 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000b870 con 0x7f3b6c147880 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6a7fc700 1 -- 172.21.15.177:0/762462990 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6000b9d0 con 0x7f3b6c147880 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b6a7fc700 1 -- 172.21.15.177:0/762462990 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000bd60 con 0x7f3b6c147880 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.144+0000 7f3b720d8700 1 -- 172.21.15.177:0/762462990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 msgr2=0x7f3b6c06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.145+0000 7f3b720d8700 1 --2- 172.21.15.177:0/762462990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c06d910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c161be0 tx=0x7f3b60009bd0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.145+0000 7f3b720d8700 1 -- 172.21.15.177:0/762462990 shutdown_connections 2023-11-27T17:48:59.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.145+0000 7f3b720d8700 1 --2- 172.21.15.177:0/762462990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c06d910 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.145+0000 7f3b720d8700 1 --2- 172.21.15.177:0/762462990 >> v2:172.21.15.178:3300/0 conn(0x7f3b6c0b6170 0x7f3b6c0704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.145+0000 7f3b720d8700 1 -- 172.21.15.177:0/762462990 >> 172.21.15.177:0/762462990 conn(0x7f3b6c0b2130 msgr2=0x7f3b6c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:59.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.145+0000 7f3b720d8700 1 -- 172.21.15.177:0/762462990 shutdown_connections 2023-11-27T17:48:59.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.145+0000 7f3b720d8700 1 -- 172.21.15.177:0/762462990 wait complete. 2023-11-27T17:48:59.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.146+0000 7f3b720d8700 1 Processor -- start 2023-11-27T17:48:59.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.146+0000 7f3b720d8700 1 -- start start 2023-11-27T17:48:59.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b720d8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0b6170 0x7f3b6c137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b720d8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c0b6600 0x7f3b6c0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b720d8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b720d8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c6a50 con 0x7f3b6c147880 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b720d8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c6d30 con 0x7f3b6c0b6170 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b720d8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c7010 con 0x7f3b6c0b6600 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c0c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52962/0 (socket says 172.21.15.177:52962) 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 -- 172.21.15.177:0/3098199972 learned_addr learned my addr 172.21.15.177:0/3098199972 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6b7fe700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0b6170 0x7f3b6c137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6affd700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c0b6600 0x7f3b6c0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 -- 172.21.15.177:0/3098199972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c0b6600 msgr2=0x7f3b6c0c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c0b6600 0x7f3b6c0c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 -- 172.21.15.177:0/3098199972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0b6170 msgr2=0x7f3b6c137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0b6170 0x7f3b6c137bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 -- 172.21.15.177:0/3098199972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b60009550 con 0x7f3b6c147880 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b6bfff700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c0c6420 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400cb50 tx=0x7f3b6400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b53fff700 1 -- 172.21.15.177:0/3098199972 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64003c00 con 0x7f3b6c147880 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b53fff700 1 -- 172.21.15.177:0/3098199972 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64003d60 con 0x7f3b6c147880 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c0c72f0 con 0x7f3b6c147880 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.147+0000 7f3b53fff700 1 -- 172.21.15.177:0/3098199972 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400aa20 con 0x7f3b6c147880 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.148+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c13b590 con 0x7f3b6c147880 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.148+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6c073aa0 con 0x7f3b6c147880 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.149+0000 7f3b53fff700 1 -- 172.21.15.177:0/3098199972 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3b6400ab80 con 0x7f3b6c147880 2023-11-27T17:48:59.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.149+0000 7f3b53fff700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f3b5806b250 0x7f3b5806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.149+0000 7f3b53fff700 1 -- 172.21.15.177:0/3098199972 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b64089990 con 0x7f3b6c147880 2023-11-27T17:48:59.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.149+0000 7f3b6b7fe700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f3b5806b250 0x7f3b5806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.150+0000 7f3b6b7fe700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f3b5806b250 0x7f3b5806d710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b60000c00 tx=0x7f3b60008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.154+0000 7f3b53fff700 1 -- 172.21.15.177:0/3098199972 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3b640546c0 con 0x7f3b6c147880 2023-11-27T17:48:59.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.386+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b6c069400 con 0x7f3b6c147880 2023-11-27T17:48:59.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.386+0000 7f3b53fff700 1 -- 172.21.15.177:0/3098199972 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f3b64057ce0 con 0x7f3b6c147880 2023-11-27T17:48:59.389 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:59.389 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2368239855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2368239855},{"type":"v1","addr":"172.21.15.178:6834","nonce":2368239855}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/2804911772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2804911772},{"type":"v1","addr":"172.21.15.177:6836","nonce":2804911772}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1048283675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1048283675},{"type":"v1","addr":"172.21.15.177:6837","nonce":1048283675}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:48:16.563848+0000","modified":"2023-11-27T17:48:19.576268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1631332189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1631332189},{"type":"v1","addr":"172.21.15.178:6835","nonce":1631332189}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:48:59.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f3b5806b250 msgr2=0x7f3b5806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f3b5806b250 0x7f3b5806d710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b60000c00 tx=0x7f3b60008030 comp rx=0 tx=0).stop 2023-11-27T17:48:59.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 msgr2=0x7f3b6c0c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c0c6420 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400cb50 tx=0x7f3b6400ce60 comp rx=0 tx=0).stop 2023-11-27T17:48:59.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 shutdown_connections 2023-11-27T17:48:59.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f3b5806b250 0x7f3b5806d710 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6c147880 0x7f3b6c0c6420 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0b6170 0x7f3b6c137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 --2- 172.21.15.177:0/3098199972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c0b6600 0x7f3b6c0c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 >> 172.21.15.177:0/3098199972 conn(0x7f3b6c0b2130 msgr2=0x7f3b6c0b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:59.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 shutdown_connections 2023-11-27T17:48:59.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.389+0000 7f3b720d8700 1 -- 172.21.15.177:0/3098199972 wait complete. 2023-11-27T17:48:59.393 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 8 2023-11-27T17:48:59.403 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:48:59.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.521+0000 7f2ba5bb0700 1 Processor -- start 2023-11-27T17:48:59.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.521+0000 7f2ba5bb0700 1 -- start start 2023-11-27T17:48:59.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2ba5bb0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ba00cd220 0x7f2ba00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2ba5bb0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ba006e960 0x7f2ba006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2ba5bb0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00cdbc0 con 0x7f2ba0143ec0 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2ba5bb0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba006df10 con 0x7f2ba006e960 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2ba5bb0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba015ec20 con 0x7f2ba00cd220 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9f7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2ba0143ec0 0x7f2ba015e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47284/0 (socket says 172.21.15.177:47284) 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9f7fe700 1 -- 172.21.15.177:0/2127619677 learned_addr learned my addr 172.21.15.177:0/2127619677 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9effd700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ba00cd220 0x7f2ba00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9ffff700 1 --2- 172.21.15.177:0/2127619677 >> v2:172.21.15.178:3300/0 conn(0x7f2ba006e960 0x7f2ba006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338920478 0 0) 0x7f2ba00cdbc0 con 0x7f2ba0143ec0 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b880035b0 con 0x7f2ba0143ec0 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022908353 0 0) 0x7f2b880035b0 con 0x7f2ba0143ec0 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ba00cd220 msgr2=0x7f2ba00cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:59.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ba00cd220 0x7f2ba00cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 >> v2:172.21.15.178:3300/0 conn(0x7f2ba006e960 msgr2=0x7f2ba006edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 --2- 172.21.15.177:0/2127619677 >> v2:172.21.15.178:3300/0 conn(0x7f2ba006e960 0x7f2ba006edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba015ef00 con 0x7f2ba0143ec0 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f2b90001670 con 0x7f2ba0143ec0 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 >> v1:172.21.15.177:6789/0 conn(0x7f2ba0143ec0 legacy=0x7f2ba015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b88003a00 0x7f2b88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88004850 0x7f2b88004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b88005210 0x7f2b8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba006df10 con 0x7f2b88003a00 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba015ec20 con 0x7f2b88005210 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8800bf50 con 0x7f2b88004850 2023-11-27T17:48:59.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9effd700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ba00cd220 0x7f2ba00cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:48:59.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.522+0000 7f2b9f7fe700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b88003a00 0x7f2b88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9ffff700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b88005210 0x7f2b8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9effd700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88004850 0x7f2b88004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9f7fe700 1 -- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88004850 msgr2=0x7f2b88004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:59.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9f7fe700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88004850 0x7f2b88004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9f7fe700 1 -- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b88005210 msgr2=0x7f2b8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:59.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9f7fe700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b88005210 0x7f2b8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9f7fe700 1 -- 172.21.15.177:0/2127619677 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880035b0 con 0x7f2b88003a00 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9f7fe700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b88003a00 0x7f2b88003e20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000c350 tx=0x7f2b88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b8f4bd8ab681f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000ce50 con 0x7f2b88003a00 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b90005960 con 0x7f2b88003a00 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9e7fc700 1 -- 172.21.15.177:0/2127619677 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90005d10 con 0x7f2b88003a00 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2127619677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b88003a00 msgr2=0x7f2b88003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2ba5bb0700 1 --2- 172.21.15.177:0/2127619677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b88003a00 0x7f2b88003e20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000c350 tx=0x7f2b88005880 comp rx=0 tx=0).stop 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.523+0000 7f2b9ffff700 1 -- 172.21.15.177:0/2127619677 reap_dead start 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.524+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2127619677 shutdown_connections 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.524+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2127619677 >> 172.21.15.177:0/2127619677 conn(0x7f2ba00b1ff0 msgr2=0x7f2ba00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.524+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2127619677 shutdown_connections 2023-11-27T17:48:59.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.524+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2127619677 wait complete. 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.525+0000 7f2ba5bb0700 1 Processor -- start 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.525+0000 7f2ba5bb0700 1 -- start start 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2ba5bb0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88003a00 0x7f2ba01f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2ba5bb0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ba0152690 0x7f2ba00b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2ba5bb0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba00b2e40 0x7f2ba015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2ba5bb0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00b32c0 con 0x7f2ba00b2e40 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2ba5bb0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0151c40 con 0x7f2ba0152690 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2ba5bb0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00ac1a0 con 0x7f2b88003a00 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba00b2e40 0x7f2ba015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba00b2e40 0x7f2ba015cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52982/0 (socket says 172.21.15.177:52982) 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 -- 172.21.15.177:0/2655189558 learned_addr learned my addr 172.21.15.177:0/2655189558 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9f7fe700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88003a00 0x7f2ba01f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 -- 172.21.15.177:0/2655189558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88003a00 msgr2=0x7f2ba01f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88003a00 0x7f2ba01f1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9effd700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ba0152690 0x7f2ba00b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 -- 172.21.15.177:0/2655189558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ba0152690 msgr2=0x7f2ba00b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ba0152690 0x7f2ba00b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 -- 172.21.15.177:0/2655189558 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00ac760 con 0x7f2ba00b2e40 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b9ffff700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba00b2e40 0x7f2ba015cd10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00b3850 tx=0x7f2b98011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b87fff700 1 -- 172.21.15.177:0/2655189558 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800e040 con 0x7f2ba00b2e40 2023-11-27T17:48:59.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b87fff700 1 -- 172.21.15.177:0/2655189558 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9800f040 con 0x7f2ba00b2e40 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2b87fff700 1 -- 172.21.15.177:0/2655189558 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800fd80 con 0x7f2ba00b2e40 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba0151e90 con 0x7f2ba00b2e40 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.526+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba00ac3f0 con 0x7f2ba00b2e40 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.527+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba00ac5b0 con 0x7f2ba00b2e40 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.528+0000 7f2b87fff700 1 -- 172.21.15.177:0/2655189558 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2b98015430 con 0x7f2ba00b2e40 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.528+0000 7f2b87fff700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b8c06b280 0x7f2b8c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.528+0000 7f2b87fff700 1 -- 172.21.15.177:0/2655189558 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b98089e30 con 0x7f2ba00b2e40 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.528+0000 7f2b9f7fe700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b8c06b280 0x7f2b8c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.529+0000 7f2b9f7fe700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b8c06b280 0x7f2b8c06d740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000c270 tx=0x7f2b9000a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.533+0000 7f2b87fff700 1 -- 172.21.15.177:0/2655189558 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2b98054bf0 con 0x7f2ba00b2e40 2023-11-27T17:48:59.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.725+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ba0073aa0 con 0x7f2ba00b2e40 2023-11-27T17:48:59.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.727+0000 7f2b87fff700 1 -- 172.21.15.177:0/2655189558 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f2b98058210 con 0x7f2ba00b2e40 2023-11-27T17:48:59.730 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:48:59.730 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:48:18.172754+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:48:14.458670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:48:15.532637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:48:59.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b8c06b280 msgr2=0x7f2b8c06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b8c06b280 0x7f2b8c06d740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000c270 tx=0x7f2b9000a000 comp rx=0 tx=0).stop 2023-11-27T17:48:59.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba00b2e40 msgr2=0x7f2ba015cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba00b2e40 0x7f2ba015cd10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00b3850 tx=0x7f2b98011f80 comp rx=0 tx=0).stop 2023-11-27T17:48:59.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 shutdown_connections 2023-11-27T17:48:59.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2b8c06b280 0x7f2b8c06d740 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba00b2e40 0x7f2ba015cd10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b88003a00 0x7f2ba01f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 --2- 172.21.15.177:0/2655189558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ba0152690 0x7f2ba00b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 >> 172.21.15.177:0/2655189558 conn(0x7f2ba00b1ff0 msgr2=0x7f2ba0140e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:59.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 shutdown_connections 2023-11-27T17:48:59.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.729+0000 7f2ba5bb0700 1 -- 172.21.15.177:0/2655189558 wait complete. 2023-11-27T17:48:59.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T17:48:59.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.863+0000 7fcf897bb700 1 Processor -- start 2023-11-27T17:48:59.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.864+0000 7fcf897bb700 1 -- start start 2023-11-27T17:48:59.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf897bb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf8415b960 0x7fcf8415e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf897bb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84161b20 0x7fcf840716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf897bb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf84072060 con 0x7fcf84071c10 2023-11-27T17:48:59.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf897bb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8406c7b0 con 0x7fcf8415b960 2023-11-27T17:48:59.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf897bb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840b7400 con 0x7fcf84161b20 2023-11-27T17:48:59.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf837fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fcf84071c10 0x7fcf840704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47308/0 (socket says 172.21.15.177:47308) 2023-11-27T17:48:59.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf837fe700 1 -- 172.21.15.177:0/3117441160 learned_addr learned my addr 172.21.15.177:0/3117441160 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf827fc700 1 --2- 172.21.15.177:0/3117441160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84161b20 0x7fcf840716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf82ffd700 1 --2- 172.21.15.177:0/3117441160 >> v2:172.21.15.178:3300/0 conn(0x7fcf8415b960 0x7fcf8415e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf81ffb700 1 -- 172.21.15.177:0/3117441160 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159938866 0 0) 0x7fcf7c001490 con 0x7fcf84071c10 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf81ffb700 1 -- 172.21.15.177:0/3117441160 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c0035b0 con 0x7fcf84071c10 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf81ffb700 1 -- 172.21.15.177:0/3117441160 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268444627 0 0) 0x7fcf6c0035b0 con 0x7fcf84071c10 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf827fc700 1 -- 172.21.15.177:0/3117441160 >> v2:172.21.15.178:3300/0 conn(0x7fcf8415b960 msgr2=0x7fcf8415e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf827fc700 1 --2- 172.21.15.177:0/3117441160 >> v2:172.21.15.178:3300/0 conn(0x7fcf8415b960 0x7fcf8415e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf827fc700 1 -- 172.21.15.177:0/3117441160 >> v1:172.21.15.177:6789/0 conn(0x7fcf84071c10 legacy=0x7fcf840704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.865+0000 7fcf827fc700 1 -- 172.21.15.177:0/3117441160 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84162290 con 0x7fcf84161b20 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf827fc700 1 --2- 172.21.15.177:0/3117441160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84161b20 0x7fcf840716d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009840 tx=0x7fcf74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1d9ae37cd39aea server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf81ffb700 1 -- 172.21.15.177:0/3117441160 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c001b80 con 0x7fcf84161b20 2023-11-27T17:48:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf81ffb700 1 -- 172.21.15.177:0/3117441160 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74004030 con 0x7fcf84161b20 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf81ffb700 1 -- 172.21.15.177:0/3117441160 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740043a0 con 0x7fcf84161b20 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf897bb700 1 -- 172.21.15.177:0/3117441160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84161b20 msgr2=0x7fcf840716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3117441160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84161b20 0x7fcf840716d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009840 tx=0x7fcf74009b50 comp rx=0 tx=0).stop 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf897bb700 1 -- 172.21.15.177:0/3117441160 shutdown_connections 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3117441160 >> v2:172.21.15.178:3300/0 conn(0x7fcf8415b960 0x7fcf8415e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3117441160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84161b20 0x7fcf840716d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf897bb700 1 -- 172.21.15.177:0/3117441160 >> 172.21.15.177:0/3117441160 conn(0x7fcf840d1bf0 msgr2=0x7fcf840d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf897bb700 1 -- 172.21.15.177:0/3117441160 shutdown_connections 2023-11-27T17:48:59.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.866+0000 7fcf897bb700 1 -- 172.21.15.177:0/3117441160 wait complete. 2023-11-27T17:48:59.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.868+0000 7fcf897bb700 1 Processor -- start 2023-11-27T17:48:59.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.868+0000 7fcf897bb700 1 -- start start 2023-11-27T17:48:59.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf897bb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84071c10 0x7fcf8406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf897bb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8415b960 0x7fcf8406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf897bb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf84161b20 0x7fcf8415df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf897bb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406dbc0 con 0x7fcf84161b20 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf897bb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406cfb0 con 0x7fcf8415b960 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf897bb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406d290 con 0x7fcf84071c10 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf837fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf84161b20 0x7fcf8415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf837fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf84161b20 0x7fcf8415df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52996/0 (socket says 172.21.15.177:52996) 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf837fe700 1 -- 172.21.15.177:0/3172089466 learned_addr learned my addr 172.21.15.177:0/3172089466 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf82ffd700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84071c10 0x7fcf8406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf827fc700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8415b960 0x7fcf8406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf837fe700 1 -- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84071c10 msgr2=0x7fcf8406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf837fe700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84071c10 0x7fcf8406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf837fe700 1 -- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8415b960 msgr2=0x7fcf8406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf837fe700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8415b960 0x7fcf8406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.869+0000 7fcf837fe700 1 -- 172.21.15.177:0/3172089466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740094a0 con 0x7fcf84161b20 2023-11-27T17:48:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.870+0000 7fcf827fc700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8415b960 0x7fcf8406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:48:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.870+0000 7fcf837fe700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf84161b20 0x7fcf8415df60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00cc40 tx=0x7fcf7c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.870+0000 7fcf6b7fe700 1 -- 172.21.15.177:0/3172089466 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00ac20 con 0x7fcf84161b20 2023-11-27T17:48:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.870+0000 7fcf6b7fe700 1 -- 172.21.15.177:0/3172089466 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00ad80 con 0x7fcf84161b20 2023-11-27T17:48:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.870+0000 7fcf6b7fe700 1 -- 172.21.15.177:0/3172089466 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c007310 con 0x7fcf84161b20 2023-11-27T17:48:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.870+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8406d570 con 0x7fcf84161b20 2023-11-27T17:48:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.870+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf84160600 con 0x7fcf84161b20 2023-11-27T17:48:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.871+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf84068450 con 0x7fcf84161b20 2023-11-27T17:48:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.871+0000 7fcf6b7fe700 1 -- 172.21.15.177:0/3172089466 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcf7c007470 con 0x7fcf84161b20 2023-11-27T17:48:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.872+0000 7fcf6b7fe700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcf7006b250 0x7fcf7006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:48:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.872+0000 7fcf6b7fe700 1 -- 172.21.15.177:0/3172089466 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf7c089360 con 0x7fcf84161b20 2023-11-27T17:48:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.872+0000 7fcf82ffd700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcf7006b250 0x7fcf7006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:48:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.872+0000 7fcf82ffd700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcf7006b250 0x7fcf7006d710 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009b70 tx=0x7fcf78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:48:59.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:48:59.876+0000 7fcf6b7fe700 1 -- 172.21.15.177:0/3172089466 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcf7c054120 con 0x7fcf84161b20 2023-11-27T17:49:00.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.111+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcf84072060 con 0x7fcf84161b20 2023-11-27T17:49:00.114 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-11-27T17:49:00.112+0000 7fb12506b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T17:49:00.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.116+0000 7fcf6b7fe700 1 -- 172.21.15.177:0/3172089466 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcf84072060 con 0x7fcf84161b20 2023-11-27T17:49:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.118+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcf7006b250 msgr2=0x7fcf7006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.118+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcf7006b250 0x7fcf7006d710 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009b70 tx=0x7fcf78008040 comp rx=0 tx=0).stop 2023-11-27T17:49:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf84161b20 msgr2=0x7fcf8415df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf84161b20 0x7fcf8415df60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00cc40 tx=0x7fcf7c00a060 comp rx=0 tx=0).stop 2023-11-27T17:49:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 shutdown_connections 2023-11-27T17:49:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fcf7006b250 0x7fcf7006d710 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf84161b20 0x7fcf8415df60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf84071c10 0x7fcf8406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 --2- 172.21.15.177:0/3172089466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8415b960 0x7fcf8406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 >> 172.21.15.177:0/3172089466 conn(0x7fcf840d1bf0 msgr2=0x7fcf840b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 shutdown_connections 2023-11-27T17:49:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.119+0000 7fcf897bb700 1 -- 172.21.15.177:0/3172089466 wait complete. 2023-11-27T17:49:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T17:49:00.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T17:49:00.160 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-11-27T17:49:00.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.253+0000 7ff589213700 1 Processor -- start 2023-11-27T17:49:00.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.253+0000 7ff589213700 1 -- start start 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.254+0000 7ff589213700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5840cdff0 0x7ff584162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff589213700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5840afc30 0x7ff5840cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff589213700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff584162bc0 con 0x7ff584146f00 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff589213700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5841472e0 con 0x7ff5840cdff0 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff589213700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5840b0110 con 0x7ff5840afc30 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5840cdff0 0x7ff584162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5840cdff0 0x7ff584162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:32792/0 (socket says 172.21.15.177:32792) 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff582d9d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff584146f00 0x7ff5840cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:46296/0 (socket says 172.21.15.177:46296) 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58259c700 1 -- 172.21.15.177:0/87317426 learned_addr learned my addr 172.21.15.177:0/87317426 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:00.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58359e700 1 --2- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5840afc30 0x7ff5840cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58259c700 1 -- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5840afc30 msgr2=0x7ff5840cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58259c700 1 --2- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5840afc30 0x7ff5840cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58259c700 1 -- 172.21.15.177:0/87317426 >> v1:172.21.15.178:6789/0 conn(0x7ff584146f00 legacy=0x7ff5840cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff581d9b700 1 -- 172.21.15.177:0/87317426 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31797806 0 0) 0x7ff584162bc0 con 0x7ff584146f00 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58259c700 1 -- 172.21.15.177:0/87317426 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5840b03f0 con 0x7ff5840cdff0 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58359e700 1 --2- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5840afc30 0x7ff5840cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff58259c700 1 --2- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840cdff0 0x7ff584162680 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5740098f0 tx=0x7ff574009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=998ed3d779b2ebd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.255+0000 7ff581d9b700 1 -- 172.21.15.177:0/87317426 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574011830 con 0x7ff5840cdff0 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff581d9b700 1 -- 172.21.15.177:0/87317426 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff574011990 con 0x7ff5840cdff0 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff581d9b700 1 -- 172.21.15.177:0/87317426 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574011d20 con 0x7ff5840cdff0 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff589213700 1 -- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840cdff0 msgr2=0x7ff584162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:00.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff589213700 1 --2- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840cdff0 0x7ff584162680 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5740098f0 tx=0x7ff574009c00 comp rx=0 tx=0).stop 2023-11-27T17:49:00.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff589213700 1 -- 172.21.15.177:0/87317426 shutdown_connections 2023-11-27T17:49:00.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff589213700 1 --2- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5840afc30 0x7ff5840cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff589213700 1 --2- 172.21.15.177:0/87317426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840cdff0 0x7ff584162680 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff589213700 1 -- 172.21.15.177:0/87317426 >> 172.21.15.177:0/87317426 conn(0x7ff5840b38b0 msgr2=0x7ff5840b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:00.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff589213700 1 -- 172.21.15.177:0/87317426 shutdown_connections 2023-11-27T17:49:00.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.256+0000 7ff589213700 1 -- 172.21.15.177:0/87317426 wait complete. 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.258+0000 7ff589213700 1 Processor -- start 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.258+0000 7ff589213700 1 -- start start 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.258+0000 7ff589213700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840afc30 0x7ff5841e8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.258+0000 7ff589213700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5840cdff0 0x7ff584143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.258+0000 7ff589213700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff584146f00 0x7ff5841436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.258+0000 7ff589213700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff584142400 con 0x7ff5840cdff0 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.258+0000 7ff589213700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5841e8cf0 con 0x7ff5840afc30 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.258+0000 7ff589213700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5841426a0 con 0x7ff584146f00 2023-11-27T17:49:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff58259c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5840cdff0 0x7ff584143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff58259c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5840cdff0 0x7ff584143180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53010/0 (socket says 172.21.15.177:53010) 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff582d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840afc30 0x7ff5841e8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff58259c700 1 -- 172.21.15.177:0/2940377979 learned_addr learned my addr 172.21.15.177:0/2940377979 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff58359e700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff584146f00 0x7ff5841436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff582d9d700 1 -- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff584146f00 msgr2=0x7ff5841436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff582d9d700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff584146f00 0x7ff5841436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff582d9d700 1 -- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5840cdff0 msgr2=0x7ff584143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff582d9d700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5840cdff0 0x7ff584143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff582d9d700 1 -- 172.21.15.177:0/2940377979 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c009a70 con 0x7ff5840afc30 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff58259c700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5840cdff0 0x7ff584143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff58359e700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff584146f00 0x7ff5841436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff582d9d700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840afc30 0x7ff5841e8490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff57800c470 tx=0x7ff57800c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff56b7fe700 1 -- 172.21.15.177:0/2940377979 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578004c80 con 0x7ff5840afc30 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff56b7fe700 1 -- 172.21.15.177:0/2940377979 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff578004de0 con 0x7ff5840afc30 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff574009550 con 0x7ff5840afc30 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff56b7fe700 1 -- 172.21.15.177:0/2940377979 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578007310 con 0x7ff5840afc30 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.259+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff584142c60 con 0x7ff5840afc30 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.260+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5840aef70 con 0x7ff5840afc30 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.261+0000 7ff56b7fe700 1 -- 172.21.15.177:0/2940377979 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff578007470 con 0x7ff5840afc30 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.261+0000 7ff56b7fe700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff57006b250 0x7ff57006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.261+0000 7ff58259c700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff57006b250 0x7ff57006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.261+0000 7ff56b7fe700 1 -- 172.21.15.177:0/2940377979 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff5780895f0 con 0x7ff5840afc30 2023-11-27T17:49:00.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.261+0000 7ff58259c700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff57006b250 0x7ff57006d710 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5841f70e0 tx=0x7ff574008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:00.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.266+0000 7ff56b7fe700 1 -- 172.21.15.177:0/2940377979 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff5780542b0 con 0x7ff5840afc30 2023-11-27T17:49:00.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:00.501+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff584073890 con 0x7ff5840afc30 2023-11-27T17:49:01.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.121+0000 7ff56b7fe700 1 -- 172.21.15.177:0/2940377979 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff578007720 con 0x7ff5840afc30 2023-11-27T17:49:01.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff57006b250 msgr2=0x7ff57006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:01.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff57006b250 0x7ff57006d710 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5841f70e0 tx=0x7ff574008030 comp rx=0 tx=0).stop 2023-11-27T17:49:01.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840afc30 msgr2=0x7ff5841e8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:01.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840afc30 0x7ff5841e8490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff57800c470 tx=0x7ff57800c780 comp rx=0 tx=0).stop 2023-11-27T17:49:01.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 shutdown_connections 2023-11-27T17:49:01.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ff57006b250 0x7ff57006d710 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff584146f00 0x7ff5841436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5840afc30 0x7ff5841e8490 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 --2- 172.21.15.177:0/2940377979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5840cdff0 0x7ff584143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 >> 172.21.15.177:0/2940377979 conn(0x7ff5840b38b0 msgr2=0x7ff5840cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:01.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 shutdown_connections 2023-11-27T17:49:01.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.124+0000 7ff589213700 1 -- 172.21.15.177:0/2940377979 wait complete. 2023-11-27T17:49:01.139 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T17:49:01.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.262+0000 7f175d962700 1 Processor -- start 2023-11-27T17:49:01.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.262+0000 7f175d962700 1 -- start start 2023-11-27T17:49:01.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f175d962700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1758158590 0x7f1758161b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:01.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f175d962700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f17580d30f0 0x7f17580d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:01.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f175d962700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17580b7630 con 0x7f175815f060 2023-11-27T17:49:01.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f175d962700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1758162af0 con 0x7f17580d30f0 2023-11-27T17:49:01.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f175d962700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580d3a50 con 0x7f1758158590 2023-11-27T17:49:01.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f1756ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1758158590 0x7f1758161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:01.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f17577fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f17580d30f0 0x7f17580d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f17577fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f17580d30f0 0x7f17580d3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:32806/0 (socket says 172.21.15.177:32806) 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f1756ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1758158590 0x7f1758161b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:40480/0 (socket says 172.21.15.177:40480) 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f17567fc700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f175815f060 0x7f17580704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:46310/0 (socket says 172.21.15.177:46310) 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f1756ffd700 1 -- 172.21.15.177:0/204832122 learned_addr learned my addr 172.21.15.177:0/204832122 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f1756ffd700 1 -- 172.21.15.177:0/204832122 >> v2:172.21.15.178:3300/0 conn(0x7f17580d30f0 msgr2=0x7f17580d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f1756ffd700 1 --2- 172.21.15.177:0/204832122 >> v2:172.21.15.178:3300/0 conn(0x7f17580d30f0 0x7f17580d3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f1756ffd700 1 -- 172.21.15.177:0/204832122 >> v1:172.21.15.178:6789/0 conn(0x7f175815f060 legacy=0x7f17580704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f1756ffd700 1 -- 172.21.15.177:0/204832122 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175815f4e0 con 0x7f1758158590 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.263+0000 7f17577fe700 1 --2- 172.21.15.177:0/204832122 >> v2:172.21.15.178:3300/0 conn(0x7f17580d30f0 0x7f17580d3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f1756ffd700 1 --2- 172.21.15.177:0/204832122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1758158590 0x7f1758161b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f174c0098f0 tx=0x7f174c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccb465c87c3e67ec server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f1755ffb700 1 -- 172.21.15.177:0/204832122 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011830 con 0x7f1758158590 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f1755ffb700 1 -- 172.21.15.177:0/204832122 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c011990 con 0x7f1758158590 2023-11-27T17:49:01.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f1755ffb700 1 -- 172.21.15.177:0/204832122 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011d20 con 0x7f1758158590 2023-11-27T17:49:01.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f175d962700 1 -- 172.21.15.177:0/204832122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1758158590 msgr2=0x7f1758161b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:01.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f175d962700 1 --2- 172.21.15.177:0/204832122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1758158590 0x7f1758161b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f174c0098f0 tx=0x7f174c009c00 comp rx=0 tx=0).stop 2023-11-27T17:49:01.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f175d962700 1 -- 172.21.15.177:0/204832122 shutdown_connections 2023-11-27T17:49:01.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f175d962700 1 --2- 172.21.15.177:0/204832122 >> v2:172.21.15.178:3300/0 conn(0x7f17580d30f0 0x7f17580d3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f175d962700 1 --2- 172.21.15.177:0/204832122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1758158590 0x7f1758161b40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f175d962700 1 -- 172.21.15.177:0/204832122 >> 172.21.15.177:0/204832122 conn(0x7f17580d0ce0 msgr2=0x7f17580d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:01.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f175d962700 1 -- 172.21.15.177:0/204832122 shutdown_connections 2023-11-27T17:49:01.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.264+0000 7f175d962700 1 -- 172.21.15.177:0/204832122 wait complete. 2023-11-27T17:49:01.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.265+0000 7f175d962700 1 Processor -- start 2023-11-27T17:49:01.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.266+0000 7f175d962700 1 -- start start 2023-11-27T17:49:01.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.266+0000 7f175d962700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17580d30f0 0x7f17580b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:01.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.266+0000 7f175d962700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758158590 0x7f1758070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:01.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.266+0000 7f175d962700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175815f060 0x7f1758071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.266+0000 7f175d962700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17581f4860 con 0x7f1758158590 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.266+0000 7f175d962700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17581f3be0 con 0x7f17580d30f0 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.266+0000 7f175d962700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17581f3ec0 con 0x7f175815f060 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758158590 0x7f1758070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758158590 0x7f1758070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53020/0 (socket says 172.21.15.177:53020) 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 -- 172.21.15.177:0/3783169853 learned_addr learned my addr 172.21.15.177:0/3783169853 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17577fe700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175815f060 0x7f1758071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f1756ffd700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17580d30f0 0x7f17580b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 -- 172.21.15.177:0/3783169853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175815f060 msgr2=0x7f1758071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175815f060 0x7f1758071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 -- 172.21.15.177:0/3783169853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17580d30f0 msgr2=0x7f17580b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17580d30f0 0x7f17580b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:01.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 -- 172.21.15.177:0/3783169853 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750009a70 con 0x7f1758158590 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f17567fc700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758158590 0x7f1758070e20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f174800c490 tx=0x7f174800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f173ffff700 1 -- 172.21.15.177:0/3783169853 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748005cb0 con 0x7f1758158590 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c009550 con 0x7f1758158590 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f173ffff700 1 -- 172.21.15.177:0/3783169853 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174800ce90 con 0x7f1758158590 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f173ffff700 1 -- 172.21.15.177:0/3783169853 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17480072d0 con 0x7f1758158590 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.267+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17581f4480 con 0x7f1758158590 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.268+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1758068450 con 0x7f1758158590 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.269+0000 7f173ffff700 1 -- 172.21.15.177:0/3783169853 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1748007430 con 0x7f1758158590 2023-11-27T17:49:01.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.269+0000 7f173ffff700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f174406b250 0x7f174406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:01.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.269+0000 7f173ffff700 1 -- 172.21.15.177:0/3783169853 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1748088c30 con 0x7f1758158590 2023-11-27T17:49:01.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.269+0000 7f1756ffd700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f174406b250 0x7f174406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:01.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.270+0000 7f1756ffd700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f174406b250 0x7f174406d710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f174c009c40 tx=0x7f174c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:01.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.274+0000 7f173ffff700 1 -- 172.21.15.177:0/3783169853 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f17480539c0 con 0x7f1758158590 2023-11-27T17:49:01.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:01.463+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1758074e90 con 0x7f1758158590 2023-11-27T17:49:02.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.121+0000 7f173ffff700 1 -- 172.21.15.177:0/3783169853 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1748056fe0 con 0x7f1758158590 2023-11-27T17:49:02.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.124+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f174406b250 msgr2=0x7f174406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:02.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.124+0000 7f175d962700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f174406b250 0x7f174406d710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f174c009c40 tx=0x7f174c008030 comp rx=0 tx=0).stop 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.124+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758158590 msgr2=0x7f1758070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.124+0000 7f175d962700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758158590 0x7f1758070e20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f174800c490 tx=0x7f174800c7a0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.125+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 shutdown_connections 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.125+0000 7f175d962700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f174406b250 0x7f174406d710 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.125+0000 7f175d962700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175815f060 0x7f1758071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.125+0000 7f175d962700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17580d30f0 0x7f17580b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.125+0000 7f175d962700 1 --2- 172.21.15.177:0/3783169853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758158590 0x7f1758070e20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.125+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 >> 172.21.15.177:0/3783169853 conn(0x7f17580d0ce0 msgr2=0x7f175815d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.125+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 shutdown_connections 2023-11-27T17:49:02.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.125+0000 7f175d962700 1 -- 172.21.15.177:0/3783169853 wait complete. 2023-11-27T17:49:02.153 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-11-27T17:49:02.154 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T17:49:02.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.278+0000 7f688c759700 1 Processor -- start 2023-11-27T17:49:02.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.278+0000 7f688c759700 1 -- start start 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.279+0000 7f688c759700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.279+0000 7f688c759700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f688415baa0 0x7f68840b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.279+0000 7f688c759700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68840cd590 con 0x7f688415bf20 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.279+0000 7f688c759700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68840cf160 con 0x7f688415baa0 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.279+0000 7f688c759700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68840cf440 con 0x7f688415b6c0 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f6889cf4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f688415baa0 0x7f68840b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f688a4f5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f6889cf4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f688415baa0 0x7f68840b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:32816/0 (socket says 172.21.15.177:32816) 2023-11-27T17:49:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f688acf6700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f688415bf20 0x7f688415e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:46324/0 (socket says 172.21.15.177:46324) 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f6889cf4700 1 -- 172.21.15.177:0/2176916794 learned_addr learned my addr 172.21.15.177:0/2176916794 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f688a4f5700 1 -- 172.21.15.177:0/2176916794 >> v2:172.21.15.178:3300/0 conn(0x7f688415baa0 msgr2=0x7f68840b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f688a4f5700 1 --2- 172.21.15.177:0/2176916794 >> v2:172.21.15.178:3300/0 conn(0x7f688415baa0 0x7f68840b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f688a4f5700 1 -- 172.21.15.177:0/2176916794 >> v1:172.21.15.178:6789/0 conn(0x7f688415bf20 legacy=0x7f688415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f688a4f5700 1 -- 172.21.15.177:0/2176916794 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840cf720 con 0x7f688415b6c0 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f6889cf4700 1 --2- 172.21.15.177:0/2176916794 >> v2:172.21.15.178:3300/0 conn(0x7f688415baa0 0x7f68840b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f688a4f5700 1 --2- 172.21.15.177:0/2176916794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840ceaa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6874009840 tx=0x7f6874009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50d95ddc99de50c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.280+0000 7f68894f3700 1 -- 172.21.15.177:0/2176916794 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874011830 con 0x7f688415b6c0 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f68894f3700 1 -- 172.21.15.177:0/2176916794 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874011990 con 0x7f688415b6c0 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f68894f3700 1 -- 172.21.15.177:0/2176916794 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874011d20 con 0x7f688415b6c0 2023-11-27T17:49:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f688c759700 1 -- 172.21.15.177:0/2176916794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 msgr2=0x7f68840ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f688c759700 1 --2- 172.21.15.177:0/2176916794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840ceaa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6874009840 tx=0x7f6874009b50 comp rx=0 tx=0).stop 2023-11-27T17:49:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f688c759700 1 -- 172.21.15.177:0/2176916794 shutdown_connections 2023-11-27T17:49:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f688c759700 1 --2- 172.21.15.177:0/2176916794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840ceaa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f688c759700 1 --2- 172.21.15.177:0/2176916794 >> v2:172.21.15.178:3300/0 conn(0x7f688415baa0 0x7f68840b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f688c759700 1 -- 172.21.15.177:0/2176916794 >> 172.21.15.177:0/2176916794 conn(0x7f68840b3cc0 msgr2=0x7f68840b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f688c759700 1 -- 172.21.15.177:0/2176916794 shutdown_connections 2023-11-27T17:49:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.281+0000 7f688c759700 1 -- 172.21.15.177:0/2176916794 wait complete. 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.282+0000 7f688c759700 1 Processor -- start 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.282+0000 7f688c759700 1 -- start start 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688c759700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688c759700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688415baa0 0x7f68840b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688c759700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f688415bf20 0x7f68840706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688c759700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840726b0 con 0x7f688415bf20 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688c759700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6884071420 con 0x7f688415baa0 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688c759700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68841444e0 con 0x7f688415b6c0 2023-11-27T17:49:02.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688acf6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f688415bf20 0x7f68840706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688acf6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f688415bf20 0x7f68840706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53036/0 (socket says 172.21.15.177:53036) 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688acf6700 1 -- 172.21.15.177:0/2122823761 learned_addr learned my addr 172.21.15.177:0/2122823761 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f688a4f5700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.283+0000 7f6889cf4700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688415baa0 0x7f68840b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f688acf6700 1 -- 172.21.15.177:0/2122823761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 msgr2=0x7f68840b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f688acf6700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f688acf6700 1 -- 172.21.15.177:0/2122823761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688415baa0 msgr2=0x7f68840b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f688acf6700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688415baa0 0x7f68840b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f688acf6700 1 -- 172.21.15.177:0/2122823761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6880009550 con 0x7f688415bf20 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f688acf6700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f688415bf20 0x7f68840706b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f687c00cbc0 tx=0x7f687c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:02.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f687affd700 1 -- 172.21.15.177:0/2122823761 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c00a9e0 con 0x7f688415bf20 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f687affd700 1 -- 172.21.15.177:0/2122823761 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c00ab40 con 0x7f688415bf20 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68740094a0 con 0x7f688415bf20 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f687affd700 1 -- 172.21.15.177:0/2122823761 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c007070 con 0x7f688415bf20 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.284+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6884144aa0 con 0x7f688415bf20 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.285+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688404f7b0 con 0x7f688415bf20 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.285+0000 7f687affd700 1 -- 172.21.15.177:0/2122823761 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f687c0071d0 con 0x7f688415bf20 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.286+0000 7f687affd700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f686806b250 0x7f686806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.286+0000 7f687affd700 1 -- 172.21.15.177:0/2122823761 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f687c089470 con 0x7f688415bf20 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.286+0000 7f688a4f5700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f686806b250 0x7f686806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:02.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.286+0000 7f688a4f5700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f686806b250 0x7f686806d710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6874000c00 tx=0x7f6874008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:02.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.290+0000 7f687affd700 1 -- 172.21.15.177:0/2122823761 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f687c054310 con 0x7f688415bf20 2023-11-27T17:49:02.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:02.481+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6884166970 con 0x7f688415bf20 2023-11-27T17:49:03.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.126+0000 7f687affd700 1 -- 172.21.15.177:0/2122823761 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f687c057930 con 0x7f688415bf20 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f686806b250 msgr2=0x7f686806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f686806b250 0x7f686806d710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6874000c00 tx=0x7f6874008030 comp rx=0 tx=0).stop 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f688415bf20 msgr2=0x7f68840706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f688415bf20 0x7f68840706b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f687c00cbc0 tx=0x7f687c00ced0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 shutdown_connections 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f686806b250 0x7f686806d710 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f688415bf20 0x7f68840706b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f688415b6c0 0x7f68840b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 --2- 172.21.15.177:0/2122823761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688415baa0 0x7f68840b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.129+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 >> 172.21.15.177:0/2122823761 conn(0x7f68840b3cc0 msgr2=0x7f688406d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:03.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.130+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 shutdown_connections 2023-11-27T17:49:03.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.130+0000 7f688c759700 1 -- 172.21.15.177:0/2122823761 wait complete. 2023-11-27T17:49:03.133 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-11-27T17:49:03.147 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T17:49:03.147 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-27T17:49:03.147 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T17:49:03.147 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T17:49:03.148 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T17:49:03.148 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-27T17:49:03.148 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T17:49:03.148 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T17:49:03.148 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T17:49:03.148 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-27T17:49:03.148 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T17:49:03.149 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T17:49:03.149 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T17:49:03.149 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-27T17:49:03.149 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-27T17:49:03.149 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T17:49:03.159 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T17:49:03.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T17:49:03.159 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T17:49:03.160 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T17:49:03.160 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T17:49:03.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T17:49:03.161 INFO:tasks.ceph.mds.d:Stopped 2023-11-27T17:49:03.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-27T17:49:03.201 INFO:tasks.ceph.mds.a:Started 2023-11-27T17:49:03.202 DEBUG:teuthology.parallel:result is None 2023-11-27T17:49:03.203 INFO:tasks.ceph.mds.c:Started 2023-11-27T17:49:03.203 DEBUG:teuthology.parallel:result is None 2023-11-27T17:49:03.204 INFO:tasks.ceph.mds.b:Started 2023-11-27T17:49:03.204 DEBUG:teuthology.parallel:result is None 2023-11-27T17:49:03.204 INFO:tasks.ceph.mds.d:Started 2023-11-27T17:49:03.204 DEBUG:teuthology.parallel:result is None 2023-11-27T17:49:03.205 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-27T17:49:03.284 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-11-27T17:49:03.285 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-11-27T17:49:03.286 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-11-27T17:49:03.287 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-11-27T17:49:03.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.331+0000 7fddba422700 1 Processor -- start 2023-11-27T17:49:03.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.331+0000 7fddba422700 1 -- start start 2023-11-27T17:49:03.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddba422700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fddb40cf3c0 0x7fddb40b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:03.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddba422700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fddb4160350 0x7fddb4144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:03.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddba422700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb40b2af0 con 0x7fddb40b2690 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddba422700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb41609e0 con 0x7fddb4160350 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddba422700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb41607a0 con 0x7fddb40cf3c0 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb37fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fddb40b2690 0x7fddb415fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47384/0 (socket says 172.21.15.177:47384) 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb37fe700 1 -- 172.21.15.177:0/2264461898 learned_addr learned my addr 172.21.15.177:0/2264461898 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb89bf700 1 --2- 172.21.15.177:0/2264461898 >> v2:172.21.15.177:3300/0 conn(0x7fddb4160350 0x7fddb4144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb3fff700 1 --2- 172.21.15.177:0/2264461898 >> v2:172.21.15.178:3300/0 conn(0x7fddb40cf3c0 0x7fddb40b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb2ffd700 1 -- 172.21.15.177:0/2264461898 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48304130 0 0) 0x7fddb40b2af0 con 0x7fddb40b2690 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb2ffd700 1 -- 172.21.15.177:0/2264461898 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd9c0035b0 con 0x7fddb40b2690 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb89bf700 1 -- 172.21.15.177:0/2264461898 >> v2:172.21.15.178:3300/0 conn(0x7fddb40cf3c0 msgr2=0x7fddb40b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb89bf700 1 --2- 172.21.15.177:0/2264461898 >> v2:172.21.15.178:3300/0 conn(0x7fddb40cf3c0 0x7fddb40b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb89bf700 1 -- 172.21.15.177:0/2264461898 >> v1:172.21.15.177:6789/0 conn(0x7fddb40b2690 legacy=0x7fddb415fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb89bf700 1 -- 172.21.15.177:0/2264461898 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40b7490 con 0x7fddb4160350 2023-11-27T17:49:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb89bf700 1 --2- 172.21.15.177:0/2264461898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4160350 0x7fddb4144fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fddb40b8320 tx=0x7fddac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fcdb39b548d39b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb2ffd700 1 -- 172.21.15.177:0/2264461898 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac00e070 con 0x7fddb4160350 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb2ffd700 1 -- 172.21.15.177:0/2264461898 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac00bb20 con 0x7fddb4160350 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.333+0000 7fddb2ffd700 1 -- 172.21.15.177:0/2264461898 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac012430 con 0x7fddb4160350 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.334+0000 7fddba422700 1 -- 172.21.15.177:0/2264461898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4160350 msgr2=0x7fddb4144fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.334+0000 7fddba422700 1 --2- 172.21.15.177:0/2264461898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4160350 0x7fddb4144fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fddb40b8320 tx=0x7fddac00b330 comp rx=0 tx=0).stop 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.334+0000 7fddba422700 1 -- 172.21.15.177:0/2264461898 shutdown_connections 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.334+0000 7fddba422700 1 --2- 172.21.15.177:0/2264461898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb4160350 0x7fddb4144fe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.334+0000 7fddba422700 1 --2- 172.21.15.177:0/2264461898 >> v2:172.21.15.178:3300/0 conn(0x7fddb40cf3c0 0x7fddb40b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.334+0000 7fddba422700 1 -- 172.21.15.177:0/2264461898 >> 172.21.15.177:0/2264461898 conn(0x7fddb4072190 msgr2=0x7fddb40725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.334+0000 7fddba422700 1 -- 172.21.15.177:0/2264461898 shutdown_connections 2023-11-27T17:49:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.334+0000 7fddba422700 1 -- 172.21.15.177:0/2264461898 wait complete. 2023-11-27T17:49:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.335+0000 7fddba422700 1 Processor -- start 2023-11-27T17:49:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.335+0000 7fddba422700 1 -- start start 2023-11-27T17:49:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddba422700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb40b2690 0x7fddb41476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddba422700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb40cf3c0 0x7fddb4145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddba422700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb4160350 0x7fddb4145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddba422700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4147280 con 0x7fddb40b2690 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddba422700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4147be0 con 0x7fddb40cf3c0 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddba422700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4146600 con 0x7fddb4160350 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddb3fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb40b2690 0x7fddb41476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddb3fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb40b2690 0x7fddb41476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53070/0 (socket says 172.21.15.177:53070) 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddb3fff700 1 -- 172.21.15.177:0/3752575674 learned_addr learned my addr 172.21.15.177:0/3752575674 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddb37fe700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb40cf3c0 0x7fddb4145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.336+0000 7fddb89bf700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb4160350 0x7fddb4145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb3fff700 1 -- 172.21.15.177:0/3752575674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb4160350 msgr2=0x7fddb4145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb3fff700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb4160350 0x7fddb4145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb3fff700 1 -- 172.21.15.177:0/3752575674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb40cf3c0 msgr2=0x7fddb4145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb3fff700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb40cf3c0 0x7fddb4145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb3fff700 1 -- 172.21.15.177:0/3752575674 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac009a70 con 0x7fddb40b2690 2023-11-27T17:49:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb3fff700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb40b2690 0x7fddb41476a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdda400e840 tx=0x7fdda400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb0ff9700 1 -- 172.21.15.177:0/3752575674 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4013610 con 0x7fddb40b2690 2023-11-27T17:49:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb0ff9700 1 -- 172.21.15.177:0/3752575674 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda4013770 con 0x7fddb40b2690 2023-11-27T17:49:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb41468e0 con 0x7fddb40b2690 2023-11-27T17:49:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddb0ff9700 1 -- 172.21.15.177:0/3752575674 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4013b20 con 0x7fddb40b2690 2023-11-27T17:49:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.337+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb4146ea0 con 0x7fddb40b2690 2023-11-27T17:49:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.338+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb4073aa0 con 0x7fddb40b2690 2023-11-27T17:49:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.339+0000 7fddb0ff9700 1 -- 172.21.15.177:0/3752575674 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdda4013c80 con 0x7fddb40b2690 2023-11-27T17:49:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.339+0000 7fddb0ff9700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdda006b280 0x7fdda006d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:03.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.339+0000 7fddb0ff9700 1 -- 172.21.15.177:0/3752575674 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdda4089230 con 0x7fddb40b2690 2023-11-27T17:49:03.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.339+0000 7fddb37fe700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdda006b280 0x7fdda006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:03.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.339+0000 7fddb37fe700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdda006b280 0x7fdda006d740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fddb41f7120 tx=0x7fdda8007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:03.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.343+0000 7fddb0ff9700 1 -- 172.21.15.177:0/3752575674 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdda40541e0 con 0x7fddb40b2690 2023-11-27T17:49:03.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-27T17:49:03.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-27T17:49:03.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-27T17:49:03.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-27T17:49:03.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:03.548+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fddb4069400 con 0x7fddb40b2690 2023-11-27T17:49:04.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.776+0000 7fddb0ff9700 1 -- 172.21.15.177:0/3752575674 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdda4057800 con 0x7fddb40b2690 2023-11-27T17:49:04.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdda006b280 msgr2=0x7fdda006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdda006b280 0x7fdda006d740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fddb41f7120 tx=0x7fdda8007dc0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb40b2690 msgr2=0x7fddb41476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb40b2690 0x7fddb41476a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdda400e840 tx=0x7fdda400eb50 comp rx=0 tx=0).stop 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 shutdown_connections 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fdda006b280 0x7fdda006d740 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb4160350 0x7fddb4145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb40b2690 0x7fddb41476a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 --2- 172.21.15.177:0/3752575674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb40cf3c0 0x7fddb4145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 >> 172.21.15.177:0/3752575674 conn(0x7fddb4072190 msgr2=0x7fddb40b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 shutdown_connections 2023-11-27T17:49:04.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.779+0000 7fddba422700 1 -- 172.21.15.177:0/3752575674 wait complete. 2023-11-27T17:49:04.783 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-11-27T17:49:04.796 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-27T17:49:04.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.919+0000 7fac4c46e700 1 Processor -- start 2023-11-27T17:49:04.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.919+0000 7fac4c46e700 1 -- start start 2023-11-27T17:49:04.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.920+0000 7fac4c46e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fac44147880 0x7fac4406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:04.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.920+0000 7fac4c46e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fac44070c00 0x7fac4415f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:04.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.920+0000 7fac4c46e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac440b5ce0 con 0x7fac440b6170 2023-11-27T17:49:04.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.920+0000 7fac4c46e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440b5700 con 0x7fac44147880 2023-11-27T17:49:04.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.920+0000 7fac4c46e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4406e230 con 0x7fac44070c00 2023-11-27T17:49:04.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.920+0000 7fac4a20a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fac44147880 0x7fac4406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.920+0000 7fac4a20a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fac44147880 0x7fac4406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53082/0 (socket says 172.21.15.177:53082) 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.920+0000 7fac4a20a700 1 -- 172.21.15.177:0/3017124039 learned_addr learned my addr 172.21.15.177:0/3017124039 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4aa0b700 1 --2- 172.21.15.177:0/3017124039 >> v2:172.21.15.178:3300/0 conn(0x7fac44070c00 0x7fac4415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4a20a700 1 -- 172.21.15.177:0/3017124039 >> v2:172.21.15.178:3300/0 conn(0x7fac44070c00 msgr2=0x7fac4415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4a20a700 1 --2- 172.21.15.177:0/3017124039 >> v2:172.21.15.178:3300/0 conn(0x7fac44070c00 0x7fac4415f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4a20a700 1 -- 172.21.15.177:0/3017124039 >> v1:172.21.15.178:6789/0 conn(0x7fac440b6170 legacy=0x7fac440704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4a20a700 1 -- 172.21.15.177:0/3017124039 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440b5970 con 0x7fac44147880 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4a20a700 1 --2- 172.21.15.177:0/3017124039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac4406d910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fac440b1650 tx=0x7fac34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879539f88dd14f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac49208700 1 -- 172.21.15.177:0/3017124039 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34004230 con 0x7fac44147880 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac49208700 1 -- 172.21.15.177:0/3017124039 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34004390 con 0x7fac44147880 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac49208700 1 -- 172.21.15.177:0/3017124039 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340036a0 con 0x7fac44147880 2023-11-27T17:49:04.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4c46e700 1 -- 172.21.15.177:0/3017124039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 msgr2=0x7fac4406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:04.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4c46e700 1 --2- 172.21.15.177:0/3017124039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac4406d910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fac440b1650 tx=0x7fac34009bd0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4c46e700 1 -- 172.21.15.177:0/3017124039 shutdown_connections 2023-11-27T17:49:04.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4c46e700 1 --2- 172.21.15.177:0/3017124039 >> v2:172.21.15.178:3300/0 conn(0x7fac44070c00 0x7fac4415f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4c46e700 1 --2- 172.21.15.177:0/3017124039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac4406d910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.921+0000 7fac4c46e700 1 -- 172.21.15.177:0/3017124039 >> 172.21.15.177:0/3017124039 conn(0x7fac440b2130 msgr2=0x7fac440b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:04.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.922+0000 7fac4c46e700 1 -- 172.21.15.177:0/3017124039 shutdown_connections 2023-11-27T17:49:04.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.922+0000 7fac4c46e700 1 -- 172.21.15.177:0/3017124039 wait complete. 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.923+0000 7fac4c46e700 1 Processor -- start 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.923+0000 7fac4c46e700 1 -- start start 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.923+0000 7fac4c46e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac44070c00 0x7fac4415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.923+0000 7fac4c46e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac440b6170 0x7fac441f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.923+0000 7fac4c46e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac440af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.923+0000 7fac4c46e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac441f7e80 con 0x7fac44147880 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.923+0000 7fac4c46e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac441f78c0 con 0x7fac440b6170 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.923+0000 7fac4c46e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac441f7ba0 con 0x7fac44070c00 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac440af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac440af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53092/0 (socket says 172.21.15.177:53092) 2023-11-27T17:49:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 -- 172.21.15.177:0/2699161820 learned_addr learned my addr 172.21.15.177:0/2699161820 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4a20a700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac44070c00 0x7fac4415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac49a09700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac440b6170 0x7fac441f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 -- 172.21.15.177:0/2699161820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac44070c00 msgr2=0x7fac4415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac44070c00 0x7fac4415d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 -- 172.21.15.177:0/2699161820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac440b6170 msgr2=0x7fac441f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac440b6170 0x7fac441f6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 -- 172.21.15.177:0/2699161820 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34009550 con 0x7fac44147880 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4aa0b700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac440af1e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00cc30 tx=0x7fac3c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac3affd700 1 -- 172.21.15.177:0/2699161820 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c00aa50 con 0x7fac44147880 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac3affd700 1 -- 172.21.15.177:0/2699161820 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c00abb0 con 0x7fac44147880 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac440ae9e0 con 0x7fac44147880 2023-11-27T17:49:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac3affd700 1 -- 172.21.15.177:0/2699161820 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c003a20 con 0x7fac44147880 2023-11-27T17:49:04.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.924+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4415dde0 con 0x7fac44147880 2023-11-27T17:49:04.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.925+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac44073aa0 con 0x7fac44147880 2023-11-27T17:49:04.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.926+0000 7fac3affd700 1 -- 172.21.15.177:0/2699161820 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fac3c00f3f0 con 0x7fac44147880 2023-11-27T17:49:04.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.926+0000 7fac3affd700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fac2806b250 0x7fac2806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:04.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.926+0000 7fac4a20a700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fac2806b250 0x7fac2806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:04.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.926+0000 7fac3affd700 1 -- 172.21.15.177:0/2699161820 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac3c0896e0 con 0x7fac44147880 2023-11-27T17:49:04.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.926+0000 7fac4a20a700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fac2806b250 0x7fac2806d710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fac34009130 tx=0x7fac34008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:04.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:04.931+0000 7fac3affd700 1 -- 172.21.15.177:0/2699161820 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fac3c0547f0 con 0x7fac44147880 2023-11-27T17:49:05.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.202+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fac440aef00 con 0x7fac44147880 2023-11-27T17:49:05.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.202+0000 7fac3affd700 1 -- 172.21.15.177:0/2699161820 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fac3c01d020 con 0x7fac44147880 2023-11-27T17:49:05.205 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:05.205 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-27T17:49:05.205 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-11-27T17:49:05.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.205 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-11-27T17:49:05.205 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRlHP6KExAAukLdiilIGGneFbtBeNl2gg==", 2023-11-27T17:49:05.205 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRlPs3kHxAA4b1vBwh/PKOwkk0RVpSZFg==", 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-27T17:49:05.206 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRlsrffGhAAmmygO3kh060STqc/7fxe2Q==", 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.207 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRlc7FPJxAAKAHwbRGrKom3FaNFuNFCbw==", 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAs1mRllPbgBRAAeQtd2cCiAnc7LM7pbt+MUQ==", 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAv1mRlrGenBRAAP/aWP6geRnrnqjBca4bFHQ==", 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-27T17:49:05.209 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAy1mRlNB3YBRAA3+VtBsPlmjUtpqLbSm+Sdw==", 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQA11mRlxpB4BRAAhLKAEZAsjsiRiFVyqyzMKg==", 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQA51mRl/oqWERAAeyQH3VKzZySxfp8w1BS25w==", 2023-11-27T17:49:05.211 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQA81mRl2cfNEBAA6dQetCMJA+zzMKVi15mkcQ==", 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.212 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBG1mRl31/QAhAA5MrpSoluxAETuL2GlkA5Ig==", 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-11-27T17:49:05.213 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBJ1mRls/I4AhAAV4/Hlg8ogU4uZPlEx1geOg==", 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRl71yWKxAAe2FZ+w7xYRvPZ8mqVdPkZQ==", 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-27T17:49:05.214 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRlZ7dKMhAA7VqlnWB0UiO2FqE2+g2gGw==", 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.215 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRlQf3vLhAAa5BNgV/MIf4oPB9oO3D7jQ==", 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.216 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRljCAxOBAAZ63GVtYgdskTFi4ebeGTGg==", 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg==", 2023-11-27T17:49:05.217 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-mds", 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBP1mRlEH10ABAATLxflxm8ewU50DvxHxuFLg==", 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-mds" 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-mgr", 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBP1mRlX4V0ABAAwM5yLR3e2TibOjYhYpmChA==", 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-osd", 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBP1mRlOIx0ABAAXopvWUTNvVsVxC+q8moCWA==", 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.219 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-osd" 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rbd", 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBP1mRl25R0ABAAt60ZwpmOJwLJcNQRRm9osA==", 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBP1mRl9Jt0ABAAZwXBLgQ8fHf8bVW9q/apOg==", 2023-11-27T17:49:05.220 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rgw", 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBP1mRlS6N0ABAAbQgA12nl1WZ24EZ/ClW9RQ==", 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-11-27T17:49:05.221 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRlw88nEBAAbGSsb0x5a/j56Gq7ev0wrw==", 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQAo1mRlvvNIDBAA4uMdKVdinQhFG5SSLgNqaA==", 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-11-27T17:49:05.222 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-11-27T17:49:05.223 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.223 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:05.223 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-11-27T17:49:05.223 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-27T17:49:05.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fac2806b250 msgr2=0x7fac2806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fac2806b250 0x7fac2806d710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fac34009130 tx=0x7fac34008030 comp rx=0 tx=0).stop 2023-11-27T17:49:05.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 msgr2=0x7fac440af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac440af1e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00cc30 tx=0x7fac3c00cf40 comp rx=0 tx=0).stop 2023-11-27T17:49:05.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 shutdown_connections 2023-11-27T17:49:05.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fac2806b250 0x7fac2806d710 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac44147880 0x7fac440af1e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac44070c00 0x7fac4415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 --2- 172.21.15.177:0/2699161820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac440b6170 0x7fac441f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 >> 172.21.15.177:0/2699161820 conn(0x7fac440b2130 msgr2=0x7fac440b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:05.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 shutdown_connections 2023-11-27T17:49:05.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.205+0000 7fac4c46e700 1 -- 172.21.15.177:0/2699161820 wait complete. 2023-11-27T17:49:05.226 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-27T17:49:05.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.344+0000 7f696a030700 1 Processor -- start 2023-11-27T17:49:05.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.344+0000 7f696a030700 1 -- start start 2023-11-27T17:49:05.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f696a030700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6964147880 0x7f696406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f696a030700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640b5ce0 con 0x7f69640b6170 2023-11-27T17:49:05.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f696a030700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640b5700 con 0x7f6964070c00 2023-11-27T17:49:05.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f696a030700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696406e230 con 0x7f6964147880 2023-11-27T17:49:05.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f6962ffd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f69640b6170 0x7f69640704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47414/0 (socket says 172.21.15.177:47414) 2023-11-27T17:49:05.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f6962ffd700 1 -- 172.21.15.177:0/775349164 learned_addr learned my addr 172.21.15.177:0/775349164 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:05.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702714488 0 0) 0x7f69640b5ce0 con 0x7f69640b6170 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69500035b0 con 0x7f69640b6170 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f69637fe700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6964147880 0x7f696406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4225373839 0 0) 0x7f69500035b0 con 0x7f69640b6170 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6964147880 msgr2=0x7f696406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f69627fc700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6964147880 0x7f696406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.345+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 >> v1:172.21.15.178:6789/0 conn(0x7f6964070c00 legacy=0x7f696415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640b5970 con 0x7f69640b6170 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f6954001670 con 0x7f69640b6170 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 >> v1:172.21.15.177:6789/0 conn(0x7f69640b6170 legacy=0x7f69640704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6964147880 0x7f6950003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6950004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6950004d90 0x7f6950005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696406e230 con 0x7f6950003f70 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695000ba70 con 0x7f6950004d90 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695000bc30 con 0x7f6964147880 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f6962ffd700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6950004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69637fe700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6964147880 0x7f6950003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f6963fff700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6950004d90 0x7f6950005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f6962ffd700 1 -- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6964147880 msgr2=0x7f6950003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f6962ffd700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6964147880 0x7f6950003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f6962ffd700 1 -- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6950004d90 msgr2=0x7f6950005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f6962ffd700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6950004d90 0x7f6950005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f6962ffd700 1 -- 172.21.15.177:0/775349164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500035b0 con 0x7f6950003f70 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f6962ffd700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6950004850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f695400c2f0 tx=0x7f6950005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8599c8354fe952e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:05.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400cd70 con 0x7f6950003f70 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954005960 con 0x7f6950003f70 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.346+0000 7f69627fc700 1 -- 172.21.15.177:0/775349164 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954005d10 con 0x7f6950003f70 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.347+0000 7f696a030700 1 -- 172.21.15.177:0/775349164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 msgr2=0x7f6950004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.347+0000 7f696a030700 1 --2- 172.21.15.177:0/775349164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6950004850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f695400c2f0 tx=0x7f6950005880 comp rx=0 tx=0).stop 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.347+0000 7f6963fff700 1 -- 172.21.15.177:0/775349164 reap_dead start 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.347+0000 7f696a030700 1 -- 172.21.15.177:0/775349164 shutdown_connections 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.347+0000 7f696a030700 1 -- 172.21.15.177:0/775349164 >> 172.21.15.177:0/775349164 conn(0x7f69640b2130 msgr2=0x7f69640b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.347+0000 7f696a030700 1 -- 172.21.15.177:0/775349164 shutdown_connections 2023-11-27T17:49:05.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.347+0000 7f696a030700 1 -- 172.21.15.177:0/775349164 wait complete. 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.348+0000 7f696a030700 1 Processor -- start 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.348+0000 7f696a030700 1 -- start start 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f696a030700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6964141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f696a030700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69640af2c0 0x7f69640af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f696a030700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696413e150 0x7f696413e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f696a030700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640c6e70 con 0x7f6950003f70 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f696a030700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69641544e0 con 0x7f69640af2c0 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f696a030700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640afc80 con 0x7f696413e150 2023-11-27T17:49:05.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f69637fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6964141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f69637fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6964141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53108/0 (socket says 172.21.15.177:53108) 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f69637fe700 1 -- 172.21.15.177:0/787394245 learned_addr learned my addr 172.21.15.177:0/787394245 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f6963fff700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696413e150 0x7f696413e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f69637fe700 1 -- 172.21.15.177:0/787394245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696413e150 msgr2=0x7f696413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f6962ffd700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69640af2c0 0x7f69640af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f69637fe700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696413e150 0x7f696413e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f69637fe700 1 -- 172.21.15.177:0/787394245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69640af2c0 msgr2=0x7f69640af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f69637fe700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69640af2c0 0x7f69640af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.349+0000 7f69637fe700 1 -- 172.21.15.177:0/787394245 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696413eb10 con 0x7f6950003f70 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.350+0000 7f69637fe700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6964141fc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f694c011ad0 tx=0x7f694c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.350+0000 7f695bfff700 1 -- 172.21.15.177:0/787394245 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00f9a0 con 0x7f6950003f70 2023-11-27T17:49:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.350+0000 7f695bfff700 1 -- 172.21.15.177:0/787394245 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c00fb00 con 0x7f6950003f70 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.350+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69640aff10 con 0x7f6950003f70 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.350+0000 7f695bfff700 1 -- 172.21.15.177:0/787394245 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00feb0 con 0x7f6950003f70 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.350+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696413f420 con 0x7f6950003f70 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.351+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696413fd50 con 0x7f6950003f70 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.351+0000 7f695bfff700 1 -- 172.21.15.177:0/787394245 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f694c014440 con 0x7f6950003f70 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.352+0000 7f695bfff700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f694406b250 0x7f694406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.352+0000 7f695bfff700 1 -- 172.21.15.177:0/787394245 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f694c089dd0 con 0x7f6950003f70 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.352+0000 7f6962ffd700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f694406b250 0x7f694406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.352+0000 7f6962ffd700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f694406b250 0x7f694406d710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69640d09c0 tx=0x7f6954007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.356+0000 7f695bfff700 1 -- 172.21.15.177:0/787394245 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f694c054f10 con 0x7f6950003f70 2023-11-27T17:49:05.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.628+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f6964073aa0 con 0x7f6950003f70 2023-11-27T17:49:05.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.632+0000 7f695bfff700 1 -- 172.21.15.177:0/787394245 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f694c08b0a0 con 0x7f6950003f70 2023-11-27T17:49:05.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.634+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f694406b250 msgr2=0x7f694406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.634+0000 7f696a030700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f694406b250 0x7f694406d710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69640d09c0 tx=0x7f6954007000 comp rx=0 tx=0).stop 2023-11-27T17:49:05.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.634+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 msgr2=0x7f6964141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.634+0000 7f696a030700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6964141fc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f694c011ad0 tx=0x7f694c011e90 comp rx=0 tx=0).stop 2023-11-27T17:49:05.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.634+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 shutdown_connections 2023-11-27T17:49:05.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.634+0000 7f696a030700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f694406b250 0x7f694406d710 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.634+0000 7f696a030700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696413e150 0x7f696413e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.635+0000 7f696a030700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6950003f70 0x7f6964141fc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.635+0000 7f696a030700 1 --2- 172.21.15.177:0/787394245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69640af2c0 0x7f69640af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.635+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 >> 172.21.15.177:0/787394245 conn(0x7f69640b2130 msgr2=0x7f6964144d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:05.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.635+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 shutdown_connections 2023-11-27T17:49:05.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.635+0000 7f696a030700 1 -- 172.21.15.177:0/787394245 wait complete. 2023-11-27T17:49:05.649 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-27T17:49:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.767+0000 7fa3853f1700 1 Processor -- start 2023-11-27T17:49:05.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.767+0000 7fa3853f1700 1 -- start start 2023-11-27T17:49:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa3853f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3801586c0 0x7fa380161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa3853f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa38015ee80 0x7fa380072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa3853f1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa380141230 con 0x7fa380072ad0 2023-11-27T17:49:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa3853f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa380072f40 con 0x7fa3801586c0 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa3853f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa380070550 con 0x7fa38015ee80 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa37effd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3801586c0 0x7fa380161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa37e7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa38015ee80 0x7fa380072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa37effd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3801586c0 0x7fa380161a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:32906/0 (socket says 172.21.15.177:32906) 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa37effd700 1 -- 172.21.15.177:0/3618566513 learned_addr learned my addr 172.21.15.177:0/3618566513 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.768+0000 7fa37f7fe700 1 --1- 172.21.15.177:0/3618566513 >> v1:172.21.15.178:6789/0 conn(0x7fa380072ad0 0x7fa380143590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:46416/0 (socket says 172.21.15.177:46416) 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37effd700 1 -- 172.21.15.177:0/3618566513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa38015ee80 msgr2=0x7fa380072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37effd700 1 --2- 172.21.15.177:0/3618566513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa38015ee80 0x7fa380072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37effd700 1 -- 172.21.15.177:0/3618566513 >> v1:172.21.15.178:6789/0 conn(0x7fa380072ad0 legacy=0x7fa380143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37dffb700 1 -- 172.21.15.177:0/3618566513 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503563507 0 0) 0x7fa380141230 con 0x7fa380072ad0 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37effd700 1 -- 172.21.15.177:0/3618566513 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380162040 con 0x7fa3801586c0 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37e7fc700 1 --2- 172.21.15.177:0/3618566513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa38015ee80 0x7fa380072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37effd700 1 --2- 172.21.15.177:0/3618566513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3801586c0 0x7fa380161a40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3740098f0 tx=0x7fa374009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c28aa0af2c526b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37dffb700 1 -- 172.21.15.177:0/3618566513 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374011830 con 0x7fa3801586c0 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37dffb700 1 -- 172.21.15.177:0/3618566513 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa374011990 con 0x7fa3801586c0 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.769+0000 7fa37dffb700 1 -- 172.21.15.177:0/3618566513 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374011d20 con 0x7fa3801586c0 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.770+0000 7fa3853f1700 1 -- 172.21.15.177:0/3618566513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3801586c0 msgr2=0x7fa380161a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.770+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3618566513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3801586c0 0x7fa380161a40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3740098f0 tx=0x7fa374009c00 comp rx=0 tx=0).stop 2023-11-27T17:49:05.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.770+0000 7fa3853f1700 1 -- 172.21.15.177:0/3618566513 shutdown_connections 2023-11-27T17:49:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.770+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3618566513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3801586c0 0x7fa380161a40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.770+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3618566513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa38015ee80 0x7fa380072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.770+0000 7fa3853f1700 1 -- 172.21.15.177:0/3618566513 >> 172.21.15.177:0/3618566513 conn(0x7fa3800b6110 msgr2=0x7fa3800b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.770+0000 7fa3853f1700 1 -- 172.21.15.177:0/3618566513 shutdown_connections 2023-11-27T17:49:05.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.770+0000 7fa3853f1700 1 -- 172.21.15.177:0/3618566513 wait complete. 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.771+0000 7fa3853f1700 1 Processor -- start 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.771+0000 7fa3853f1700 1 -- start start 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa3853f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa380072ad0 0x7fa3801409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa3853f1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3801586c0 0x7fa3801597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa3853f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa38015ee80 0x7fa38006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa3853f1700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa380140f30 con 0x7fa3801586c0 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa3853f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38015a150 con 0x7fa38015ee80 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa3853f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38015a430 con 0x7fa380072ad0 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3801586c0 0x7fa3801597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3801586c0 0x7fa3801597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53124/0 (socket says 172.21.15.177:53124) 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 -- 172.21.15.177:0/3592110773 learned_addr learned my addr 172.21.15.177:0/3592110773 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37effd700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa380072ad0 0x7fa3801409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37f7fe700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa38015ee80 0x7fa38006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 -- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa380072ad0 msgr2=0x7fa3801409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa380072ad0 0x7fa3801409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 -- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa38015ee80 msgr2=0x7fa38006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa38015ee80 0x7fa38006cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 -- 172.21.15.177:0/3592110773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700094a0 con 0x7fa3801586c0 2023-11-27T17:49:05.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37effd700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa380072ad0 0x7fa3801409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37f7fe700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa38015ee80 0x7fa38006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.772+0000 7fa37e7fc700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3801586c0 0x7fa3801597e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa37000ebe0 tx=0x7fa370009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.773+0000 7fa3677fe700 1 -- 172.21.15.177:0/3592110773 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000c910 con 0x7fa3801586c0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.773+0000 7fa3677fe700 1 -- 172.21.15.177:0/3592110773 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000ca70 con 0x7fa3801586c0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.773+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa374009550 con 0x7fa3801586c0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.773+0000 7fa3677fe700 1 -- 172.21.15.177:0/3592110773 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000cde0 con 0x7fa3801586c0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.773+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38015a9f0 con 0x7fa3801586c0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.773+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa380069400 con 0x7fa3801586c0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.775+0000 7fa3677fe700 1 -- 172.21.15.177:0/3592110773 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa370013470 con 0x7fa3801586c0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.775+0000 7fa3677fe700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36c06b250 0x7fa36c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.775+0000 7fa3677fe700 1 -- 172.21.15.177:0/3592110773 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa370089ff0 con 0x7fa3801586c0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.775+0000 7fa37effd700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36c06b250 0x7fa36c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:05.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.775+0000 7fa37effd700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36c06b250 0x7fa36c06d710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa374009c40 tx=0x7fa374008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:05.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:05.779+0000 7fa3677fe700 1 -- 172.21.15.177:0/3592110773 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa370055150 con 0x7fa3801586c0 2023-11-27T17:49:06.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.046+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa380072370 con 0x7fa3801586c0 2023-11-27T17:49:06.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.048+0000 7fa3677fe700 1 -- 172.21.15.177:0/3592110773 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa370058770 con 0x7fa3801586c0 2023-11-27T17:49:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36c06b250 msgr2=0x7fa36c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36c06b250 0x7fa36c06d710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa374009c40 tx=0x7fa374008030 comp rx=0 tx=0).stop 2023-11-27T17:49:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3801586c0 msgr2=0x7fa3801597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3801586c0 0x7fa3801597e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa37000ebe0 tx=0x7fa370009ec0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 shutdown_connections 2023-11-27T17:49:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fa36c06b250 0x7fa36c06d710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa38015ee80 0x7fa38006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa380072ad0 0x7fa3801409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 --2- 172.21.15.177:0/3592110773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3801586c0 0x7fa3801597e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 >> 172.21.15.177:0/3592110773 conn(0x7fa3800b6110 msgr2=0x7fa3800d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 shutdown_connections 2023-11-27T17:49:06.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.050+0000 7fa3853f1700 1 -- 172.21.15.177:0/3592110773 wait complete. 2023-11-27T17:49:06.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-27T17:49:06.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.185+0000 7f02fb334700 1 Processor -- start 2023-11-27T17:49:06.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.185+0000 7f02fb334700 1 -- start start 2023-11-27T17:49:06.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02fb334700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02f41566d0 0x7f02f4160660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02fb334700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f02f4072e10 0x7f02f406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02fb334700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f4156ab0 con 0x7f02f415c660 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02fb334700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f4160ba0 con 0x7f02f41566d0 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02fb334700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f406df10 con 0x7f02f4072e10 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f90d0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02f41566d0 0x7f02f4160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f88cf700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f02f415c660 0x7f02f4072700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47448/0 (socket says 172.21.15.177:47448) 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f90d0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02f41566d0 0x7f02f4160660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53130/0 (socket says 172.21.15.177:53130) 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f88cf700 1 -- 172.21.15.177:0/152857652 learned_addr learned my addr 172.21.15.177:0/152857652 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f98d1700 1 --2- 172.21.15.177:0/152857652 >> v2:172.21.15.178:3300/0 conn(0x7f02f4072e10 0x7f02f406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f90d0700 1 -- 172.21.15.177:0/152857652 >> v2:172.21.15.178:3300/0 conn(0x7f02f4072e10 msgr2=0x7f02f406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f90d0700 1 --2- 172.21.15.177:0/152857652 >> v2:172.21.15.178:3300/0 conn(0x7f02f4072e10 0x7f02f406e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f90d0700 1 -- 172.21.15.177:0/152857652 >> v1:172.21.15.177:6789/0 conn(0x7f02f415c660 legacy=0x7f02f4072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f90d0700 1 -- 172.21.15.177:0/152857652 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f415cbb0 con 0x7f02f41566d0 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f98d1700 1 --2- 172.21.15.177:0/152857652 >> v2:172.21.15.178:3300/0 conn(0x7f02f4072e10 0x7f02f406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02f90d0700 1 --2- 172.21.15.177:0/152857652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f41566d0 0x7f02f4160660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f02f40670f0 tx=0x7f02e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47afa9569c6f86a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02ebfff700 1 -- 172.21.15.177:0/152857652 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4011830 con 0x7f02f41566d0 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02ebfff700 1 -- 172.21.15.177:0/152857652 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e4011990 con 0x7f02f41566d0 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.186+0000 7f02ebfff700 1 -- 172.21.15.177:0/152857652 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4011d20 con 0x7f02f41566d0 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.187+0000 7f02fb334700 1 -- 172.21.15.177:0/152857652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f41566d0 msgr2=0x7f02f4160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.187+0000 7f02fb334700 1 --2- 172.21.15.177:0/152857652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f41566d0 0x7f02f4160660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f02f40670f0 tx=0x7f02e4009b20 comp rx=0 tx=0).stop 2023-11-27T17:49:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.187+0000 7f02fb334700 1 -- 172.21.15.177:0/152857652 shutdown_connections 2023-11-27T17:49:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.187+0000 7f02fb334700 1 --2- 172.21.15.177:0/152857652 >> v2:172.21.15.178:3300/0 conn(0x7f02f4072e10 0x7f02f406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.187+0000 7f02fb334700 1 --2- 172.21.15.177:0/152857652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f41566d0 0x7f02f4160660 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.187+0000 7f02fb334700 1 -- 172.21.15.177:0/152857652 >> 172.21.15.177:0/152857652 conn(0x7f02f40b1ff0 msgr2=0x7f02f40b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.187+0000 7f02fb334700 1 -- 172.21.15.177:0/152857652 shutdown_connections 2023-11-27T17:49:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.187+0000 7f02fb334700 1 -- 172.21.15.177:0/152857652 wait complete. 2023-11-27T17:49:06.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.188+0000 7f02fb334700 1 Processor -- start 2023-11-27T17:49:06.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.188+0000 7f02fb334700 1 -- start start 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02fb334700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f4072e10 0x7f02f415c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02fb334700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02f41566d0 0x7f02f415ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02fb334700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02f415c660 0x7f02f41f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02fb334700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f4158450 con 0x7f02f4072e10 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02fb334700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f4157840 con 0x7f02f41566d0 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02fb334700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f4157b20 con 0x7f02f415c660 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f4072e10 0x7f02f415c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f4072e10 0x7f02f415c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53136/0 (socket says 172.21.15.177:53136) 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 -- 172.21.15.177:0/1361141587 learned_addr learned my addr 172.21.15.177:0/1361141587 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 -- 172.21.15.177:0/1361141587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02f415c660 msgr2=0x7f02f41f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02f415c660 0x7f02f41f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 -- 172.21.15.177:0/1361141587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02f41566d0 msgr2=0x7f02f415ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02f41566d0 0x7f02f415ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 -- 172.21.15.177:0/1361141587 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e40094a0 con 0x7f02f4072e10 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.189+0000 7f02f90d0700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f4072e10 0x7f02f415c0f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f02e40090b0 tx=0x7f02e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.190+0000 7f02e9ffb700 1 -- 172.21.15.177:0/1361141587 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e40038a0 con 0x7f02f4072e10 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.190+0000 7f02e9ffb700 1 -- 172.21.15.177:0/1361141587 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e401f070 con 0x7f02f4072e10 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.190+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f4157e00 con 0x7f02f4072e10 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.190+0000 7f02e9ffb700 1 -- 172.21.15.177:0/1361141587 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4003c60 con 0x7f02f4072e10 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.190+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f41588e0 con 0x7f02f4072e10 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.191+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f4073aa0 con 0x7f02f4072e10 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.191+0000 7f02e9ffb700 1 -- 172.21.15.177:0/1361141587 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f02e4026480 con 0x7f02f4072e10 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.192+0000 7f02e9ffb700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f02d806b250 0x7f02d806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.192+0000 7f02e9ffb700 1 -- 172.21.15.177:0/1361141587 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f02e4021070 con 0x7f02f4072e10 2023-11-27T17:49:06.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.192+0000 7f02f88cf700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f02d806b250 0x7f02d806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.192+0000 7f02f88cf700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f02d806b250 0x7f02d806d710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f02f415c630 tx=0x7f02f0007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:06.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.196+0000 7f02e9ffb700 1 -- 172.21.15.177:0/1361141587 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f02e40561b0 con 0x7f02f4072e10 2023-11-27T17:49:06.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.468+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f02f4069400 con 0x7f02f4072e10 2023-11-27T17:49:06.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.472+0000 7f02e9ffb700 1 -- 172.21.15.177:0/1361141587 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f02e40597d0 con 0x7f02f4072e10 2023-11-27T17:49:06.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.474+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f02d806b250 msgr2=0x7f02d806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.474+0000 7f02fb334700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f02d806b250 0x7f02d806d710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f02f415c630 tx=0x7f02f0007ad0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.474+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f4072e10 msgr2=0x7f02f415c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.474+0000 7f02fb334700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f4072e10 0x7f02f415c0f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f02e40090b0 tx=0x7f02e4004750 comp rx=0 tx=0).stop 2023-11-27T17:49:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.475+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 shutdown_connections 2023-11-27T17:49:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.475+0000 7f02fb334700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f02d806b250 0x7f02d806d710 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.475+0000 7f02fb334700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02f415c660 0x7f02f41f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.475+0000 7f02fb334700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f4072e10 0x7f02f415c0f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.475+0000 7f02fb334700 1 --2- 172.21.15.177:0/1361141587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02f41566d0 0x7f02f415ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.475+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 >> 172.21.15.177:0/1361141587 conn(0x7f02f40b1ff0 msgr2=0x7f02f40b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:06.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.475+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 shutdown_connections 2023-11-27T17:49:06.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.475+0000 7f02fb334700 1 -- 172.21.15.177:0/1361141587 wait complete. 2023-11-27T17:49:06.489 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-27T17:49:06.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc121009700 1 Processor -- start 2023-11-27T17:49:06.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc121009700 1 -- start start 2023-11-27T17:49:06.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc121009700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc11c072d20 0x7fc11c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc121009700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 0x7fc11c143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc121009700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c06e510 con 0x7fc11c141030 2023-11-27T17:49:06.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc121009700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c161ac0 con 0x7fc11c072d20 2023-11-27T17:49:06.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc121009700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c141410 con 0x7fc11c06dd00 2023-11-27T17:49:06.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc11a59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc11c072d20 0x7fc11c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc11a59c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc11c072d20 0x7fc11c06d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53146/0 (socket says 172.21.15.177:53146) 2023-11-27T17:49:06.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc11a59c700 1 -- 172.21.15.177:0/1365963969 learned_addr learned my addr 172.21.15.177:0/1365963969 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:06.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc11a59c700 1 -- 172.21.15.177:0/1365963969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 msgr2=0x7fc11c143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:06.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc11a59c700 1 --2- 172.21.15.177:0/1365963969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 0x7fc11c143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc11a59c700 1 -- 172.21.15.177:0/1365963969 >> v1:172.21.15.178:6789/0 conn(0x7fc11c141030 legacy=0x7fc11c072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:06.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc11a59c700 1 -- 172.21.15.177:0/1365963969 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c161ca0 con 0x7fc11c072d20 2023-11-27T17:49:06.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc11a59c700 1 --2- 172.21.15.177:0/1365963969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c072d20 0x7fc11c06d7c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc1100098f0 tx=0x7fc110009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e622c252cf80218b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:06.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc119d9b700 1 -- 172.21.15.177:0/1365963969 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110004230 con 0x7fc11c072d20 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc119d9b700 1 -- 172.21.15.177:0/1365963969 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc110004390 con 0x7fc11c072d20 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.609+0000 7fc119d9b700 1 -- 172.21.15.177:0/1365963969 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1100036a0 con 0x7fc11c072d20 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.610+0000 7fc121009700 1 -- 172.21.15.177:0/1365963969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c072d20 msgr2=0x7fc11c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.610+0000 7fc121009700 1 --2- 172.21.15.177:0/1365963969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c072d20 0x7fc11c06d7c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc1100098f0 tx=0x7fc110009c00 comp rx=0 tx=0).stop 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.610+0000 7fc121009700 1 -- 172.21.15.177:0/1365963969 shutdown_connections 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.610+0000 7fc121009700 1 --2- 172.21.15.177:0/1365963969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 0x7fc11c143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.610+0000 7fc121009700 1 --2- 172.21.15.177:0/1365963969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c072d20 0x7fc11c06d7c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.610+0000 7fc121009700 1 -- 172.21.15.177:0/1365963969 >> 172.21.15.177:0/1365963969 conn(0x7fc11c06aff0 msgr2=0x7fc11c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.610+0000 7fc121009700 1 -- 172.21.15.177:0/1365963969 shutdown_connections 2023-11-27T17:49:06.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.610+0000 7fc121009700 1 -- 172.21.15.177:0/1365963969 wait complete. 2023-11-27T17:49:06.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.611+0000 7fc121009700 1 Processor -- start 2023-11-27T17:49:06.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.611+0000 7fc121009700 1 -- start start 2023-11-27T17:49:06.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc121009700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 0x7fc11c144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc121009700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc11c072d20 0x7fc11c13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc121009700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c141030 0x7fc11c1f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc121009700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c158b00 con 0x7fc11c141030 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc121009700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1f44b0 con 0x7fc11c072d20 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc121009700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1f4790 con 0x7fc11c06dd00 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc11b59e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c141030 0x7fc11c1f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc11b59e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c141030 0x7fc11c1f3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53154/0 (socket says 172.21.15.177:53154) 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.612+0000 7fc11b59e700 1 -- 172.21.15.177:0/2844507175 learned_addr learned my addr 172.21.15.177:0/2844507175 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11a59c700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc11c072d20 0x7fc11c13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11ad9d700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 0x7fc11c144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11b59e700 1 -- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 msgr2=0x7fc11c144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11b59e700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 0x7fc11c144440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11b59e700 1 -- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc11c072d20 msgr2=0x7fc11c13fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11b59e700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc11c072d20 0x7fc11c13fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11b59e700 1 -- 172.21.15.177:0/2844507175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc110009550 con 0x7fc11c141030 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11a59c700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc11c072d20 0x7fc11c13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc11b59e700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c141030 0x7fc11c1f3950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc11400b970 tx=0x7fc11400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc1037fe700 1 -- 172.21.15.177:0/2844507175 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11400c9b0 con 0x7fc11c141030 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc1037fe700 1 -- 172.21.15.177:0/2844507175 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11400cb30 con 0x7fc11c141030 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c158d10 con 0x7fc11c141030 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc1037fe700 1 -- 172.21.15.177:0/2844507175 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114014440 con 0x7fc11c141030 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.613+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c146ea0 con 0x7fc11c141030 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.614+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c1f49d0 con 0x7fc11c141030 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.615+0000 7fc1037fe700 1 -- 172.21.15.177:0/2844507175 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc11401d3b0 con 0x7fc11c141030 2023-11-27T17:49:06.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.615+0000 7fc1037fe700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc10806b250 0x7fc10806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:06.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.615+0000 7fc1037fe700 1 -- 172.21.15.177:0/2844507175 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc114006e40 con 0x7fc11c141030 2023-11-27T17:49:06.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.615+0000 7fc11ad9d700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc10806b250 0x7fc10806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:06.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.615+0000 7fc11ad9d700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc10806b250 0x7fc10806d710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009870 tx=0x7fc10c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:06.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.619+0000 7fc1037fe700 1 -- 172.21.15.177:0/2844507175 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc114054500 con 0x7fc11c141030 2023-11-27T17:49:06.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.890+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc11c073aa0 con 0x7fc11c141030 2023-11-27T17:49:06.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.891+0000 7fc1037fe700 1 -- 172.21.15.177:0/2844507175 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc1140190a0 con 0x7fc11c141030 2023-11-27T17:49:06.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc10806b250 msgr2=0x7fc10806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc10806b250 0x7fc10806d710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009870 tx=0x7fc10c008040 comp rx=0 tx=0).stop 2023-11-27T17:49:06.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c141030 msgr2=0x7fc11c1f3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:06.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c141030 0x7fc11c1f3950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc11400b970 tx=0x7fc11400bd30 comp rx=0 tx=0).stop 2023-11-27T17:49:06.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 shutdown_connections 2023-11-27T17:49:06.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc10806b250 0x7fc10806d710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c141030 0x7fc11c1f3950 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc11c06dd00 0x7fc11c144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 --2- 172.21.15.177:0/2844507175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc11c072d20 0x7fc11c13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:06.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 >> 172.21.15.177:0/2844507175 conn(0x7fc11c06aff0 msgr2=0x7fc11c160d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:06.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 shutdown_connections 2023-11-27T17:49:06.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:06.894+0000 7fc121009700 1 -- 172.21.15.177:0/2844507175 wait complete. 2023-11-27T17:49:06.908 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-27T17:49:07.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f9916f1e700 1 Processor -- start 2023-11-27T17:49:07.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f9916f1e700 1 -- start start 2023-11-27T17:49:07.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f9916f1e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006d910 0x7f991006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f9916f1e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f991006dcf0 0x7f991015b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f9916f1e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991006e520 con 0x7f991015e880 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f9916f1e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991006efc0 con 0x7f991006dcf0 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f9916f1e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991006f2a0 con 0x7f991006d910 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f99154bb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f991006dcf0 0x7f991015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f99154bb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f991006dcf0 0x7f991015b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53162/0 (socket says 172.21.15.177:53162) 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f99154bb700 1 -- 172.21.15.177:0/3704654320 learned_addr learned my addr 172.21.15.177:0/3704654320 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.029+0000 7f990ffff700 1 --1- 172.21.15.177:0/3704654320 >> v1:172.21.15.177:6789/0 conn(0x7f991015e880 0x7f99100b05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47478/0 (socket says 172.21.15.177:47478) 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f9914cba700 1 --2- 172.21.15.177:0/3704654320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006d910 0x7f991006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f99154bb700 1 -- 172.21.15.177:0/3704654320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006d910 msgr2=0x7f991006e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:07.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f99154bb700 1 --2- 172.21.15.177:0/3704654320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006d910 0x7f991006e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f99154bb700 1 -- 172.21.15.177:0/3704654320 >> v1:172.21.15.177:6789/0 conn(0x7f991015e880 legacy=0x7f99100b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f99154bb700 1 -- 172.21.15.177:0/3704654320 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991006f580 con 0x7f991006dcf0 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f990f7fe700 1 -- 172.21.15.177:0/3704654320 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536182046 0 0) 0x7f991006e520 con 0x7f991015e880 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f99154bb700 1 --2- 172.21.15.177:0/3704654320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991006dcf0 0x7f991015b750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f990800d150 tx=0x7f990800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a517cc14e8a5e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f990f7fe700 1 -- 172.21.15.177:0/3704654320 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908010070 con 0x7f991006dcf0 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f990f7fe700 1 -- 172.21.15.177:0/3704654320 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800ddc0 con 0x7f991006dcf0 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.030+0000 7f990f7fe700 1 -- 172.21.15.177:0/3704654320 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800b310 con 0x7f991006dcf0 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.031+0000 7f9916f1e700 1 -- 172.21.15.177:0/3704654320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991006dcf0 msgr2=0x7f991015b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.031+0000 7f9916f1e700 1 --2- 172.21.15.177:0/3704654320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991006dcf0 0x7f991015b750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f990800d150 tx=0x7f990800d460 comp rx=0 tx=0).stop 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.031+0000 7f9916f1e700 1 -- 172.21.15.177:0/3704654320 shutdown_connections 2023-11-27T17:49:07.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.031+0000 7f9916f1e700 1 --2- 172.21.15.177:0/3704654320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991006dcf0 0x7f991015b750 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.031+0000 7f9916f1e700 1 --2- 172.21.15.177:0/3704654320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006d910 0x7f991006e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.031+0000 7f9916f1e700 1 -- 172.21.15.177:0/3704654320 >> 172.21.15.177:0/3704654320 conn(0x7f99100b2130 msgr2=0x7f99100b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.031+0000 7f9916f1e700 1 -- 172.21.15.177:0/3704654320 shutdown_connections 2023-11-27T17:49:07.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.031+0000 7f9916f1e700 1 -- 172.21.15.177:0/3704654320 wait complete. 2023-11-27T17:49:07.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.032+0000 7f9916f1e700 1 Processor -- start 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.032+0000 7f9916f1e700 1 -- start start 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f9916f1e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f991006d910 0x7f99101562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f9916f1e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006dcf0 0x7f9910153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f9916f1e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991015e880 0x7f99100af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f9916f1e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100ae410 con 0x7f991015e880 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f9916f1e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100ae6f0 con 0x7f991006d910 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f9916f1e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100ae9d0 con 0x7f991006dcf0 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991015e880 0x7f99100af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991015e880 0x7f99100af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53168/0 (socket says 172.21.15.177:53168) 2023-11-27T17:49:07.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 -- 172.21.15.177:0/1612205944 learned_addr learned my addr 172.21.15.177:0/1612205944 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f990ffff700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006dcf0 0x7f9910153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f9914cba700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f991006d910 0x7f99101562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 -- 172.21.15.177:0/1612205944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006dcf0 msgr2=0x7f9910153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006dcf0 0x7f9910153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 -- 172.21.15.177:0/1612205944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f991006d910 msgr2=0x7f99101562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f991006d910 0x7f99101562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 -- 172.21.15.177:0/1612205944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990800bd40 con 0x7f991015e880 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f99154bb700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991015e880 0x7f99100af490 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f99100b1eb0 tx=0x7f9908004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f990d7fa700 1 -- 172.21.15.177:0/1612205944 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908009a10 con 0x7f991015e880 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f990d7fa700 1 -- 172.21.15.177:0/1612205944 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908009b90 con 0x7f991015e880 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.033+0000 7f990d7fa700 1 -- 172.21.15.177:0/1612205944 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800b4c0 con 0x7f991015e880 2023-11-27T17:49:07.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.034+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99100aecb0 con 0x7f991015e880 2023-11-27T17:49:07.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.034+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9910154530 con 0x7f991015e880 2023-11-27T17:49:07.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.034+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910073aa0 con 0x7f991015e880 2023-11-27T17:49:07.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.035+0000 7f990d7fa700 1 -- 172.21.15.177:0/1612205944 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9908004040 con 0x7f991015e880 2023-11-27T17:49:07.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.035+0000 7f990d7fa700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f98f406b250 0x7f98f406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.035+0000 7f990d7fa700 1 -- 172.21.15.177:0/1612205944 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f990808b270 con 0x7f991015e880 2023-11-27T17:49:07.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.035+0000 7f9914cba700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f98f406b250 0x7f98f406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.036+0000 7f9914cba700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f98f406b250 0x7f98f406d710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9904009930 tx=0x7f9904008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.041+0000 7f990d7fa700 1 -- 172.21.15.177:0/1612205944 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9908056300 con 0x7f991015e880 2023-11-27T17:49:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.311+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f99101546f0 con 0x7f991015e880 2023-11-27T17:49:07.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.313+0000 7f990d7fa700 1 -- 172.21.15.177:0/1612205944 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9908059920 con 0x7f991015e880 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f98f406b250 msgr2=0x7f98f406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f98f406b250 0x7f98f406d710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9904009930 tx=0x7f9904008040 comp rx=0 tx=0).stop 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991015e880 msgr2=0x7f99100af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991015e880 0x7f99100af490 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f99100b1eb0 tx=0x7f9908004ad0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 shutdown_connections 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f98f406b250 0x7f98f406d710 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f991015e880 0x7f99100af490 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f991006d910 0x7f99101562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 --2- 172.21.15.177:0/1612205944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991006dcf0 0x7f9910153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 >> 172.21.15.177:0/1612205944 conn(0x7f99100b2130 msgr2=0x7f991015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 shutdown_connections 2023-11-27T17:49:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.315+0000 7f9916f1e700 1 -- 172.21.15.177:0/1612205944 wait complete. 2023-11-27T17:49:07.329 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-27T17:49:07.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.448+0000 7f7caba6b700 1 Processor -- start 2023-11-27T17:49:07.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.449+0000 7f7caba6b700 1 -- start start 2023-11-27T17:49:07.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.449+0000 7f7caba6b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ca4160350 0x7f7ca4144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.449+0000 7f7caba6b700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca4160780 con 0x7f7ca40cf3c0 2023-11-27T17:49:07.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7caba6b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca40b7490 con 0x7f7ca40b2860 2023-11-27T17:49:07.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7caba6b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca41609e0 con 0x7f7ca4160350 2023-11-27T17:49:07.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca9807700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7ca40cf3c0 0x7f7ca40b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47490/0 (socket says 172.21.15.177:47490) 2023-11-27T17:49:07.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca9807700 1 -- 172.21.15.177:0/2571033444 learned_addr learned my addr 172.21.15.177:0/2571033444 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:07.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683369182 0 0) 0x7f7ca4160780 con 0x7f7ca40cf3c0 2023-11-27T17:49:07.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c900035b0 con 0x7f7ca40cf3c0 2023-11-27T17:49:07.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7caa008700 1 --2- 172.21.15.177:0/2571033444 >> v2:172.21.15.178:3300/0 conn(0x7f7ca4160350 0x7f7ca4144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2123412901 0 0) 0x7f7c900035b0 con 0x7f7ca40cf3c0 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 >> v2:172.21.15.178:3300/0 conn(0x7f7ca4160350 msgr2=0x7f7ca4144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 --2- 172.21.15.177:0/2571033444 >> v2:172.21.15.178:3300/0 conn(0x7f7ca4160350 0x7f7ca4144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 >> v1:172.21.15.178:6789/0 conn(0x7f7ca40b2860 legacy=0x7f7ca415fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40d0f40 con 0x7f7ca40cf3c0 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f7ca0001670 con 0x7f7ca40cf3c0 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 >> v1:172.21.15.177:6789/0 conn(0x7f7ca40cf3c0 legacy=0x7f7ca40b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90003a00 0x7f7c90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90004850 0x7f7c90004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c90005210 0x7f7c9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41609e0 con 0x7f7c90004850 2023-11-27T17:49:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9000c0b0 con 0x7f7c90003a00 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9000c270 con 0x7f7c90005210 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca9006700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90004850 0x7f7c90004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7ca9807700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90003a00 0x7f7c90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.450+0000 7f7caa008700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c90005210 0x7f7c9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca9006700 1 -- 172.21.15.177:0/2571033444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c90005210 msgr2=0x7f7c9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca9006700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c90005210 0x7f7c9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca9006700 1 -- 172.21.15.177:0/2571033444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90003a00 msgr2=0x7f7c90003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca9006700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90003a00 0x7f7c90003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca9006700 1 -- 172.21.15.177:0/2571033444 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900035b0 con 0x7f7c90004850 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7caa008700 1 -- 172.21.15.177:0/2571033444 reap_dead start 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca9006700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90004850 0x7f7c90004cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c940017c0 tx=0x7f7c90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1393ff3666f40c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940052d0 con 0x7f7c90004850 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c94005450 con 0x7f7c90004850 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7ca8805700 1 -- 172.21.15.177:0/2571033444 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940038c0 con 0x7f7c90004850 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7caba6b700 1 -- 172.21.15.177:0/2571033444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90004850 msgr2=0x7f7c90004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.451+0000 7f7caba6b700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90004850 0x7f7c90004cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c940017c0 tx=0x7f7c90005880 comp rx=0 tx=0).stop 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.452+0000 7f7caba6b700 1 -- 172.21.15.177:0/2571033444 shutdown_connections 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.452+0000 7f7caba6b700 1 --2- 172.21.15.177:0/2571033444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90004850 0x7f7c90004cd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.452+0000 7f7caba6b700 1 -- 172.21.15.177:0/2571033444 >> 172.21.15.177:0/2571033444 conn(0x7f7ca4072190 msgr2=0x7f7ca40725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.452+0000 7f7caba6b700 1 -- 172.21.15.177:0/2571033444 shutdown_connections 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.452+0000 7f7caba6b700 1 -- 172.21.15.177:0/2571033444 wait complete. 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.453+0000 7f7caba6b700 1 Processor -- start 2023-11-27T17:49:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.453+0000 7f7caba6b700 1 -- start start 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.453+0000 7f7caba6b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90004850 0x7f7ca4146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.453+0000 7f7caba6b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ca40cc700 0x7f7ca40ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.453+0000 7f7caba6b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ca4154070 0x7f7ca4154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7caba6b700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4154a40 con 0x7f7ca40cc700 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7caba6b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40cd0a0 con 0x7f7c90004850 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7caba6b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40cde40 con 0x7f7ca4154070 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ca40cc700 0x7f7ca40ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ca40cc700 0x7f7ca40ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53184/0 (socket says 172.21.15.177:53184) 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 -- 172.21.15.177:0/3447743369 learned_addr learned my addr 172.21.15.177:0/3447743369 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:07.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9807700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90004850 0x7f7ca4146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7caa008700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ca4154070 0x7f7ca4154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 -- 172.21.15.177:0/3447743369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ca4154070 msgr2=0x7f7ca4154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ca4154070 0x7f7ca4154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 -- 172.21.15.177:0/3447743369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90004850 msgr2=0x7f7ca4146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90004850 0x7f7ca4146830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 -- 172.21.15.177:0/3447743369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40cd2c0 con 0x7f7ca40cc700 2023-11-27T17:49:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7ca9006700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ca40cc700 0x7f7ca40ccb60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c080 tx=0x7f7c94001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7c9a7fc700 1 -- 172.21.15.177:0/3447743369 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94001290 con 0x7f7ca40cc700 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7c9a7fc700 1 -- 172.21.15.177:0/3447743369 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c94006e20 con 0x7f7ca40cc700 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca40cd5a0 con 0x7f7ca40cc700 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7c9a7fc700 1 -- 172.21.15.177:0/3447743369 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94007260 con 0x7f7ca40cc700 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.454+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca40cdb60 con 0x7f7ca40cc700 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.455+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca4073aa0 con 0x7f7ca40cc700 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.456+0000 7f7c9a7fc700 1 -- 172.21.15.177:0/3447743369 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7c940073c0 con 0x7f7ca40cc700 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.456+0000 7f7c9a7fc700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7c8806b250 0x7f7c8806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.456+0000 7f7c9a7fc700 1 -- 172.21.15.177:0/3447743369 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c94089c90 con 0x7f7ca40cc700 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.456+0000 7f7ca9807700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7c8806b250 0x7f7c8806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.456+0000 7f7ca9807700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7c8806b250 0x7f7c8806d710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0001540 tx=0x7f7ca00014d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.460+0000 7f7c9a7fc700 1 -- 172.21.15.177:0/3447743369 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7c940bce90 con 0x7f7ca40cc700 2023-11-27T17:49:07.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.727+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f7ca4069400 con 0x7f7ca40cc700 2023-11-27T17:49:07.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.730+0000 7f7c9a7fc700 1 -- 172.21.15.177:0/3447743369 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c940170a0 con 0x7f7ca40cc700 2023-11-27T17:49:07.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7c8806b250 msgr2=0x7f7c8806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7c8806b250 0x7f7c8806d710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0001540 tx=0x7f7ca00014d0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ca40cc700 msgr2=0x7f7ca40ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ca40cc700 0x7f7ca40ccb60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c080 tx=0x7f7c94001120 comp rx=0 tx=0).stop 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 shutdown_connections 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7c8806b250 0x7f7c8806d710 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ca4154070 0x7f7ca4154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c90004850 0x7f7ca4146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 --2- 172.21.15.177:0/3447743369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ca40cc700 0x7f7ca40ccb60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 >> 172.21.15.177:0/3447743369 conn(0x7f7ca4072190 msgr2=0x7f7ca406e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 shutdown_connections 2023-11-27T17:49:07.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.732+0000 7f7caba6b700 1 -- 172.21.15.177:0/3447743369 wait complete. 2023-11-27T17:49:07.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:49:07.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.864+0000 7f9c42d87700 1 Processor -- start 2023-11-27T17:49:07.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.864+0000 7f9c42d87700 1 -- start start 2023-11-27T17:49:07.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.865+0000 7f9c42d87700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c0d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c42d87700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9c3c06f3d0 0x7f9c3c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c42d87700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c0723b0 con 0x7f9c3c0b6720 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c42d87700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b6bb0 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c42d87700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0717a0 con 0x7f9c3c15ad60 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3bfff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9c3c06f3d0 0x7f9c3c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3bfff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9c3c06f3d0 0x7f9c3c0b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53192/0 (socket says 172.21.15.177:53192) 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3bfff700 1 -- 172.21.15.177:0/988031825 learned_addr learned my addr 172.21.15.177:0/988031825 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c40b23700 1 --2- 172.21.15.177:0/988031825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c0d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3bfff700 1 -- 172.21.15.177:0/988031825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 msgr2=0x7f9c3c0d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3bfff700 1 --2- 172.21.15.177:0/988031825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c0d0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3bfff700 1 -- 172.21.15.177:0/988031825 >> v1:172.21.15.178:6789/0 conn(0x7f9c3c0b6720 legacy=0x7f9c3c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3bfff700 1 -- 172.21.15.177:0/988031825 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c071a80 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c40b23700 1 --2- 172.21.15.177:0/988031825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c0d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3bfff700 1 --2- 172.21.15.177:0/988031825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c0b61e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098f0 tx=0x7f9c28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857219757604d0e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3b7fe700 1 -- 172.21.15.177:0/988031825 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28004230 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3b7fe700 1 -- 172.21.15.177:0/988031825 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c28004390 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.866+0000 7f9c3b7fe700 1 -- 172.21.15.177:0/988031825 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c280036a0 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.867+0000 7f9c42d87700 1 -- 172.21.15.177:0/988031825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 msgr2=0x7f9c3c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.867+0000 7f9c42d87700 1 --2- 172.21.15.177:0/988031825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c0b61e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098f0 tx=0x7f9c28009c00 comp rx=0 tx=0).stop 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.867+0000 7f9c42d87700 1 -- 172.21.15.177:0/988031825 shutdown_connections 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.867+0000 7f9c42d87700 1 --2- 172.21.15.177:0/988031825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c0d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.867+0000 7f9c42d87700 1 --2- 172.21.15.177:0/988031825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c0b61e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.867+0000 7f9c42d87700 1 -- 172.21.15.177:0/988031825 >> 172.21.15.177:0/988031825 conn(0x7f9c3c0b3590 msgr2=0x7f9c3c0b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.867+0000 7f9c42d87700 1 -- 172.21.15.177:0/988031825 shutdown_connections 2023-11-27T17:49:07.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.867+0000 7f9c42d87700 1 -- 172.21.15.177:0/988031825 wait complete. 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.868+0000 7f9c42d87700 1 Processor -- start 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.868+0000 7f9c42d87700 1 -- start start 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c42d87700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c1f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c42d87700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3c0b6720 0x7f9c3c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c42d87700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c42d87700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c14c5b0 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c42d87700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c14c7a0 con 0x7f9c3c0b6720 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c42d87700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c14ca80 con 0x7f9c3c15ad60 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c40b23700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c1f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c40b23700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c1f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53196/0 (socket says 172.21.15.177:53196) 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c40b23700 1 -- 172.21.15.177:0/2054843441 learned_addr learned my addr 172.21.15.177:0/2054843441 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c3bfff700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3c0b6720 0x7f9c3c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c41324700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c40b23700 1 -- 172.21.15.177:0/2054843441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 msgr2=0x7f9c3c14c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c40b23700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c14c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c40b23700 1 -- 172.21.15.177:0/2054843441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3c0b6720 msgr2=0x7f9c3c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c40b23700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3c0b6720 0x7f9c3c14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.869+0000 7f9c40b23700 1 -- 172.21.15.177:0/2054843441 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009550 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.870+0000 7f9c40b23700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c1f3860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000c7f0 tx=0x7f9c3000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.870+0000 7f9c397fa700 1 -- 172.21.15.177:0/2054843441 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30011800 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.870+0000 7f9c397fa700 1 -- 172.21.15.177:0/2054843441 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c30011960 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.870+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c14cd60 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.870+0000 7f9c397fa700 1 -- 172.21.15.177:0/2054843441 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30011d10 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.870+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c14d320 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.871+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c073aa0 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.871+0000 7f9c397fa700 1 -- 172.21.15.177:0/2054843441 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9c30018360 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.871+0000 7f9c397fa700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c2006b250 0x7f9c2006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:07.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.872+0000 7f9c397fa700 1 -- 172.21.15.177:0/2054843441 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c30089650 con 0x7f9c3c06f3d0 2023-11-27T17:49:07.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.872+0000 7f9c3bfff700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c2006b250 0x7f9c2006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:07.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.872+0000 7f9c3bfff700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c2006b250 0x7f9c2006d710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c1573f0 tx=0x7f9c28008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:07.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:07.876+0000 7f9c397fa700 1 -- 172.21.15.177:0/2054843441 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9c300546d0 con 0x7f9c3c06f3d0 2023-11-27T17:49:08.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.066+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c3c068450 con 0x7f9c3c06f3d0 2023-11-27T17:49:08.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.067+0000 7f9c397fa700 1 -- 172.21.15.177:0/2054843441 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12894 (secure 0 0 0) 0x7f9c30057cf0 con 0x7f9c3c06f3d0 2023-11-27T17:49:08.069 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:08.069 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":29,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:49:04.775985+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:49:08.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c2006b250 msgr2=0x7f9c2006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c2006b250 0x7f9c2006d710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c1573f0 tx=0x7f9c28008030 comp rx=0 tx=0).stop 2023-11-27T17:49:08.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 msgr2=0x7f9c3c1f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c1f3860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000c7f0 tx=0x7f9c3000cbb0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 shutdown_connections 2023-11-27T17:49:08.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f9c2006b250 0x7f9c2006d710 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c3c15ad60 0x7f9c3c14c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c06f3d0 0x7f9c3c1f3860 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 --2- 172.21.15.177:0/2054843441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c3c0b6720 0x7f9c3c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.069+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 >> 172.21.15.177:0/2054843441 conn(0x7f9c3c0b3590 msgr2=0x7f9c3c0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:08.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.070+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 shutdown_connections 2023-11-27T17:49:08.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.070+0000 7f9c42d87700 1 -- 172.21.15.177:0/2054843441 wait complete. 2023-11-27T17:49:08.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:48:10.663802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:49:08.083 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:49:08.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.206+0000 7fbd8ec28700 1 Processor -- start 2023-11-27T17:49:08.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.206+0000 7fbd8ec28700 1 -- start start 2023-11-27T17:49:08.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.206+0000 7fbd8ec28700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd880cdff0 0x7fbd88162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.206+0000 7fbd8ec28700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbd880afc30 0x7fbd880cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.206+0000 7fbd8ec28700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd88162bc0 con 0x7fbd88146f00 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.206+0000 7fbd8ec28700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd881472e0 con 0x7fbd880afc30 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.206+0000 7fbd8ec28700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880b0110 con 0x7fbd880cdff0 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8d1c5700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbd880afc30 0x7fbd880cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8d1c5700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbd880afc30 0x7fbd880cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53208/0 (socket says 172.21.15.177:53208) 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8c9c4700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fbd88146f00 0x7fbd880cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47522/0 (socket says 172.21.15.177:47522) 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8d1c5700 1 -- 172.21.15.177:0/1149439218 learned_addr learned my addr 172.21.15.177:0/1149439218 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8d1c5700 1 -- 172.21.15.177:0/1149439218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd880cdff0 msgr2=0x7fbd88162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8d1c5700 1 --2- 172.21.15.177:0/1149439218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd880cdff0 0x7fbd88162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8d1c5700 1 -- 172.21.15.177:0/1149439218 >> v1:172.21.15.177:6789/0 conn(0x7fbd88146f00 legacy=0x7fbd880cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd877fe700 1 -- 172.21.15.177:0/1149439218 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173987780 0 0) 0x7fbd88162bc0 con 0x7fbd88146f00 2023-11-27T17:49:08.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8d1c5700 1 -- 172.21.15.177:0/1149439218 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd880b03f0 con 0x7fbd880afc30 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd8d1c5700 1 --2- 172.21.15.177:0/1149439218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880afc30 0x7fbd880cef50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009e50 tx=0x7fbd8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e4ebab90c69f25 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd877fe700 1 -- 172.21.15.177:0/1149439218 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000e070 con 0x7fbd880afc30 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd877fe700 1 -- 172.21.15.177:0/1149439218 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8000b9c0 con 0x7fbd880afc30 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.207+0000 7fbd877fe700 1 -- 172.21.15.177:0/1149439218 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000bd70 con 0x7fbd880afc30 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.208+0000 7fbd8ec28700 1 -- 172.21.15.177:0/1149439218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880afc30 msgr2=0x7fbd880cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.208+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/1149439218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880afc30 0x7fbd880cef50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009e50 tx=0x7fbd8000b330 comp rx=0 tx=0).stop 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.208+0000 7fbd8ec28700 1 -- 172.21.15.177:0/1149439218 shutdown_connections 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.208+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/1149439218 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880afc30 0x7fbd880cef50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.208+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/1149439218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd880cdff0 0x7fbd88162680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.208+0000 7fbd8ec28700 1 -- 172.21.15.177:0/1149439218 >> 172.21.15.177:0/1149439218 conn(0x7fbd880b38b0 msgr2=0x7fbd880b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.208+0000 7fbd8ec28700 1 -- 172.21.15.177:0/1149439218 shutdown_connections 2023-11-27T17:49:08.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.208+0000 7fbd8ec28700 1 -- 172.21.15.177:0/1149439218 wait complete. 2023-11-27T17:49:08.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.209+0000 7fbd8ec28700 1 Processor -- start 2023-11-27T17:49:08.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.209+0000 7fbd8ec28700 1 -- start start 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.210+0000 7fbd8ec28700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd880afc30 0x7fbd88071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.210+0000 7fbd8ec28700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880cdff0 0x7fbd88156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.210+0000 7fbd8ec28700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88146f00 0x7fbd881f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.210+0000 7fbd8ec28700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd88071b90 con 0x7fbd880cdff0 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.210+0000 7fbd8ec28700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd881459c0 con 0x7fbd880afc30 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.210+0000 7fbd8ec28700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd88156e60 con 0x7fbd88146f00 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.210+0000 7fbd87fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880cdff0 0x7fbd88156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd87fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880cdff0 0x7fbd88156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53212/0 (socket says 172.21.15.177:53212) 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd87fff700 1 -- 172.21.15.177:0/176142034 learned_addr learned my addr 172.21.15.177:0/176142034 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd8c9c4700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd880afc30 0x7fbd88071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd8d1c5700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88146f00 0x7fbd881f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd87fff700 1 -- 172.21.15.177:0/176142034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88146f00 msgr2=0x7fbd881f3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd87fff700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88146f00 0x7fbd881f3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd87fff700 1 -- 172.21.15.177:0/176142034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd880afc30 msgr2=0x7fbd88071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd87fff700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd880afc30 0x7fbd88071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd87fff700 1 -- 172.21.15.177:0/176142034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009b30 con 0x7fbd880cdff0 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd87fff700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880cdff0 0x7fbd88156920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400b500 tx=0x7fbd7400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd857fa700 1 -- 172.21.15.177:0/176142034 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74011830 con 0x7fbd880cdff0 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd857fa700 1 -- 172.21.15.177:0/176142034 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd740119b0 con 0x7fbd880cdff0 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd88144db0 con 0x7fbd880cdff0 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd857fa700 1 -- 172.21.15.177:0/176142034 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74011d60 con 0x7fbd880cdff0 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.211+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd88145370 con 0x7fbd880cdff0 2023-11-27T17:49:08.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.212+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd88145b70 con 0x7fbd880cdff0 2023-11-27T17:49:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.213+0000 7fbd857fa700 1 -- 172.21.15.177:0/176142034 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbd7401a400 con 0x7fbd880cdff0 2023-11-27T17:49:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.213+0000 7fbd857fa700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbd6c06b250 0x7fbd6c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.213+0000 7fbd857fa700 1 -- 172.21.15.177:0/176142034 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd74089650 con 0x7fbd880cdff0 2023-11-27T17:49:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.213+0000 7fbd8c9c4700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbd6c06b250 0x7fbd6c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.213+0000 7fbd8c9c4700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbd6c06b250 0x7fbd6c06d710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c000f60 tx=0x7fbd7c007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.217+0000 7fbd857fa700 1 -- 172.21.15.177:0/176142034 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbd88145b70 con 0x7fbd880cdff0 2023-11-27T17:49:08.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.405+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd880aef70 con 0x7fbd880cdff0 2023-11-27T17:49:08.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.405+0000 7fbd857fa700 1 -- 172.21.15.177:0/176142034 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd740150a0 con 0x7fbd880cdff0 2023-11-27T17:49:08.407 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-11-27T17:49:08.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.407+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbd6c06b250 msgr2=0x7fbd6c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.407+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbd6c06b250 0x7fbd6c06d710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c000f60 tx=0x7fbd7c007c00 comp rx=0 tx=0).stop 2023-11-27T17:49:08.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.407+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880cdff0 msgr2=0x7fbd88156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.407+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880cdff0 0x7fbd88156920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400b500 tx=0x7fbd7400b8c0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.407+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 shutdown_connections 2023-11-27T17:49:08.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.407+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fbd6c06b250 0x7fbd6c06d710 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.407+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88146f00 0x7fbd881f3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.407+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd880afc30 0x7fbd88071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.408+0000 7fbd8ec28700 1 --2- 172.21.15.177:0/176142034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd880cdff0 0x7fbd88156920 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.408+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 >> 172.21.15.177:0/176142034 conn(0x7fbd880b38b0 msgr2=0x7fbd8806d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:08.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.408+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 shutdown_connections 2023-11-27T17:49:08.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.408+0000 7fbd8ec28700 1 -- 172.21.15.177:0/176142034 wait complete. 2023-11-27T17:49:08.422 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T17:49:08.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.542+0000 7f10eb229700 1 Processor -- start 2023-11-27T17:49:08.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.542+0000 7f10eb229700 1 -- start start 2023-11-27T17:49:08.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.542+0000 7f10eb229700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f10e406ded0 0x7f10e4168e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.542+0000 7f10eb229700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e406e2e0 con 0x7f10e4072d20 2023-11-27T17:49:08.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.542+0000 7f10eb229700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e406e510 con 0x7f10e4141030 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10eb229700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e4161ac0 con 0x7f10e406ded0 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e3fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f10e4072d20 0x7f10e406d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47538/0 (socket says 172.21.15.177:47538) 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e3fff700 1 -- 172.21.15.177:0/2738818278 learned_addr learned my addr 172.21.15.177:0/2738818278 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e97c6700 1 --2- 172.21.15.177:0/2738818278 >> v2:172.21.15.178:3300/0 conn(0x7f10e406ded0 0x7f10e4168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869913183 0 0) 0x7f10e406e2e0 con 0x7f10e4072d20 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d40035b0 con 0x7f10e4072d20 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222166974 0 0) 0x7f10d40035b0 con 0x7f10e4072d20 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 >> v2:172.21.15.178:3300/0 conn(0x7f10e406ded0 msgr2=0x7f10e4168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 --2- 172.21.15.177:0/2738818278 >> v2:172.21.15.178:3300/0 conn(0x7f10e406ded0 0x7f10e4168e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 >> v1:172.21.15.178:6789/0 conn(0x7f10e4141030 legacy=0x7f10e4072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4144630 con 0x7f10e4072d20 2023-11-27T17:49:08.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7f10d0001670 con 0x7f10e4072d20 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 >> v1:172.21.15.177:6789/0 conn(0x7f10e4072d20 legacy=0x7f10e406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10d4003a00 0x7f10d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10d4004850 0x7f10d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4161ac0 con 0x7f10d4005210 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d400c1b0 con 0x7f10d4004850 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d400c370 con 0x7f10d4003a00 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e97c6700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e3fff700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10d4004850 0x7f10d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.543+0000 7f10e8fc5700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10d4003a00 0x7f10d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e97c6700 1 -- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10d4003a00 msgr2=0x7f10d4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:08.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e97c6700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10d4003a00 0x7f10d4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e97c6700 1 -- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10d4004850 msgr2=0x7f10d4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:08.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e97c6700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10d4004850 0x7f10d4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e97c6700 1 -- 172.21.15.177:0/2738818278 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40035b0 con 0x7f10d4005210 2023-11-27T17:49:08.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e8fc5700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10d4003a00 0x7f10d4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:08.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e3fff700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10d4004850 0x7f10d4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:08.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e97c6700 1 -- 172.21.15.177:0/2738818278 reap_dead start 2023-11-27T17:49:08.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e97c6700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10d400ba10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009fc0 tx=0x7f10d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7f230941aebd93 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc003a20 con 0x7f10d4005210 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc00f040 con 0x7f10d4005210 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10e37fe700 1 -- 172.21.15.177:0/2738818278 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc003de0 con 0x7f10d4005210 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10eb229700 1 -- 172.21.15.177:0/2738818278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 msgr2=0x7f10d400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10eb229700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10d400ba10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009fc0 tx=0x7f10d4005880 comp rx=0 tx=0).stop 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10eb229700 1 -- 172.21.15.177:0/2738818278 shutdown_connections 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10eb229700 1 --2- 172.21.15.177:0/2738818278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10d400ba10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10eb229700 1 -- 172.21.15.177:0/2738818278 >> 172.21.15.177:0/2738818278 conn(0x7f10e406aff0 msgr2=0x7f10e406b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10eb229700 1 -- 172.21.15.177:0/2738818278 shutdown_connections 2023-11-27T17:49:08.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.544+0000 7f10eb229700 1 -- 172.21.15.177:0/2738818278 wait complete. 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.546+0000 7f10eb229700 1 Processor -- start 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.546+0000 7f10eb229700 1 -- start start 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.546+0000 7f10eb229700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10e4158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10eb229700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10e413fa30 0x7f10e41447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10eb229700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10e4132de0 0x7f10e4145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10eb229700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40afe10 con 0x7f10d4005210 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10eb229700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40b00b0 con 0x7f10e4132de0 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10eb229700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40b0390 con 0x7f10e413fa30 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10e4158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10e4158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53230/0 (socket says 172.21.15.177:53230) 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 -- 172.21.15.177:0/247003834 learned_addr learned my addr 172.21.15.177:0/247003834 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:08.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e3fff700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10e413fa30 0x7f10e41447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e97c6700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10e4132de0 0x7f10e4145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 -- 172.21.15.177:0/247003834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10e413fa30 msgr2=0x7f10e41447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10e413fa30 0x7f10e41447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 -- 172.21.15.177:0/247003834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10e4132de0 msgr2=0x7f10e4145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10e4132de0 0x7f10e4145600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 -- 172.21.15.177:0/247003834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40b0670 con 0x7f10d4005210 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e8fc5700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10e4158880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f10d800e550 tx=0x7f10d800e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e17fa700 1 -- 172.21.15.177:0/247003834 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d800ee80 con 0x7f10d4005210 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e17fa700 1 -- 172.21.15.177:0/247003834 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80052e0 con 0x7f10d4005210 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e40b0950 con 0x7f10d4005210 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10e17fa700 1 -- 172.21.15.177:0/247003834 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8003680 con 0x7f10d4005210 2023-11-27T17:49:08.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.547+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e4144d00 con 0x7f10d4005210 2023-11-27T17:49:08.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.548+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e4073aa0 con 0x7f10d4005210 2023-11-27T17:49:08.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.549+0000 7f10e17fa700 1 -- 172.21.15.177:0/247003834 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f10d80037e0 con 0x7f10d4005210 2023-11-27T17:49:08.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.549+0000 7f10e17fa700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f10c806b250 0x7f10c806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.549+0000 7f10e17fa700 1 -- 172.21.15.177:0/247003834 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10d8088a60 con 0x7f10d4005210 2023-11-27T17:49:08.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.549+0000 7f10e3fff700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f10c806b250 0x7f10c806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.550+0000 7f10e3fff700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f10c806b250 0x7f10c806d710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f10e413fe70 tx=0x7f10d0007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.553+0000 7f10e17fa700 1 -- 172.21.15.177:0/247003834 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f10d8053af0 con 0x7f10d4005210 2023-11-27T17:49:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.748+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f10e406e510 con 0x7f10d4005210 2023-11-27T17:49:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.749+0000 7f10e17fa700 1 -- 172.21.15.177:0/247003834 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f10e406e510 con 0x7f10d4005210 2023-11-27T17:49:08.750 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:08.750 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-11-27T17:49:08.750 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-11-27T17:49:08.751 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-11-27T17:49:08.751 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-11-27T17:49:08.751 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-11-27T17:49:08.751 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f10c806b250 msgr2=0x7f10c806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f10c806b250 0x7f10c806d710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f10e413fe70 tx=0x7f10d0007040 comp rx=0 tx=0).stop 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 msgr2=0x7f10e4158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10e4158880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f10d800e550 tx=0x7f10d800e860 comp rx=0 tx=0).stop 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 shutdown_connections 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f10c806b250 0x7f10c806d710 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10e4132de0 0x7f10e4145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10d4005210 0x7f10e4158880 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 --2- 172.21.15.177:0/247003834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10e413fa30 0x7f10e41447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 >> 172.21.15.177:0/247003834 conn(0x7f10e406aff0 msgr2=0x7f10e4141640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 shutdown_connections 2023-11-27T17:49:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.751+0000 7f10eb229700 1 -- 172.21.15.177:0/247003834 wait complete. 2023-11-27T17:49:08.765 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T17:49:08.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T17:49:08.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.888+0000 7f968195c700 1 Processor -- start 2023-11-27T17:49:08.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.888+0000 7f968195c700 1 -- start start 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f968195c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f967c0d3bf0 0x7f967c0d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f968195c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f967c0716d0 0x7f967c071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f968195c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967c072020 con 0x7f967c158830 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f968195c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c0d37d0 con 0x7f967c0716d0 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f968195c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c06c740 con 0x7f967c0d3bf0 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f967b7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f967c0716d0 0x7f967c071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f967b7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f967c0716d0 0x7f967c071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53242/0 (socket says 172.21.15.177:53242) 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f967b7fe700 1 -- 172.21.15.177:0/2306428719 learned_addr learned my addr 172.21.15.177:0/2306428719 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f967a7fc700 1 --2- 172.21.15.177:0/2306428719 >> v2:172.21.15.178:3300/0 conn(0x7f967c0d3bf0 0x7f967c0d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f967b7fe700 1 -- 172.21.15.177:0/2306428719 >> v2:172.21.15.178:3300/0 conn(0x7f967c0d3bf0 msgr2=0x7f967c0d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f967b7fe700 1 --2- 172.21.15.177:0/2306428719 >> v2:172.21.15.178:3300/0 conn(0x7f967c0d3bf0 0x7f967c0d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.889+0000 7f967b7fe700 1 -- 172.21.15.177:0/2306428719 >> v1:172.21.15.178:6789/0 conn(0x7f967c158830 legacy=0x7f967c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f967b7fe700 1 -- 172.21.15.177:0/2306428719 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c0d2b50 con 0x7f967c0716d0 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f967b7fe700 1 --2- 172.21.15.177:0/2306428719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c0716d0 0x7f967c071ae0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f967c0b33e0 tx=0x7f967400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9f45c97cc3ba83 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f9679ffb700 1 -- 172.21.15.177:0/2306428719 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400e070 con 0x7f967c0716d0 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f9679ffb700 1 -- 172.21.15.177:0/2306428719 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967400b910 con 0x7f967c0716d0 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f9679ffb700 1 -- 172.21.15.177:0/2306428719 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400bcc0 con 0x7f967c0716d0 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f968195c700 1 -- 172.21.15.177:0/2306428719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c0716d0 msgr2=0x7f967c071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f968195c700 1 --2- 172.21.15.177:0/2306428719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c0716d0 0x7f967c071ae0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f967c0b33e0 tx=0x7f967400b330 comp rx=0 tx=0).stop 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f968195c700 1 -- 172.21.15.177:0/2306428719 shutdown_connections 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f968195c700 1 --2- 172.21.15.177:0/2306428719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c0716d0 0x7f967c071ae0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f968195c700 1 --2- 172.21.15.177:0/2306428719 >> v2:172.21.15.178:3300/0 conn(0x7f967c0d3bf0 0x7f967c0d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f968195c700 1 -- 172.21.15.177:0/2306428719 >> 172.21.15.177:0/2306428719 conn(0x7f967c0b3850 msgr2=0x7f967c0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:08.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f968195c700 1 -- 172.21.15.177:0/2306428719 shutdown_connections 2023-11-27T17:49:08.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.890+0000 7f968195c700 1 -- 172.21.15.177:0/2306428719 wait complete. 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.892+0000 7f968195c700 1 Processor -- start 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.892+0000 7f968195c700 1 -- start start 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.892+0000 7f968195c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c0716d0 0x7f967c155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f968195c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c0d3bf0 0x7f967c06e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f968195c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c158830 0x7f967c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f968195c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c06f630 con 0x7f967c158830 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f968195c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c06e820 con 0x7f967c0d3bf0 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f968195c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c06f350 con 0x7f967c0716d0 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c158830 0x7f967c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c158830 0x7f967c15d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53248/0 (socket says 172.21.15.177:53248) 2023-11-27T17:49:08.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 -- 172.21.15.177:0/2304371906 learned_addr learned my addr 172.21.15.177:0/2304371906 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967a7fc700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c0d3bf0 0x7f967c06e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967affd700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c0716d0 0x7f967c155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 -- 172.21.15.177:0/2304371906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c0716d0 msgr2=0x7f967c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c0716d0 0x7f967c155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 -- 172.21.15.177:0/2304371906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c0d3bf0 msgr2=0x7f967c06e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c0d3bf0 0x7f967c06e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 -- 172.21.15.177:0/2304371906 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009b30 con 0x7f967c158830 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f967b7fe700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c158830 0x7f967c15d360 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f967c0b7630 tx=0x7f9674004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f9663fff700 1 -- 172.21.15.177:0/2304371906 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740048c0 con 0x7f967c158830 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f9663fff700 1 -- 172.21.15.177:0/2304371906 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96740099b0 con 0x7f967c158830 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f9663fff700 1 -- 172.21.15.177:0/2304371906 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967401c680 con 0x7f967c158830 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c158db0 con 0x7f967c158830 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.893+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c159370 con 0x7f967c158830 2023-11-27T17:49:08.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.894+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c159530 con 0x7f967c158830 2023-11-27T17:49:08.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.895+0000 7f9663fff700 1 -- 172.21.15.177:0/2304371906 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f967401c7e0 con 0x7f967c158830 2023-11-27T17:49:08.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.895+0000 7f9663fff700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f966806b250 0x7f966806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:08.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.895+0000 7f9663fff700 1 -- 172.21.15.177:0/2304371906 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f967408b1d0 con 0x7f967c158830 2023-11-27T17:49:08.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.895+0000 7f967affd700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f966806b250 0x7f966806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:08.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.896+0000 7f967affd700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f966806b250 0x7f966806d710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9670001800 tx=0x7f9670009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:08.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:08.900+0000 7f9663fff700 1 -- 172.21.15.177:0/2304371906 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f96740562e0 con 0x7f967c158830 2023-11-27T17:49:09.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.091+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f967c068450 con 0x7f967c158830 2023-11-27T17:49:09.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.758+0000 7f9663fff700 1 -- 172.21.15.177:0/2304371906 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9674059900 con 0x7f967c158830 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f966806b250 msgr2=0x7f966806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f966806b250 0x7f966806d710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9670001800 tx=0x7f9670009040 comp rx=0 tx=0).stop 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c158830 msgr2=0x7f967c15d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c158830 0x7f967c15d360 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f967c0b7630 tx=0x7f9674004ad0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 shutdown_connections 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f966806b250 0x7f966806d710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967c158830 0x7f967c15d360 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c0716d0 0x7f967c155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 --2- 172.21.15.177:0/2304371906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c0d3bf0 0x7f967c06e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 >> 172.21.15.177:0/2304371906 conn(0x7f967c0b3850 msgr2=0x7f967c0b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:09.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.761+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 shutdown_connections 2023-11-27T17:49:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.762+0000 7f968195c700 1 -- 172.21.15.177:0/2304371906 wait complete. 2023-11-27T17:49:09.764 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-11-27T17:49:09.781 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T17:49:09.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.912+0000 7fe342596700 1 Processor -- start 2023-11-27T17:49:09.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.912+0000 7fe342596700 1 -- start start 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.912+0000 7fe342596700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0cf3c0 0x7fe33c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.912+0000 7fe342596700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe33c160350 0x7fe33c144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.912+0000 7fe342596700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0d0f40 con 0x7fe33c0b2690 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.912+0000 7fe342596700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c1607e0 con 0x7fe33c160350 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.912+0000 7fe342596700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1609e0 con 0x7fe33c0cf3c0 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe33bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0cf3c0 0x7fe33c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe340b33700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe33c160350 0x7fe33c144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe33bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0cf3c0 0x7fe33c0b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:40718/0 (socket says 172.21.15.177:40718) 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe33bfff700 1 -- 172.21.15.177:0/1488179380 learned_addr learned my addr 172.21.15.177:0/1488179380 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:09.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe340b33700 1 -- 172.21.15.177:0/1488179380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0cf3c0 msgr2=0x7fe33c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:09.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe340b33700 1 --2- 172.21.15.177:0/1488179380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0cf3c0 0x7fe33c0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe340b33700 1 -- 172.21.15.177:0/1488179380 >> v1:172.21.15.178:6789/0 conn(0x7fe33c0b2690 legacy=0x7fe33c15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:09.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe340b33700 1 -- 172.21.15.177:0/1488179380 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0b7490 con 0x7fe33c160350 2023-11-27T17:49:09.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe33affd700 1 -- 172.21.15.177:0/1488179380 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861502630 0 0) 0x7fe33c0d0f40 con 0x7fe33c0b2690 2023-11-27T17:49:09.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe340b33700 1 --2- 172.21.15.177:0/1488179380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c160350 0x7fe33c144fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe334009d90 tx=0x7fe33400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd5cbe807271681 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:09.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.913+0000 7fe33affd700 1 -- 172.21.15.177:0/1488179380 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33400e070 con 0x7fe33c160350 2023-11-27T17:49:09.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe33affd700 1 -- 172.21.15.177:0/1488179380 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400bb20 con 0x7fe33c160350 2023-11-27T17:49:09.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe33affd700 1 -- 172.21.15.177:0/1488179380 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334012430 con 0x7fe33c160350 2023-11-27T17:49:09.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe342596700 1 -- 172.21.15.177:0/1488179380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c160350 msgr2=0x7fe33c144fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:09.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe342596700 1 --2- 172.21.15.177:0/1488179380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c160350 0x7fe33c144fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe334009d90 tx=0x7fe33400b330 comp rx=0 tx=0).stop 2023-11-27T17:49:09.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe342596700 1 -- 172.21.15.177:0/1488179380 shutdown_connections 2023-11-27T17:49:09.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe342596700 1 --2- 172.21.15.177:0/1488179380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c160350 0x7fe33c144fe0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe342596700 1 --2- 172.21.15.177:0/1488179380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0cf3c0 0x7fe33c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe342596700 1 -- 172.21.15.177:0/1488179380 >> 172.21.15.177:0/1488179380 conn(0x7fe33c072190 msgr2=0x7fe33c0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:09.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe342596700 1 -- 172.21.15.177:0/1488179380 shutdown_connections 2023-11-27T17:49:09.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.914+0000 7fe342596700 1 -- 172.21.15.177:0/1488179380 wait complete. 2023-11-27T17:49:09.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.915+0000 7fe342596700 1 Processor -- start 2023-11-27T17:49:09.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.915+0000 7fe342596700 1 -- start start 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe342596700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0b2690 0x7fe33c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe342596700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c0cf3c0 0x7fe33c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe342596700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c160350 0x7fe33c0b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe342596700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c14f240 con 0x7fe33c160350 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe342596700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c15c560 con 0x7fe33c0cf3c0 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe342596700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c15afa0 con 0x7fe33c0b2690 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe340b33700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c160350 0x7fe33c0b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe340b33700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c160350 0x7fe33c0b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53260/0 (socket says 172.21.15.177:53260) 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe340b33700 1 -- 172.21.15.177:0/805892331 learned_addr learned my addr 172.21.15.177:0/805892331 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe33b7fe700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c0cf3c0 0x7fe33c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.916+0000 7fe33bfff700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0b2690 0x7fe33c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:09.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe340b33700 1 -- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0b2690 msgr2=0x7fe33c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe340b33700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0b2690 0x7fe33c15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe340b33700 1 -- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c0cf3c0 msgr2=0x7fe33c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe340b33700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c0cf3c0 0x7fe33c15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe340b33700 1 -- 172.21.15.177:0/805892331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe334009a70 con 0x7fe33c160350 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe33b7fe700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c0cf3c0 0x7fe33c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe340b33700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c160350 0x7fe33c0b5320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0690f0 tx=0x7fe334004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe338ff9700 1 -- 172.21.15.177:0/805892331 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334012430 con 0x7fe33c160350 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe338ff9700 1 -- 172.21.15.177:0/805892331 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe334020070 con 0x7fe33c160350 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe338ff9700 1 -- 172.21.15.177:0/805892331 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334004280 con 0x7fe33c160350 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c15bfa0 con 0x7fe33c160350 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.917+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c14ee60 con 0x7fe33c160350 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.918+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c073aa0 con 0x7fe33c160350 2023-11-27T17:49:09.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.918+0000 7fe338ff9700 1 -- 172.21.15.177:0/805892331 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe3340043e0 con 0x7fe33c160350 2023-11-27T17:49:09.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.919+0000 7fe338ff9700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe32806b250 0x7fe32806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:09.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.919+0000 7fe338ff9700 1 -- 172.21.15.177:0/805892331 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe334022070 con 0x7fe33c160350 2023-11-27T17:49:09.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.919+0000 7fe33bfff700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe32806b250 0x7fe32806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:09.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.919+0000 7fe33bfff700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe32806b250 0x7fe32806d710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe330009bd0 tx=0x7fe3300092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:09.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:09.924+0000 7fe338ff9700 1 -- 172.21.15.177:0/805892331 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe334056360 con 0x7fe33c160350 2023-11-27T17:49:10.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-27T17:49:10.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-27T17:49:10.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-27T17:49:10.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-27T17:49:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.120+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe33c14f380 con 0x7fe33c160350 2023-11-27T17:49:10.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.763+0000 7fe338ff9700 1 -- 172.21.15.177:0/805892331 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe334059980 con 0x7fe33c160350 2023-11-27T17:49:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.767+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe32806b250 msgr2=0x7fe32806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.767+0000 7fe342596700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe32806b250 0x7fe32806d710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe330009bd0 tx=0x7fe3300092c0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.767+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c160350 msgr2=0x7fe33c0b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.767+0000 7fe342596700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c160350 0x7fe33c0b5320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0690f0 tx=0x7fe334004ad0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.769+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 shutdown_connections 2023-11-27T17:49:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.769+0000 7fe342596700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe32806b250 0x7fe32806d710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.769+0000 7fe342596700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c160350 0x7fe33c0b5320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.769+0000 7fe342596700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe33c0b2690 0x7fe33c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.769+0000 7fe342596700 1 --2- 172.21.15.177:0/805892331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe33c0cf3c0 0x7fe33c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.769+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 >> 172.21.15.177:0/805892331 conn(0x7fe33c072190 msgr2=0x7fe33c06d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:10.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.776+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 shutdown_connections 2023-11-27T17:49:10.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.777+0000 7fe342596700 1 -- 172.21.15.177:0/805892331 wait complete. 2023-11-27T17:49:10.784 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-11-27T17:49:10.795 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.920+0000 7f0775c05700 1 Processor -- start 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.921+0000 7f0775c05700 1 -- start start 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f0775c05700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f077015ac90 0x7f077015b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f0775c05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07700cee50 0x7f077015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f0775c05700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07700cdb60 con 0x7f07700cc8d0 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f0775c05700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07700cddb0 con 0x7f077015ac90 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f0775c05700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07700ce090 con 0x7f07700cee50 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076f7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f077015ac90 0x7f077015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076f7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f077015ac90 0x7f077015b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53264/0 (socket says 172.21.15.177:53264) 2023-11-27T17:49:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076f7fe700 1 -- 172.21.15.177:0/569829963 learned_addr learned my addr 172.21.15.177:0/569829963 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076effd700 1 --2- 172.21.15.177:0/569829963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07700cee50 0x7f077015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076f7fe700 1 -- 172.21.15.177:0/569829963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07700cee50 msgr2=0x7f077015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076f7fe700 1 --2- 172.21.15.177:0/569829963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07700cee50 0x7f077015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076f7fe700 1 -- 172.21.15.177:0/569829963 >> v1:172.21.15.178:6789/0 conn(0x7f07700cc8d0 legacy=0x7f07700ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076f7fe700 1 -- 172.21.15.177:0/569829963 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700ce370 con 0x7f077015ac90 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076effd700 1 --2- 172.21.15.177:0/569829963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07700cee50 0x7f077015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076f7fe700 1 --2- 172.21.15.177:0/569829963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077015ac90 0x7f077015b070 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f07640098f0 tx=0x7f0764009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28881a2d5ce5461 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076e7fc700 1 -- 172.21.15.177:0/569829963 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400b8a0 con 0x7f077015ac90 2023-11-27T17:49:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076e7fc700 1 -- 172.21.15.177:0/569829963 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400ba00 con 0x7f077015ac90 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.922+0000 7f076e7fc700 1 -- 172.21.15.177:0/569829963 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400bd90 con 0x7f077015ac90 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.923+0000 7f0775c05700 1 -- 172.21.15.177:0/569829963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077015ac90 msgr2=0x7f077015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.923+0000 7f0775c05700 1 --2- 172.21.15.177:0/569829963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077015ac90 0x7f077015b070 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f07640098f0 tx=0x7f0764009c00 comp rx=0 tx=0).stop 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.923+0000 7f0775c05700 1 -- 172.21.15.177:0/569829963 shutdown_connections 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.923+0000 7f0775c05700 1 --2- 172.21.15.177:0/569829963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f077015ac90 0x7f077015b070 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.923+0000 7f0775c05700 1 --2- 172.21.15.177:0/569829963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07700cee50 0x7f077015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.923+0000 7f0775c05700 1 -- 172.21.15.177:0/569829963 >> 172.21.15.177:0/569829963 conn(0x7f07700aef90 msgr2=0x7f07700af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.923+0000 7f0775c05700 1 -- 172.21.15.177:0/569829963 shutdown_connections 2023-11-27T17:49:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.923+0000 7f0775c05700 1 -- 172.21.15.177:0/569829963 wait complete. 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.924+0000 7f0775c05700 1 Processor -- start 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.924+0000 7f0775c05700 1 -- start start 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f0775c05700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07700cc8d0 0x7f0770155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f0775c05700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07700cee50 0x7f077013c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f0775c05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f077015ac90 0x7f0770071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f0775c05700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0770156f30 con 0x7f07700cee50 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f0775c05700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0770157350 con 0x7f07700cc8d0 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f0775c05700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07701562b0 con 0x7f077015ac90 2023-11-27T17:49:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076effd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07700cee50 0x7f077013c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076effd700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07700cee50 0x7f077013c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53272/0 (socket says 172.21.15.177:53272) 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076effd700 1 -- 172.21.15.177:0/452097612 learned_addr learned my addr 172.21.15.177:0/452097612 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076f7fe700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07700cc8d0 0x7f0770155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076ffff700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f077015ac90 0x7f0770071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076effd700 1 -- 172.21.15.177:0/452097612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f077015ac90 msgr2=0x7f0770071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076effd700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f077015ac90 0x7f0770071d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076effd700 1 -- 172.21.15.177:0/452097612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07700cc8d0 msgr2=0x7f0770155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076effd700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07700cc8d0 0x7f0770155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.925+0000 7f076effd700 1 -- 172.21.15.177:0/452097612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009550 con 0x7f07700cee50 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.926+0000 7f076effd700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07700cee50 0x7f077013c660 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f076000e7e0 tx=0x7f076000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.926+0000 7f0757fff700 1 -- 172.21.15.177:0/452097612 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760004230 con 0x7f07700cee50 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.926+0000 7f0757fff700 1 -- 172.21.15.177:0/452097612 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760004390 con 0x7f07700cee50 2023-11-27T17:49:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.926+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0770156590 con 0x7f07700cee50 2023-11-27T17:49:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.926+0000 7f0757fff700 1 -- 172.21.15.177:0/452097612 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600036a0 con 0x7f07700cee50 2023-11-27T17:49:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.926+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0770156b50 con 0x7f07700cee50 2023-11-27T17:49:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.927+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07701571a0 con 0x7f07700cee50 2023-11-27T17:49:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.927+0000 7f0757fff700 1 -- 172.21.15.177:0/452097612 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0760003800 con 0x7f07700cee50 2023-11-27T17:49:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.928+0000 7f0757fff700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f075c06b250 0x7f075c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.928+0000 7f076f7fe700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f075c06b250 0x7f075c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.928+0000 7f0757fff700 1 -- 172.21.15.177:0/452097612 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f07600897c0 con 0x7f07700cee50 2023-11-27T17:49:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.928+0000 7f076f7fe700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f075c06b250 0x7f075c06d710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0764009c40 tx=0x7f0764008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:10.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:10.932+0000 7f0757fff700 1 -- 172.21.15.177:0/452097612 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0760054630 con 0x7f07700cee50 2023-11-27T17:49:11.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.167+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0770069400 con 0x7f07700cee50 2023-11-27T17:49:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.765+0000 7f0757fff700 1 -- 172.21.15.177:0/452097612 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0760057c50 con 0x7f07700cee50 2023-11-27T17:49:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.769+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f075c06b250 msgr2=0x7f075c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.769+0000 7f0775c05700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f075c06b250 0x7f075c06d710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0764009c40 tx=0x7f0764008030 comp rx=0 tx=0).stop 2023-11-27T17:49:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.769+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07700cee50 msgr2=0x7f077013c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.769+0000 7f0775c05700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07700cee50 0x7f077013c660 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f076000e7e0 tx=0x7f076000eba0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.770+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 shutdown_connections 2023-11-27T17:49:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.770+0000 7f0775c05700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f075c06b250 0x7f075c06d710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.770+0000 7f0775c05700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f077015ac90 0x7f0770071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.770+0000 7f0775c05700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07700cc8d0 0x7f0770155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.770+0000 7f0775c05700 1 --2- 172.21.15.177:0/452097612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07700cee50 0x7f077013c660 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.770+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 >> 172.21.15.177:0/452097612 conn(0x7f07700aef90 msgr2=0x7f077015b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.771+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 shutdown_connections 2023-11-27T17:49:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.772+0000 7f0775c05700 1 -- 172.21.15.177:0/452097612 wait complete. 2023-11-27T17:49:11.779 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 4 and data pool 5 2023-11-27T17:49:11.804 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:49:11.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.923+0000 7f17fb4f3700 1 Processor -- start 2023-11-27T17:49:11.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.923+0000 7f17fb4f3700 1 -- start start 2023-11-27T17:49:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17fb4f3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f17f4147810 0x7f17f40b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17fb4f3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 0x7f17f40704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17fb4f3700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f17f4070a30 0x7f17f4161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17fb4f3700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f4070ec0 con 0x7f17f4070a30 2023-11-27T17:49:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17fb4f3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f406e200 con 0x7f17f4147810 2023-11-27T17:49:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17fb4f3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f406e4e0 con 0x7f17f406d9b0 2023-11-27T17:49:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17f9a90700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f17f4070a30 0x7f17f4161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17f9a90700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f17f4070a30 0x7f17f4161bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53294/0 (socket says 172.21.15.177:53294) 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17f9a90700 1 -- 172.21.15.177:0/2649873402 learned_addr learned my addr 172.21.15.177:0/2649873402 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17f8a8e700 1 --2- 172.21.15.177:0/2649873402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 0x7f17f40704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.924+0000 7f17f928f700 1 --2- 172.21.15.177:0/2649873402 >> v2:172.21.15.178:3300/0 conn(0x7f17f4147810 0x7f17f40b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17f9a90700 1 -- 172.21.15.177:0/2649873402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 msgr2=0x7f17f40704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17f9a90700 1 --2- 172.21.15.177:0/2649873402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 0x7f17f40704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17f9a90700 1 -- 172.21.15.177:0/2649873402 >> v2:172.21.15.178:3300/0 conn(0x7f17f4147810 msgr2=0x7f17f40b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17f9a90700 1 --2- 172.21.15.177:0/2649873402 >> v2:172.21.15.178:3300/0 conn(0x7f17f4147810 0x7f17f40b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17f9a90700 1 -- 172.21.15.177:0/2649873402 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f415e970 con 0x7f17f4070a30 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17f9a90700 1 --2- 172.21.15.177:0/2649873402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f4161bd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f17f40b1c90 tx=0x7f17ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3765aead0cb09a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17ebfff700 1 -- 172.21.15.177:0/2649873402 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00e070 con 0x7f17f4070a30 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17ebfff700 1 -- 172.21.15.177:0/2649873402 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec00b9c0 con 0x7f17f4070a30 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17ebfff700 1 -- 172.21.15.177:0/2649873402 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00bd70 con 0x7f17f4070a30 2023-11-27T17:49:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17fb4f3700 1 -- 172.21.15.177:0/2649873402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 msgr2=0x7f17f4161bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/2649873402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f4161bd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f17f40b1c90 tx=0x7f17ec00b330 comp rx=0 tx=0).stop 2023-11-27T17:49:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17fb4f3700 1 -- 172.21.15.177:0/2649873402 shutdown_connections 2023-11-27T17:49:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/2649873402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f4161bd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/2649873402 >> v2:172.21.15.178:3300/0 conn(0x7f17f4147810 0x7f17f40b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/2649873402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 0x7f17f40704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.925+0000 7f17fb4f3700 1 -- 172.21.15.177:0/2649873402 >> 172.21.15.177:0/2649873402 conn(0x7f17f40b2130 msgr2=0x7f17f40b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.926+0000 7f17fb4f3700 1 -- 172.21.15.177:0/2649873402 shutdown_connections 2023-11-27T17:49:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.926+0000 7f17fb4f3700 1 -- 172.21.15.177:0/2649873402 wait complete. 2023-11-27T17:49:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.927+0000 7f17fb4f3700 1 Processor -- start 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.927+0000 7f17fb4f3700 1 -- start start 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.927+0000 7f17fb4f3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 0x7f17f41404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.927+0000 7f17fb4f3700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f413ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.927+0000 7f17fb4f3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f4147810 0x7f17f40af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.927+0000 7f17fb4f3700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41409e0 con 0x7f17f4070a30 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.927+0000 7f17fb4f3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4140010 con 0x7f17f4147810 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.927+0000 7f17fb4f3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f413f470 con 0x7f17f406d9b0 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f413ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f413ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53298/0 (socket says 172.21.15.177:53298) 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 -- 172.21.15.177:0/821627810 learned_addr learned my addr 172.21.15.177:0/821627810 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f928f700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 0x7f17f41404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f9a90700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f4147810 0x7f17f40af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 -- 172.21.15.177:0/821627810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 msgr2=0x7f17f41404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 0x7f17f41404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 -- 172.21.15.177:0/821627810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f4147810 msgr2=0x7f17f40af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f4147810 0x7f17f40af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 -- 172.21.15.177:0/821627810 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec009b30 con 0x7f17f4070a30 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17f8a8e700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f413ac20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e840 tx=0x7f17f000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17e9ffb700 1 -- 172.21.15.177:0/821627810 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f000c070 con 0x7f17f4070a30 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17e9ffb700 1 -- 172.21.15.177:0/821627810 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0013610 con 0x7f17f4070a30 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f413f6e0 con 0x7f17f4070a30 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17e9ffb700 1 -- 172.21.15.177:0/821627810 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00139a0 con 0x7f17f4070a30 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.928+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f413fca0 con 0x7f17f4070a30 2023-11-27T17:49:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.929+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f4073aa0 con 0x7f17f4070a30 2023-11-27T17:49:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.930+0000 7f17e9ffb700 1 -- 172.21.15.177:0/821627810 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f17f0013b00 con 0x7f17f4070a30 2023-11-27T17:49:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.930+0000 7f17e9ffb700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f17d806b250 0x7f17d806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.930+0000 7f17f928f700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f17d806b250 0x7f17d806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.930+0000 7f17e9ffb700 1 -- 172.21.15.177:0/821627810 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17f0089690 con 0x7f17f4070a30 2023-11-27T17:49:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.931+0000 7f17f928f700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f17d806b250 0x7f17d806d710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17e4006b20 tx=0x7f17e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:11.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:11.935+0000 7f17e9ffb700 1 -- 172.21.15.177:0/821627810 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f17f00543c0 con 0x7f17f4070a30 2023-11-27T17:49:12.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.126+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17f406de30 con 0x7f17f4070a30 2023-11-27T17:49:12.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.127+0000 7f17e9ffb700 1 -- 172.21.15.177:0/821627810 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16619 (secure 0 0 0) 0x7f17f0009440 con 0x7f17f4070a30 2023-11-27T17:49:12.129 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:12.129 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":32,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:49:11.167713+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:49:09.109220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T17:49:10.137874+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:49:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f17d806b250 msgr2=0x7f17d806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f17d806b250 0x7f17d806d710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17e4006b20 tx=0x7f17e4008040 comp rx=0 tx=0).stop 2023-11-27T17:49:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 msgr2=0x7f17f413ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f413ac20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e840 tx=0x7f17f000eb50 comp rx=0 tx=0).stop 2023-11-27T17:49:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 shutdown_connections 2023-11-27T17:49:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f17d806b250 0x7f17d806d710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f4147810 0x7f17f40af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f406d9b0 0x7f17f41404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 --2- 172.21.15.177:0/821627810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17f4070a30 0x7f17f413ac20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 >> 172.21.15.177:0/821627810 conn(0x7f17f40b2130 msgr2=0x7f17f4161140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 shutdown_connections 2023-11-27T17:49:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.129+0000 7f17fb4f3700 1 -- 172.21.15.177:0/821627810 wait complete. 2023-11-27T17:49:12.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:49:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.261+0000 7f08e651e700 1 Processor -- start 2023-11-27T17:49:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.261+0000 7f08e651e700 1 -- start start 2023-11-27T17:49:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08e651e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f08e0143ec0 0x7f08e015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08e651e700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f08e015e6e0 0x7f08e00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08e651e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e006df10 con 0x7f08e00cd760 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08e651e700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00cdb80 con 0x7f08e015e6e0 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08e651e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e015ec20 con 0x7f08e0143ec0 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08df7fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f08e015e6e0 0x7f08e00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08e4abb700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f08e00cd760 0x7f08e00cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47626/0 (socket says 172.21.15.177:47626) 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08e4abb700 1 -- 172.21.15.177:0/27980163 learned_addr learned my addr 172.21.15.177:0/27980163 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08dffff700 1 --2- 172.21.15.177:0/27980163 >> v2:172.21.15.178:3300/0 conn(0x7f08e0143ec0 0x7f08e015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08df7fe700 1 -- 172.21.15.177:0/27980163 >> v2:172.21.15.178:3300/0 conn(0x7f08e0143ec0 msgr2=0x7f08e015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08df7fe700 1 --2- 172.21.15.177:0/27980163 >> v2:172.21.15.178:3300/0 conn(0x7f08e0143ec0 0x7f08e015e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08df7fe700 1 -- 172.21.15.177:0/27980163 >> v1:172.21.15.177:6789/0 conn(0x7f08e00cd760 legacy=0x7f08e00cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08df7fe700 1 -- 172.21.15.177:0/27980163 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e015ef00 con 0x7f08e015e6e0 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08df7fe700 1 --2- 172.21.15.177:0/27980163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e00cd220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b3640 tx=0x7f08d0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf46ff31bf1f7de9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08deffd700 1 -- 172.21.15.177:0/27980163 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0010800 con 0x7f08e015e6e0 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08deffd700 1 -- 172.21.15.177:0/27980163 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0010960 con 0x7f08e015e6e0 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.262+0000 7f08deffd700 1 -- 172.21.15.177:0/27980163 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0010cf0 con 0x7f08e015e6e0 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.263+0000 7f08e651e700 1 -- 172.21.15.177:0/27980163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 msgr2=0x7f08e00cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.263+0000 7f08e651e700 1 --2- 172.21.15.177:0/27980163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e00cd220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b3640 tx=0x7f08d0009b20 comp rx=0 tx=0).stop 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.263+0000 7f08e651e700 1 -- 172.21.15.177:0/27980163 shutdown_connections 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.263+0000 7f08e651e700 1 --2- 172.21.15.177:0/27980163 >> v2:172.21.15.178:3300/0 conn(0x7f08e0143ec0 0x7f08e015e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.263+0000 7f08e651e700 1 --2- 172.21.15.177:0/27980163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e00cd220 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.263+0000 7f08e651e700 1 -- 172.21.15.177:0/27980163 >> 172.21.15.177:0/27980163 conn(0x7f08e00b1ff0 msgr2=0x7f08e00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.263+0000 7f08e651e700 1 -- 172.21.15.177:0/27980163 shutdown_connections 2023-11-27T17:49:12.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.263+0000 7f08e651e700 1 -- 172.21.15.177:0/27980163 wait complete. 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.264+0000 7f08e651e700 1 Processor -- start 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.264+0000 7f08e651e700 1 -- start start 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e651e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e00cd760 0x7f08e015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e651e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e0143ec0 0x7f08e015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e651e700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e0136380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e651e700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e015a120 con 0x7f08e015e6e0 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e651e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e01f42c0 con 0x7f08e0143ec0 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e651e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0159e40 con 0x7f08e00cd760 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e4abb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e0136380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e4abb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e0136380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53314/0 (socket says 172.21.15.177:53314) 2023-11-27T17:49:12.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08e4abb700 1 -- 172.21.15.177:0/2744992304 learned_addr learned my addr 172.21.15.177:0/2744992304 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08df7fe700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e0143ec0 0x7f08e015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.265+0000 7f08dffff700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e00cd760 0x7f08e015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08e4abb700 1 -- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e00cd760 msgr2=0x7f08e015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08e4abb700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e00cd760 0x7f08e015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08e4abb700 1 -- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e0143ec0 msgr2=0x7f08e015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08e4abb700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e0143ec0 0x7f08e015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08e4abb700 1 -- 172.21.15.177:0/2744992304 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00094a0 con 0x7f08e015e6e0 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08dffff700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e00cd760 0x7f08e015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08e4abb700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e0136380 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f08d800cbc0 tx=0x7f08d800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08dcff9700 1 -- 172.21.15.177:0/2744992304 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800aaa0 con 0x7f08e015e6e0 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08dcff9700 1 -- 172.21.15.177:0/2744992304 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800ac00 con 0x7f08e015e6e0 2023-11-27T17:49:12.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e0134010 con 0x7f08e015e6e0 2023-11-27T17:49:12.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08dcff9700 1 -- 172.21.15.177:0/2744992304 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8012400 con 0x7f08e015e6e0 2023-11-27T17:49:12.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.266+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e01345d0 con 0x7f08e015e6e0 2023-11-27T17:49:12.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.267+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e0073aa0 con 0x7f08e015e6e0 2023-11-27T17:49:12.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.267+0000 7f08dcff9700 1 -- 172.21.15.177:0/2744992304 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f08d801b3b0 con 0x7f08e015e6e0 2023-11-27T17:49:12.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.268+0000 7f08dcff9700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f08cc06b250 0x7f08cc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.268+0000 7f08dcff9700 1 -- 172.21.15.177:0/2744992304 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08d8089560 con 0x7f08e015e6e0 2023-11-27T17:49:12.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.268+0000 7f08dffff700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f08cc06b250 0x7f08cc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.268+0000 7f08dffff700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f08cc06b250 0x7f08cc06d710 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f08d40099f0 tx=0x7f08d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:12.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.272+0000 7f08dcff9700 1 -- 172.21.15.177:0/2744992304 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f08d8054330 con 0x7f08e015e6e0 2023-11-27T17:49:12.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.462+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e015a5a0 con 0x7f08e015e6e0 2023-11-27T17:49:12.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.464+0000 7f08dcff9700 1 -- 172.21.15.177:0/2744992304 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16619 (secure 0 0 0) 0x7f08d8057950 con 0x7f08e015e6e0 2023-11-27T17:49:12.465 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:12.465 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":32,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:49:11.167713+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:49:09.109220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T17:49:10.137874+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:49:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f08cc06b250 msgr2=0x7f08cc06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f08cc06b250 0x7f08cc06d710 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f08d40099f0 tx=0x7f08d4008040 comp rx=0 tx=0).stop 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 msgr2=0x7f08e0136380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e0136380 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f08d800cbc0 tx=0x7f08d800ced0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 shutdown_connections 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f08cc06b250 0x7f08cc06d710 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e015e6e0 0x7f08e0136380 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e00cd760 0x7f08e015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 --2- 172.21.15.177:0/2744992304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e0143ec0 0x7f08e015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 >> 172.21.15.177:0/2744992304 conn(0x7f08e00b1ff0 msgr2=0x7f08e0067050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 shutdown_connections 2023-11-27T17:49:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.466+0000 7f08e651e700 1 -- 172.21.15.177:0/2744992304 wait complete. 2023-11-27T17:49:12.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T17:49:12.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.600+0000 7ffa617f8700 1 Processor -- start 2023-11-27T17:49:12.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.600+0000 7ffa617f8700 1 -- start start 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.601+0000 7ffa617f8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa5c0afc30 0x7ffa5c162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.601+0000 7ffa617f8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c162bc0 con 0x7ffa5c0cdff0 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.601+0000 7ffa617f8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0b0110 con 0x7ffa5c146f00 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.601+0000 7ffa617f8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c1472e0 con 0x7ffa5c0afc30 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.601+0000 7ffa5a7fc700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ffa5c0cdff0 0x7ffa5c0cef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47638/0 (socket says 172.21.15.177:47638) 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa5a7fc700 1 -- 172.21.15.177:0/560977822 learned_addr learned my addr 172.21.15.177:0/560977822 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa5b7fe700 1 --2- 172.21.15.177:0/560977822 >> v2:172.21.15.178:3300/0 conn(0x7ffa5c0afc30 0x7ffa5c162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa59ffb700 1 -- 172.21.15.177:0/560977822 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539136832 0 0) 0x7ffa5c162bc0 con 0x7ffa5c0cdff0 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa59ffb700 1 -- 172.21.15.177:0/560977822 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa440035b0 con 0x7ffa5c0cdff0 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa59ffb700 1 -- 172.21.15.177:0/560977822 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1275224472 0 0) 0x7ffa440035b0 con 0x7ffa5c0cdff0 2023-11-27T17:49:12.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa5b7fe700 1 -- 172.21.15.177:0/560977822 >> v1:172.21.15.178:6789/0 conn(0x7ffa5c146f00 legacy=0x7ffa5c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa5b7fe700 1 -- 172.21.15.177:0/560977822 >> v1:172.21.15.177:6789/0 conn(0x7ffa5c0cdff0 legacy=0x7ffa5c0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa5b7fe700 1 -- 172.21.15.177:0/560977822 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0b03f0 con 0x7ffa5c0afc30 2023-11-27T17:49:12.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa5b7fe700 1 --2- 172.21.15.177:0/560977822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 0x7ffa5c162680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009d90 tx=0x7ffa5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37ecd70a5cbaf82 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:12.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa59ffb700 1 -- 172.21.15.177:0/560977822 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400e070 con 0x7ffa5c0afc30 2023-11-27T17:49:12.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa59ffb700 1 -- 172.21.15.177:0/560977822 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54003a20 con 0x7ffa5c0afc30 2023-11-27T17:49:12.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.602+0000 7ffa59ffb700 1 -- 172.21.15.177:0/560977822 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c001670 con 0x7ffa5c0afc30 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.603+0000 7ffa617f8700 1 -- 172.21.15.177:0/560977822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 msgr2=0x7ffa5c162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.603+0000 7ffa617f8700 1 --2- 172.21.15.177:0/560977822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 0x7ffa5c162680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009d90 tx=0x7ffa5400b330 comp rx=0 tx=0).stop 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.603+0000 7ffa617f8700 1 -- 172.21.15.177:0/560977822 shutdown_connections 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.603+0000 7ffa617f8700 1 --2- 172.21.15.177:0/560977822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 0x7ffa5c162680 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.603+0000 7ffa617f8700 1 -- 172.21.15.177:0/560977822 >> 172.21.15.177:0/560977822 conn(0x7ffa5c0b38b0 msgr2=0x7ffa5c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.603+0000 7ffa617f8700 1 -- 172.21.15.177:0/560977822 shutdown_connections 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.603+0000 7ffa617f8700 1 -- 172.21.15.177:0/560977822 wait complete. 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.604+0000 7ffa617f8700 1 Processor -- start 2023-11-27T17:49:12.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.604+0000 7ffa617f8700 1 -- start start 2023-11-27T17:49:12.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa617f8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 0x7ffa5c1f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa617f8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa5c0cdff0 0x7ffa5c1406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa617f8700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c146f00 0x7ffa5c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa617f8700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c15d770 con 0x7ffa5c146f00 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa617f8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c1f4a70 con 0x7ffa5c0afc30 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa617f8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c140c00 con 0x7ffa5c0cdff0 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c146f00 0x7ffa5c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5b7fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c146f00 0x7ffa5c141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53328/0 (socket says 172.21.15.177:53328) 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5b7fe700 1 -- 172.21.15.177:0/769021398 learned_addr learned my addr 172.21.15.177:0/769021398 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5affd700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 0x7ffa5c1f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5a7fc700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa5c0cdff0 0x7ffa5c1406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5b7fe700 1 -- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa5c0cdff0 msgr2=0x7ffa5c1406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5b7fe700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa5c0cdff0 0x7ffa5c1406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5b7fe700 1 -- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 msgr2=0x7ffa5c1f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5b7fe700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 0x7ffa5c1f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:12.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5b7fe700 1 -- 172.21.15.177:0/769021398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54009a70 con 0x7ffa5c146f00 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5a7fc700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa5c0cdff0 0x7ffa5c1406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.605+0000 7ffa5affd700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 0x7ffa5c1f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.606+0000 7ffa5b7fe700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c146f00 0x7ffa5c141fc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffa54015040 tx=0x7ffa54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.606+0000 7ffa437fe700 1 -- 172.21.15.177:0/769021398 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54004760 con 0x7ffa5c146f00 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.606+0000 7ffa437fe700 1 -- 172.21.15.177:0/769021398 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa540048c0 con 0x7ffa5c146f00 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.606+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c15b410 con 0x7ffa5c146f00 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.606+0000 7ffa437fe700 1 -- 172.21.15.177:0/769021398 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5401b680 con 0x7ffa5c146f00 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.606+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c15b9d0 con 0x7ffa5c146f00 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.607+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c162bc0 con 0x7ffa5c146f00 2023-11-27T17:49:12.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.607+0000 7ffa437fe700 1 -- 172.21.15.177:0/769021398 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ffa5401b7e0 con 0x7ffa5c146f00 2023-11-27T17:49:12.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.607+0000 7ffa437fe700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ffa4806b250 0x7ffa4806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:12.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.608+0000 7ffa437fe700 1 -- 172.21.15.177:0/769021398 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa5408b140 con 0x7ffa5c146f00 2023-11-27T17:49:12.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.608+0000 7ffa5affd700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ffa4806b250 0x7ffa4806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:12.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.608+0000 7ffa5affd700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ffa4806b250 0x7ffa4806d710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c143190 tx=0x7ffa50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:12.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.612+0000 7ffa437fe700 1 -- 172.21.15.177:0/769021398 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ffa54059990 con 0x7ffa5c146f00 2023-11-27T17:49:12.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:12.851+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffa5c069400 con 0x7ffa5c146f00 2023-11-27T17:49:13.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.787+0000 7ffa437fe700 1 -- 172.21.15.177:0/769021398 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffa54059520 con 0x7ffa5c146f00 2023-11-27T17:49:13.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ffa4806b250 msgr2=0x7ffa4806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:13.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ffa4806b250 0x7ffa4806d710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c143190 tx=0x7ffa50009040 comp rx=0 tx=0).stop 2023-11-27T17:49:13.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c146f00 msgr2=0x7ffa5c141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:13.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c146f00 0x7ffa5c141fc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffa54015040 tx=0x7ffa54004ad0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 shutdown_connections 2023-11-27T17:49:13.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7ffa4806b250 0x7ffa4806d710 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c146f00 0x7ffa5c141fc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa5c0afc30 0x7ffa5c1f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 --2- 172.21.15.177:0/769021398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa5c0cdff0 0x7ffa5c1406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 >> 172.21.15.177:0/769021398 conn(0x7ffa5c0b38b0 msgr2=0x7ffa5c0b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:13.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 shutdown_connections 2023-11-27T17:49:13.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.790+0000 7ffa617f8700 1 -- 172.21.15.177:0/769021398 wait complete. 2023-11-27T17:49:13.806 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T17:49:13.807 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T17:49:13.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.934+0000 7fe0da476700 1 Processor -- start 2023-11-27T17:49:13.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.934+0000 7fe0da476700 1 -- start start 2023-11-27T17:49:13.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0da476700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe0d40cdf60 0x7fe0d40b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:13.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0da476700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d415b870 con 0x7fe0d40afa50 2023-11-27T17:49:13.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0da476700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d415bb50 con 0x7fe0d415b3d0 2023-11-27T17:49:13.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0da476700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d40afe30 con 0x7fe0d40cdf60 2023-11-27T17:49:13.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d3fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe0d40afa50 0x7fe0d415e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47650/0 (socket says 172.21.15.177:47650) 2023-11-27T17:49:13.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d3fff700 1 -- 172.21.15.177:0/186705065 learned_addr learned my addr 172.21.15.177:0/186705065 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:13.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d8a13700 1 --2- 172.21.15.177:0/186705065 >> v2:172.21.15.178:3300/0 conn(0x7fe0d40cdf60 0x7fe0d40b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:13.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937964985 0 0) 0x7fe0d415b870 con 0x7fe0d40afa50 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0bc0035b0 con 0x7fe0d40afa50 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832427400 0 0) 0x7fe0bc0035b0 con 0x7fe0d40afa50 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 >> v2:172.21.15.178:3300/0 conn(0x7fe0d40cdf60 msgr2=0x7fe0d40b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 --2- 172.21.15.177:0/186705065 >> v2:172.21.15.178:3300/0 conn(0x7fe0d40cdf60 0x7fe0d40b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 >> v1:172.21.15.178:6789/0 conn(0x7fe0d415b3d0 legacy=0x7fe0d40cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d415be30 con 0x7fe0d40afa50 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fe0c8001670 con 0x7fe0d40afa50 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.935+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 >> v1:172.21.15.177:6789/0 conn(0x7fe0d40afa50 legacy=0x7fe0d415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc003a00 0x7fe0bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc004850 0x7fe0bc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0bc005210 0x7fe0bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40afe30 con 0x7fe0bc005210 2023-11-27T17:49:13.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc00c0b0 con 0x7fe0bc003a00 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc00c270 con 0x7fe0bc004850 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d3fff700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc003a00 0x7fe0bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d8a13700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0bc005210 0x7fe0bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d37fe700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc004850 0x7fe0bc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d8a13700 1 -- 172.21.15.177:0/186705065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc004850 msgr2=0x7fe0bc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d8a13700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc004850 0x7fe0bc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d8a13700 1 -- 172.21.15.177:0/186705065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc003a00 msgr2=0x7fe0bc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d8a13700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc003a00 0x7fe0bc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d8a13700 1 -- 172.21.15.177:0/186705065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0035b0 con 0x7fe0bc005210 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d8a13700 1 -- 172.21.15.177:0/186705065 reap_dead start 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d8a13700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0bc005210 0x7fe0bc00ba10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009fc0 tx=0x7fe0bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf80ad93d4084e1e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:13.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc003a20 con 0x7fe0bc005210 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc00f040 con 0x7fe0bc005210 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.936+0000 7fe0d2ffd700 1 -- 172.21.15.177:0/186705065 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc003de0 con 0x7fe0bc005210 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.937+0000 7fe0da476700 1 -- 172.21.15.177:0/186705065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0bc005210 msgr2=0x7fe0bc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.937+0000 7fe0da476700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0bc005210 0x7fe0bc00ba10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009fc0 tx=0x7fe0bc005880 comp rx=0 tx=0).stop 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.937+0000 7fe0da476700 1 -- 172.21.15.177:0/186705065 shutdown_connections 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.937+0000 7fe0da476700 1 --2- 172.21.15.177:0/186705065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0bc005210 0x7fe0bc00ba10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.937+0000 7fe0da476700 1 -- 172.21.15.177:0/186705065 >> 172.21.15.177:0/186705065 conn(0x7fe0d40b38b0 msgr2=0x7fe0d40b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.937+0000 7fe0da476700 1 -- 172.21.15.177:0/186705065 shutdown_connections 2023-11-27T17:49:13.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.937+0000 7fe0da476700 1 -- 172.21.15.177:0/186705065 wait complete. 2023-11-27T17:49:13.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.938+0000 7fe0da476700 1 Processor -- start 2023-11-27T17:49:13.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.938+0000 7fe0da476700 1 -- start start 2023-11-27T17:49:13.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0da476700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc005210 0x7fe0d41572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:13.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0da476700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d40a94c0 0x7fe0d41416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:13.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0da476700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0d4155920 0x7fe0d40704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0da476700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4156e10 con 0x7fe0d4155920 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0da476700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4156200 con 0x7fe0bc005210 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0da476700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d41564e0 con 0x7fe0d40a94c0 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0d4155920 0x7fe0d40704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0d4155920 0x7fe0d40704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53348/0 (socket says 172.21.15.177:53348) 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 -- 172.21.15.177:0/2708272568 learned_addr learned my addr 172.21.15.177:0/2708272568 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 -- 172.21.15.177:0/2708272568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d40a94c0 msgr2=0x7fe0d41416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d40a94c0 0x7fe0d41416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d3fff700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc005210 0x7fe0d41572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 -- 172.21.15.177:0/2708272568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc005210 msgr2=0x7fe0d41572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc005210 0x7fe0d41572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:13.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 -- 172.21.15.177:0/2708272568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d41567c0 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.939+0000 7fe0d8a13700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0d4155920 0x7fe0d40704f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40ce540 tx=0x7fe0cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.940+0000 7fe0d0ff9700 1 -- 172.21.15.177:0/2708272568 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc003e10 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.940+0000 7fe0d0ff9700 1 -- 172.21.15.177:0/2708272568 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc004230 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.940+0000 7fe0d0ff9700 1 -- 172.21.15.177:0/2708272568 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0045e0 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.940+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d4156aa0 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.940+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d4155da0 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.941+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d4155fc0 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.941+0000 7fe0d0ff9700 1 -- 172.21.15.177:0/2708272568 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe0cc004740 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.941+0000 7fe0d0ff9700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe0c006b280 0x7fe0c006d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.941+0000 7fe0d0ff9700 1 -- 172.21.15.177:0/2708272568 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0cc08abc0 con 0x7fe0d4155920 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.941+0000 7fe0d3fff700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe0c006b280 0x7fe0c006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:13.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.942+0000 7fe0d3fff700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe0c006b280 0x7fe0c006d740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8001050 tx=0x7fe0c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:13.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:13.946+0000 7fe0d0ff9700 1 -- 172.21.15.177:0/2708272568 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe0d4155fc0 con 0x7fe0d4155920 2023-11-27T17:49:14.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.180+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe0d4155fc0 con 0x7fe0d4155920 2023-11-27T17:49:14.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.791+0000 7fe0d0ff9700 1 -- 172.21.15.177:0/2708272568 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe0d4155fc0 con 0x7fe0d4155920 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe0c006b280 msgr2=0x7fe0c006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe0c006b280 0x7fe0c006d740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8001050 tx=0x7fe0c8009040 comp rx=0 tx=0).stop 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0d4155920 msgr2=0x7fe0d40704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0d4155920 0x7fe0d40704f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40ce540 tx=0x7fe0cc009750 comp rx=0 tx=0).stop 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 shutdown_connections 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe0c006b280 0x7fe0c006d740 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0d4155920 0x7fe0d40704f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc005210 0x7fe0d41572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 --2- 172.21.15.177:0/2708272568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d40a94c0 0x7fe0d41416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 >> 172.21.15.177:0/2708272568 conn(0x7fe0d40b38b0 msgr2=0x7fe0d415c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:14.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 shutdown_connections 2023-11-27T17:49:14.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.794+0000 7fe0da476700 1 -- 172.21.15.177:0/2708272568 wait complete. 2023-11-27T17:49:14.810 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T17:49:14.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:49:14.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.930+0000 7fc91e8f9700 1 Processor -- start 2023-11-27T17:49:14.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.931+0000 7fc91e8f9700 1 -- start start 2023-11-27T17:49:14.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.931+0000 7fc91e8f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc91815df10 0x7fc9180d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:14.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.931+0000 7fc91e8f9700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc91815e2f0 0x7fc9180d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:14.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.931+0000 7fc91e8f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc918161e00 con 0x7fc9180b21c0 2023-11-27T17:49:14.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.931+0000 7fc91e8f9700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91806c100 con 0x7fc91815e2f0 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.931+0000 7fc91e8f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9181620e0 con 0x7fc91815df10 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc9177fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc91815e2f0 0x7fc9180d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc9177fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc91815e2f0 0x7fc9180d17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53352/0 (socket says 172.21.15.177:53352) 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc9177fe700 1 -- 172.21.15.177:0/1803232122 learned_addr learned my addr 172.21.15.177:0/1803232122 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc917fff700 1 --2- 172.21.15.177:0/1803232122 >> v2:172.21.15.178:3300/0 conn(0x7fc91815df10 0x7fc9180d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc9177fe700 1 -- 172.21.15.177:0/1803232122 >> v2:172.21.15.178:3300/0 conn(0x7fc91815df10 msgr2=0x7fc9180d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc9177fe700 1 --2- 172.21.15.177:0/1803232122 >> v2:172.21.15.178:3300/0 conn(0x7fc91815df10 0x7fc9180d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc9177fe700 1 -- 172.21.15.177:0/1803232122 >> v1:172.21.15.178:6789/0 conn(0x7fc9180b21c0 legacy=0x7fc9180b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc9177fe700 1 -- 172.21.15.177:0/1803232122 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9181623c0 con 0x7fc91815e2f0 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc917fff700 1 --2- 172.21.15.177:0/1803232122 >> v2:172.21.15.178:3300/0 conn(0x7fc91815df10 0x7fc9180d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc9177fe700 1 --2- 172.21.15.177:0/1803232122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815e2f0 0x7fc9180d17c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b4ae0 tx=0x7fc900009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf906ee7a8ad96b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc916ffd700 1 -- 172.21.15.177:0/1803232122 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000b870 con 0x7fc91815e2f0 2023-11-27T17:49:14.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc916ffd700 1 -- 172.21.15.177:0/1803232122 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000b9d0 con 0x7fc91815e2f0 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.932+0000 7fc916ffd700 1 -- 172.21.15.177:0/1803232122 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000bd60 con 0x7fc91815e2f0 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.933+0000 7fc91e8f9700 1 -- 172.21.15.177:0/1803232122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815e2f0 msgr2=0x7fc9180d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.933+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/1803232122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815e2f0 0x7fc9180d17c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b4ae0 tx=0x7fc900009bd0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.933+0000 7fc91e8f9700 1 -- 172.21.15.177:0/1803232122 shutdown_connections 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.933+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/1803232122 >> v2:172.21.15.178:3300/0 conn(0x7fc91815df10 0x7fc9180d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.933+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/1803232122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815e2f0 0x7fc9180d17c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.933+0000 7fc91e8f9700 1 -- 172.21.15.177:0/1803232122 >> 172.21.15.177:0/1803232122 conn(0x7fc918072190 msgr2=0x7fc9180725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.933+0000 7fc91e8f9700 1 -- 172.21.15.177:0/1803232122 shutdown_connections 2023-11-27T17:49:14.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.933+0000 7fc91e8f9700 1 -- 172.21.15.177:0/1803232122 wait complete. 2023-11-27T17:49:14.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.934+0000 7fc91e8f9700 1 Processor -- start 2023-11-27T17:49:14.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.935+0000 7fc91e8f9700 1 -- start start 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.935+0000 7fc91e8f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9180b21c0 0x7fc9180cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.935+0000 7fc91e8f9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815df10 0x7fc9180cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.935+0000 7fc91e8f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91815e2f0 0x7fc9181f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.935+0000 7fc91e8f9700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180cdfa0 con 0x7fc91815df10 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.935+0000 7fc91e8f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180cd230 con 0x7fc9180b21c0 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.935+0000 7fc91e8f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180cd420 con 0x7fc91815e2f0 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815df10 0x7fc9180cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815df10 0x7fc9180cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53360/0 (socket says 172.21.15.177:53360) 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc917fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9180b21c0 0x7fc9180cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 -- 172.21.15.177:0/4252426178 learned_addr learned my addr 172.21.15.177:0/4252426178 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc91ce96700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91815e2f0 0x7fc9181f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:14.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 -- 172.21.15.177:0/4252426178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91815e2f0 msgr2=0x7fc9181f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91815e2f0 0x7fc9181f33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 -- 172.21.15.177:0/4252426178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9180b21c0 msgr2=0x7fc9180cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9180b21c0 0x7fc9180cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 -- 172.21.15.177:0/4252426178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009550 con 0x7fc91815df10 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc91ce96700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91815e2f0 0x7fc9181f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc9177fe700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815df10 0x7fc9180cccf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc900000c00 tx=0x7fc900004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc914ff9700 1 -- 172.21.15.177:0/4252426178 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900004520 con 0x7fc91815df10 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc914ff9700 1 -- 172.21.15.177:0/4252426178 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90001e070 con 0x7fc91815df10 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9180cd700 con 0x7fc91815df10 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc914ff9700 1 -- 172.21.15.177:0/4252426178 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9000038a0 con 0x7fc91815df10 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.936+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9180cdcc0 con 0x7fc91815df10 2023-11-27T17:49:14.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.937+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc918073aa0 con 0x7fc91815df10 2023-11-27T17:49:14.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.938+0000 7fc914ff9700 1 -- 172.21.15.177:0/4252426178 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc900003a00 con 0x7fc91815df10 2023-11-27T17:49:14.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.938+0000 7fc914ff9700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc8f806b250 0x7fc8f806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:14.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.938+0000 7fc914ff9700 1 -- 172.21.15.177:0/4252426178 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc900020070 con 0x7fc91815df10 2023-11-27T17:49:14.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.938+0000 7fc917fff700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc8f806b250 0x7fc8f806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:14.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.938+0000 7fc917fff700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc8f806b250 0x7fc8f806d710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9080099d0 tx=0x7fc908008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:14.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:14.942+0000 7fc914ff9700 1 -- 172.21.15.177:0/4252426178 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc900055c20 con 0x7fc91815df10 2023-11-27T17:49:15.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.175+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc918069400 con 0x7fc91815df10 2023-11-27T17:49:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.176+0000 7fc914ff9700 1 -- 172.21.15.177:0/4252426178 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fc900015090 con 0x7fc91815df10 2023-11-27T17:49:15.178 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:15.178 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/4007543868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":4007543868},{"type":"v1","addr":"172.21.15.178:6834","nonce":4007543868}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1923553033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1923553033},{"type":"v1","addr":"172.21.15.178:6835","nonce":1923553033}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1398217543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1398217543},{"type":"v1","addr":"172.21.15.177:6836","nonce":1398217543}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:49:11.168024+0000","modified":"2023-11-27T17:49:14.181916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.177:6837/1746694137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1746694137},{"type":"v1","addr":"172.21.15.177:6837","nonce":1746694137}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-27T17:49:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc8f806b250 msgr2=0x7fc8f806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc8f806b250 0x7fc8f806d710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9080099d0 tx=0x7fc908008040 comp rx=0 tx=0).stop 2023-11-27T17:49:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815df10 msgr2=0x7fc9180cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815df10 0x7fc9180cccf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc900000c00 tx=0x7fc900004750 comp rx=0 tx=0).stop 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 shutdown_connections 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc8f806b250 0x7fc8f806d710 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91815e2f0 0x7fc9181f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9180b21c0 0x7fc9180cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 --2- 172.21.15.177:0/4252426178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91815df10 0x7fc9180cccf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 >> 172.21.15.177:0/4252426178 conn(0x7fc918072190 msgr2=0x7fc9180b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 shutdown_connections 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.178+0000 7fc91e8f9700 1 -- 172.21.15.177:0/4252426178 wait complete. 2023-11-27T17:49:15.181 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 16 2023-11-27T17:49:15.192 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:49:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.311+0000 7f386e621700 1 Processor -- start 2023-11-27T17:49:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.311+0000 7f386e621700 1 -- start start 2023-11-27T17:49:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.311+0000 7f386e621700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f38681413a0 0x7f386806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.311+0000 7f386e621700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868147370 0x7f386806d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.311+0000 7f386e621700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38680735a0 con 0x7f3868140fc0 2023-11-27T17:49:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.311+0000 7f386e621700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3868162cd0 con 0x7f38681413a0 2023-11-27T17:49:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.311+0000 7f386e621700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38680ae270 con 0x7f3868147370 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f38677fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f38681413a0 0x7f386806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f38677fe700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f38681413a0 0x7f386806cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53368/0 (socket says 172.21.15.177:53368) 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f38677fe700 1 -- 172.21.15.177:0/3350727062 learned_addr learned my addr 172.21.15.177:0/3350727062 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f386cbbe700 1 --2- 172.21.15.177:0/3350727062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868147370 0x7f386806d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f38677fe700 1 -- 172.21.15.177:0/3350727062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868147370 msgr2=0x7f386806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f38677fe700 1 --2- 172.21.15.177:0/3350727062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868147370 0x7f386806d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f38677fe700 1 -- 172.21.15.177:0/3350727062 >> v1:172.21.15.178:6789/0 conn(0x7f3868140fc0 legacy=0x7f38680ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f38677fe700 1 -- 172.21.15.177:0/3350727062 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680af0f0 con 0x7f38681413a0 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f38677fe700 1 --2- 172.21.15.177:0/3350727062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f386806cf00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f385c0098f0 tx=0x7f385c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4bbc60254b39a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f3866ffd700 1 -- 172.21.15.177:0/3350727062 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c004230 con 0x7f38681413a0 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f3866ffd700 1 -- 172.21.15.177:0/3350727062 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c004390 con 0x7f38681413a0 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.312+0000 7f3866ffd700 1 -- 172.21.15.177:0/3350727062 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0036a0 con 0x7f38681413a0 2023-11-27T17:49:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.313+0000 7f386e621700 1 -- 172.21.15.177:0/3350727062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 msgr2=0x7f386806cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.313+0000 7f386e621700 1 --2- 172.21.15.177:0/3350727062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f386806cf00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f385c0098f0 tx=0x7f385c009c00 comp rx=0 tx=0).stop 2023-11-27T17:49:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.313+0000 7f386e621700 1 -- 172.21.15.177:0/3350727062 shutdown_connections 2023-11-27T17:49:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.313+0000 7f386e621700 1 --2- 172.21.15.177:0/3350727062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868147370 0x7f386806d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.313+0000 7f386e621700 1 --2- 172.21.15.177:0/3350727062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f386806cf00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.313+0000 7f386e621700 1 -- 172.21.15.177:0/3350727062 >> 172.21.15.177:0/3350727062 conn(0x7f38680d0e70 msgr2=0x7f38680b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.313+0000 7f386e621700 1 -- 172.21.15.177:0/3350727062 shutdown_connections 2023-11-27T17:49:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.313+0000 7f386e621700 1 -- 172.21.15.177:0/3350727062 wait complete. 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.314+0000 7f386e621700 1 Processor -- start 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.314+0000 7f386e621700 1 -- start start 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386e621700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868140fc0 0x7f3868161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386e621700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f3868146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386e621700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3868147370 0x7f386813ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386e621700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3868129720 con 0x7f38681413a0 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386e621700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680b14f0 con 0x7f3868147370 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386e621700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38681470b0 con 0x7f3868140fc0 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f3868146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f3868146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53374/0 (socket says 172.21.15.177:53374) 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 -- 172.21.15.177:0/2583129087 learned_addr learned my addr 172.21.15.177:0/2583129087 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f3867fff700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868140fc0 0x7f3868161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386cbbe700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3868147370 0x7f386813ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 -- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868140fc0 msgr2=0x7f3868161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868140fc0 0x7f3868161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 -- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3868147370 msgr2=0x7f386813ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3868147370 0x7f386813ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 -- 172.21.15.177:0/2583129087 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c009550 con 0x7f38681413a0 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386cbbe700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3868147370 0x7f386813ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f38677fe700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f3868146b70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f385c009130 tx=0x7f385c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f3864ff9700 1 -- 172.21.15.177:0/2583129087 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c003b50 con 0x7f38681413a0 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f3864ff9700 1 -- 172.21.15.177:0/2583129087 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c01f070 con 0x7f38681413a0 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38681312a0 con 0x7f38681413a0 2023-11-27T17:49:15.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f3864ff9700 1 -- 172.21.15.177:0/2583129087 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00b660 con 0x7f38681413a0 2023-11-27T17:49:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.315+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3868131860 con 0x7f38681413a0 2023-11-27T17:49:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.316+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3868073aa0 con 0x7f38681413a0 2023-11-27T17:49:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.317+0000 7f3864ff9700 1 -- 172.21.15.177:0/2583129087 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f385c021030 con 0x7f38681413a0 2023-11-27T17:49:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.317+0000 7f3864ff9700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f385406b250 0x7f385406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.317+0000 7f3864ff9700 1 -- 172.21.15.177:0/2583129087 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f385c08af00 con 0x7f38681413a0 2023-11-27T17:49:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.317+0000 7f3867fff700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f385406b250 0x7f385406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.318+0000 7f3867fff700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f385406b250 0x7f385406d710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3858007fd0 tx=0x7f3858009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:15.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.322+0000 7f3864ff9700 1 -- 172.21.15.177:0/2583129087 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f385c055cc0 con 0x7f38681413a0 2023-11-27T17:49:15.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.514+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3868073aa0 con 0x7f38681413a0 2023-11-27T17:49:15.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.515+0000 7f3864ff9700 1 -- 172.21.15.177:0/2583129087 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f385c0592e0 con 0x7f38681413a0 2023-11-27T17:49:15.518 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:15.518 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":33,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","created":"2023-11-27T17:47:59.007076+0000","modified":"2023-11-27T17:49:12.779133+0000","last_up_change":"2023-11-27T17:48:08.927368+0000","last_in_change":"2023-11-27T17:48:01.491141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:48:10.663802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:49:09.109220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T17:49:10.137874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14b9bc6e-b475-43f4-a62e-78fb5acdecd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6801","nonce":3442982886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6803","nonce":3442982886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6807","nonce":3442982886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3442982886},{"type":"v1","addr":"172.21.15.177:6805","nonce":3442982886}]},"public_addr":"172.21.15.177:6801/3442982886","cluster_addr":"172.21.15.177:6803/3442982886","heartbeat_back_addr":"172.21.15.177:6807/3442982886","heartbeat_front_addr":"172.21.15.177:6805/3442982886","state":["exists","up"]},{"osd":1,"uuid":"fb5c0e3d-3b98-4149-8cef-a72e5cf5f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6817","nonce":2217323012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6819","nonce":2217323012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6823","nonce":2217323012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2217323012},{"type":"v1","addr":"172.21.15.177:6821","nonce":2217323012}]},"public_addr":"172.21.15.177:6817/2217323012","cluster_addr":"172.21.15.177:6819/2217323012","heartbeat_back_addr":"172.21.15.177:6823/2217323012","heartbeat_front_addr":"172.21.15.177:6821/2217323012","state":["exists","up"]},{"osd":2,"uuid":"422bf301-9e8e-4c96-aa75-883717f49bfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6809","nonce":2628156561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6811","nonce":2628156561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6815","nonce":2628156561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2628156561},{"type":"v1","addr":"172.21.15.177:6813","nonce":2628156561}]},"public_addr":"172.21.15.177:6809/2628156561","cluster_addr":"172.21.15.177:6811/2628156561","heartbeat_back_addr":"172.21.15.177:6815/2628156561","heartbeat_front_addr":"172.21.15.177:6813/2628156561","state":["exists","up"]},{"osd":3,"uuid":"c423d761-307d-4c04-b4b9-8e680d19227f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6825","nonce":1967175209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6827","nonce":1967175209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6831","nonce":1967175209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1967175209},{"type":"v1","addr":"172.21.15.177:6829","nonce":1967175209}]},"public_addr":"172.21.15.177:6825/1967175209","cluster_addr":"172.21.15.177:6827/1967175209","heartbeat_back_addr":"172.21.15.177:6831/1967175209","heartbeat_front_addr":"172.21.15.177:6829/1967175209","state":["exists","up"]},{"osd":4,"uuid":"602c6293-7ef2-4d15-a841-ba93e6a8e196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6817","nonce":836610101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6819","nonce":836610101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6823","nonce":836610101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":836610101},{"type":"v1","addr":"172.21.15.178:6821","nonce":836610101}]},"public_addr":"172.21.15.178:6817/836610101","cluster_addr":"172.21.15.178:6819/836610101","heartbeat_back_addr":"172.21.15.178:6823/836610101","heartbeat_front_addr":"172.21.15.178:6821/836610101","state":["exists","up"]},{"osd":5,"uuid":"cfc016da-08c8-4209-ab4f-396e1a384fa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6809","nonce":990180260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6811","nonce":990180260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6815","nonce":990180260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":990180260},{"type":"v1","addr":"172.21.15.178:6813","nonce":990180260}]},"public_addr":"172.21.15.178:6809/990180260","cluster_addr":"172.21.15.178:6811/990180260","heartbeat_back_addr":"172.21.15.178:6815/990180260","heartbeat_front_addr":"172.21.15.178:6813/990180260","state":["exists","up"]},{"osd":6,"uuid":"5f7bd22b-4c20-4682-a058-da8785268f9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6801","nonce":1957875668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6803","nonce":1957875668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6807","nonce":1957875668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1957875668},{"type":"v1","addr":"172.21.15.178:6805","nonce":1957875668}]},"public_addr":"172.21.15.178:6801/1957875668","cluster_addr":"172.21.15.178:6803/1957875668","heartbeat_back_addr":"172.21.15.178:6807/1957875668","heartbeat_front_addr":"172.21.15.178:6805/1957875668","state":["exists","up"]},{"osd":7,"uuid":"072497cd-3a04-487a-830a-37477a7fdc6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6825","nonce":3510383557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6827","nonce":3510383557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6831","nonce":3510383557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3510383557},{"type":"v1","addr":"172.21.15.178:6829","nonce":3510383557}]},"public_addr":"172.21.15.178:6825/3510383557","cluster_addr":"172.21.15.178:6827/3510383557","heartbeat_back_addr":"172.21.15.178:6831/3510383557","heartbeat_front_addr":"172.21.15.178:6829/3510383557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.462115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.744498+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.668611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.689548+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.696283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.656188+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692305+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:48:06.692466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:49:15.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f385406b250 msgr2=0x7f385406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f385406b250 0x7f385406d710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3858007fd0 tx=0x7f3858009040 comp rx=0 tx=0).stop 2023-11-27T17:49:15.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 msgr2=0x7f3868146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f3868146b70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f385c009130 tx=0x7f385c004750 comp rx=0 tx=0).stop 2023-11-27T17:49:15.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 shutdown_connections 2023-11-27T17:49:15.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f385406b250 0x7f385406d710 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3868147370 0x7f386813ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3868140fc0 0x7f3868161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 --2- 172.21.15.177:0/2583129087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38681413a0 0x7f3868146b70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 >> 172.21.15.177:0/2583129087 conn(0x7f38680d0e70 msgr2=0x7f38680b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:15.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 shutdown_connections 2023-11-27T17:49:15.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.517+0000 7f386e621700 1 -- 172.21.15.177:0/2583129087 wait complete. 2023-11-27T17:49:15.533 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T17:49:15.533 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:49:15.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.651+0000 7fe37c6bb700 1 Processor -- start 2023-11-27T17:49:15.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.651+0000 7fe37c6bb700 1 -- start start 2023-11-27T17:49:15.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe37c6bb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe37415ad60 0x7fe3740b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe37c6bb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe37415b140 0x7fe3740b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe37c6bb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3740b6020 con 0x7fe37415f680 2023-11-27T17:49:15.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe37c6bb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe374071b10 con 0x7fe37415b140 2023-11-27T17:49:15.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe37c6bb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3740b5d40 con 0x7fe37415ad60 2023-11-27T17:49:15.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379c56700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe37415b140 0x7fe3740b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe37ac58700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe37415f680 0x7fe3740cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47702/0 (socket says 172.21.15.177:47702) 2023-11-27T17:49:15.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe37ac58700 1 -- 172.21.15.177:0/3109559415 learned_addr learned my addr 172.21.15.177:0/3109559415 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:15.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe37a457700 1 --2- 172.21.15.177:0/3109559415 >> v2:172.21.15.178:3300/0 conn(0x7fe37415ad60 0x7fe3740b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379c56700 1 -- 172.21.15.177:0/3109559415 >> v2:172.21.15.178:3300/0 conn(0x7fe37415ad60 msgr2=0x7fe3740b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:15.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379c56700 1 --2- 172.21.15.177:0/3109559415 >> v2:172.21.15.178:3300/0 conn(0x7fe37415ad60 0x7fe3740b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379c56700 1 -- 172.21.15.177:0/3109559415 >> v1:172.21.15.177:6789/0 conn(0x7fe37415f680 legacy=0x7fe3740cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379c56700 1 -- 172.21.15.177:0/3109559415 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37415eba0 con 0x7fe37415b140 2023-11-27T17:49:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379c56700 1 --2- 172.21.15.177:0/3109559415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe3740b5710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe3740b2a40 tx=0x7fe370009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5656e2cb6b65bcd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379455700 1 -- 172.21.15.177:0/3109559415 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370011830 con 0x7fe37415b140 2023-11-27T17:49:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379455700 1 -- 172.21.15.177:0/3109559415 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe370011990 con 0x7fe37415b140 2023-11-27T17:49:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.652+0000 7fe379455700 1 -- 172.21.15.177:0/3109559415 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370011d20 con 0x7fe37415b140 2023-11-27T17:49:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.653+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3109559415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 msgr2=0x7fe3740b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.653+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3109559415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe3740b5710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe3740b2a40 tx=0x7fe370009b20 comp rx=0 tx=0).stop 2023-11-27T17:49:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.653+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3109559415 shutdown_connections 2023-11-27T17:49:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.653+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3109559415 >> v2:172.21.15.178:3300/0 conn(0x7fe37415ad60 0x7fe3740b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.653+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3109559415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe3740b5710 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.653+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3109559415 >> 172.21.15.177:0/3109559415 conn(0x7fe374067000 msgr2=0x7fe3740b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.653+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3109559415 shutdown_connections 2023-11-27T17:49:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.653+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3109559415 wait complete. 2023-11-27T17:49:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.654+0000 7fe37c6bb700 1 Processor -- start 2023-11-27T17:49:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.654+0000 7fe37c6bb700 1 -- start start 2023-11-27T17:49:15.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37c6bb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe37415ad60 0x7fe37406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37c6bb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe37415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37c6bb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37415f680 0x7fe37414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37c6bb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37415c6f0 con 0x7fe37415b140 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37c6bb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe374144e60 con 0x7fe37415f680 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37c6bb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37406faf0 con 0x7fe37415ad60 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe379c56700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe37415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe379c56700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe37415dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53388/0 (socket says 172.21.15.177:53388) 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe379c56700 1 -- 172.21.15.177:0/3362935528 learned_addr learned my addr 172.21.15.177:0/3362935528 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37a457700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe37415ad60 0x7fe37406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37ac58700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37415f680 0x7fe37414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe379c56700 1 -- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe37415ad60 msgr2=0x7fe37406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe379c56700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe37415ad60 0x7fe37406f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe379c56700 1 -- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37415f680 msgr2=0x7fe37414cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe379c56700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37415f680 0x7fe37414cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe379c56700 1 -- 172.21.15.177:0/3362935528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700094a0 con 0x7fe37415b140 2023-11-27T17:49:15.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37ac58700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37415f680 0x7fe37414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:15.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.655+0000 7fe37a457700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe37415ad60 0x7fe37406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:15.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.656+0000 7fe379c56700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe37415dc70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe370009b60 tx=0x7fe370004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:15.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.656+0000 7fe36affd700 1 -- 172.21.15.177:0/3362935528 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3700036a0 con 0x7fe37415b140 2023-11-27T17:49:15.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.656+0000 7fe36affd700 1 -- 172.21.15.177:0/3362935528 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37001f070 con 0x7fe37415b140 2023-11-27T17:49:15.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.656+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37415ba70 con 0x7fe37415b140 2023-11-27T17:49:15.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.656+0000 7fe36affd700 1 -- 172.21.15.177:0/3362935528 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370003a60 con 0x7fe37415b140 2023-11-27T17:49:15.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.656+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37415c030 con 0x7fe37415b140 2023-11-27T17:49:15.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.657+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe374073aa0 con 0x7fe37415b140 2023-11-27T17:49:15.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.657+0000 7fe36affd700 1 -- 172.21.15.177:0/3362935528 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe370003bc0 con 0x7fe37415b140 2023-11-27T17:49:15.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.657+0000 7fe36affd700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe35806b250 0x7fe35806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:15.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.657+0000 7fe36affd700 1 -- 172.21.15.177:0/3362935528 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe370021070 con 0x7fe37415b140 2023-11-27T17:49:15.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.657+0000 7fe37a457700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe35806b250 0x7fe35806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:15.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.658+0000 7fe37a457700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe35806b250 0x7fe35806d710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3640099f0 tx=0x7fe364008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:15.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.662+0000 7fe36affd700 1 -- 172.21.15.177:0/3362935528 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe370056120 con 0x7fe37415b140 2023-11-27T17:49:15.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.848+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe374146200 con 0x7fe35806b250 2023-11-27T17:49:15.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.856+0000 7fe36affd700 1 -- 172.21.15.177:0/3362935528 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264541 (secure 0 0 0) 0x7fe374146200 con 0x7fe35806b250 2023-11-27T17:49:15.861 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:15.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe35806b250 msgr2=0x7fe35806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe35806b250 0x7fe35806d710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3640099f0 tx=0x7fe364008040 comp rx=0 tx=0).stop 2023-11-27T17:49:15.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 msgr2=0x7fe37415dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:15.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe37415dc70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe370009b60 tx=0x7fe370004750 comp rx=0 tx=0).stop 2023-11-27T17:49:15.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 shutdown_connections 2023-11-27T17:49:15.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fe35806b250 0x7fe35806d710 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37415f680 0x7fe37414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe37415ad60 0x7fe37406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 --2- 172.21.15.177:0/3362935528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37415b140 0x7fe37415dc70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:15.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 >> 172.21.15.177:0/3362935528 conn(0x7fe374067000 msgr2=0x7fe374151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:15.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 shutdown_connections 2023-11-27T17:49:15.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:15.859+0000 7fe37c6bb700 1 -- 172.21.15.177:0/3362935528 wait complete. 2023-11-27T17:49:15.864 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:49:15.874 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-27T17:49:14.631853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219900,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754820,"statfs":{"total":773094113280,"available":772868935680,"internally_reserved":0,"allocated":3776512,"data_stored":2132168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.870173"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763601+0000","last_change":"2023-11-27T17:49:09.763601+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763601+0000","last_undegraded":"2023-11-27T17:49:09.763601+0000","last_fullsized":"2023-11-27T17:49:09.763601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767547+0000","last_change":"2023-11-27T17:49:09.767547+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767547+0000","last_undegraded":"2023-11-27T17:49:09.767547+0000","last_fullsized":"2023-11-27T17:49:09.767547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768339+0000","last_change":"2023-11-27T17:49:09.768339+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768339+0000","last_undegraded":"2023-11-27T17:49:09.768339+0000","last_fullsized":"2023-11-27T17:49:09.768339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765143+0000","last_change":"2023-11-27T17:49:09.765143+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765143+0000","last_undegraded":"2023-11-27T17:49:09.765143+0000","last_fullsized":"2023-11-27T17:49:09.765143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763172+0000","last_change":"2023-11-27T17:49:09.763172+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763172+0000","last_undegraded":"2023-11-27T17:49:09.763172+0000","last_fullsized":"2023-11-27T17:49:09.763172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761610+0000","last_change":"2023-11-27T17:49:09.761610+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761610+0000","last_undegraded":"2023-11-27T17:49:09.761610+0000","last_fullsized":"2023-11-27T17:49:09.761610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768590+0000","last_change":"2023-11-27T17:49:09.768590+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768590+0000","last_undegraded":"2023-11-27T17:49:09.768590+0000","last_fullsized":"2023-11-27T17:49:09.768590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761390+0000","last_change":"2023-11-27T17:49:09.761390+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761390+0000","last_undegraded":"2023-11-27T17:49:09.761390+0000","last_fullsized":"2023-11-27T17:49:09.761390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768846+0000","last_change":"2023-11-27T17:49:09.768846+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768846+0000","last_undegraded":"2023-11-27T17:49:09.768846+0000","last_fullsized":"2023-11-27T17:49:09.768846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767095+0000","last_change":"2023-11-27T17:49:09.767095+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767095+0000","last_undegraded":"2023-11-27T17:49:09.767095+0000","last_fullsized":"2023-11-27T17:49:09.767095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.764648+0000","last_change":"2023-11-27T17:49:09.764648+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.764648+0000","last_undegraded":"2023-11-27T17:49:09.764648+0000","last_fullsized":"2023-11-27T17:49:09.764648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768487+0000","last_change":"2023-11-27T17:49:09.768487+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768487+0000","last_undegraded":"2023-11-27T17:49:09.768487+0000","last_fullsized":"2023-11-27T17:49:09.768487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.762650+0000","last_change":"2023-11-27T17:49:09.762650+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.762650+0000","last_undegraded":"2023-11-27T17:49:09.762650+0000","last_fullsized":"2023-11-27T17:49:09.762650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.766894+0000","last_change":"2023-11-27T17:49:09.766894+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.766894+0000","last_undegraded":"2023-11-27T17:49:09.766894+0000","last_fullsized":"2023-11-27T17:49:09.766894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767346+0000","last_change":"2023-11-27T17:49:09.767346+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767346+0000","last_undegraded":"2023-11-27T17:49:09.767346+0000","last_fullsized":"2023-11-27T17:49:09.767346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.762188+0000","last_change":"2023-11-27T17:49:09.762188+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.762188+0000","last_undegraded":"2023-11-27T17:49:09.762188+0000","last_fullsized":"2023-11-27T17:49:09.762188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761579+0000","last_change":"2023-11-27T17:49:09.761579+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761579+0000","last_undegraded":"2023-11-27T17:49:09.761579+0000","last_fullsized":"2023-11-27T17:49:09.761579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761579+0000","last_change":"2023-11-27T17:49:09.761579+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761579+0000","last_undegraded":"2023-11-27T17:49:09.761579+0000","last_fullsized":"2023-11-27T17:49:09.761579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765626+0000","last_change":"2023-11-27T17:49:09.765626+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765626+0000","last_undegraded":"2023-11-27T17:49:09.765626+0000","last_fullsized":"2023-11-27T17:49:09.765626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763933+0000","last_change":"2023-11-27T17:49:09.763933+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763933+0000","last_undegraded":"2023-11-27T17:49:09.763933+0000","last_fullsized":"2023-11-27T17:49:09.763933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761997+0000","last_change":"2023-11-27T17:49:09.761997+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761997+0000","last_undegraded":"2023-11-27T17:49:09.761997+0000","last_fullsized":"2023-11-27T17:49:09.761997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.764627+0000","last_change":"2023-11-27T17:49:09.764627+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.764627+0000","last_undegraded":"2023-11-27T17:49:09.764627+0000","last_fullsized":"2023-11-27T17:49:09.764627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765974+0000","last_change":"2023-11-27T17:49:09.765974+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765974+0000","last_undegraded":"2023-11-27T17:49:09.765974+0000","last_fullsized":"2023-11-27T17:49:09.765974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765143+0000","last_change":"2023-11-27T17:49:09.765143+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765143+0000","last_undegraded":"2023-11-27T17:49:09.765143+0000","last_fullsized":"2023-11-27T17:49:09.765143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761420+0000","last_change":"2023-11-27T17:49:09.761420+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761420+0000","last_undegraded":"2023-11-27T17:49:09.761420+0000","last_fullsized":"2023-11-27T17:49:09.761420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.766172+0000","last_change":"2023-11-27T17:49:09.766172+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.766172+0000","last_undegraded":"2023-11-27T17:49:09.766172+0000","last_fullsized":"2023-11-27T17:49:09.766172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763571+0000","last_change":"2023-11-27T17:49:09.763571+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763571+0000","last_undegraded":"2023-11-27T17:49:09.763571+0000","last_fullsized":"2023-11-27T17:49:09.763571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:49:04.779667+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:49:04.779667+0000","last_peered":"2023-11-27T17:49:04.779667+0000","last_clean":"2023-11-27T17:49:04.779667+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:49:04.779667+0000","last_undegraded":"2023-11-27T17:49:04.779667+0000","last_fullsized":"2023-11-27T17:49:04.779667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":917504,"data_stored":709297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.63200000000000001}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.378},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.5}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.504},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.317},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.57399999999999995}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.626}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.55000000000000004}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.42199999999999999}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.747}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:49:15.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:49:16.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.031+0000 7feb837d6700 1 Processor -- start 2023-11-27T17:49:16.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.032+0000 7feb837d6700 1 -- start start 2023-11-27T17:49:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.032+0000 7feb837d6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b6170 0x7feb7c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.032+0000 7feb837d6700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feb7c0b65d0 0x7feb7c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.032+0000 7feb837d6700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c0b5ce0 con 0x7feb7c147880 2023-11-27T17:49:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.032+0000 7feb837d6700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7c06e020 con 0x7feb7c0b65d0 2023-11-27T17:49:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.032+0000 7feb837d6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0b5700 con 0x7feb7c0b6170 2023-11-27T17:49:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81d73700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feb7c0b65d0 0x7feb7c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81d73700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feb7c0b65d0 0x7feb7c070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53398/0 (socket says 172.21.15.177:53398) 2023-11-27T17:49:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81572700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7feb7c147880 0x7feb7c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47712/0 (socket says 172.21.15.177:47712) 2023-11-27T17:49:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81d73700 1 -- 172.21.15.177:0/3087298723 learned_addr learned my addr 172.21.15.177:0/3087298723 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb80d71700 1 --2- 172.21.15.177:0/3087298723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b6170 0x7feb7c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81d73700 1 -- 172.21.15.177:0/3087298723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b6170 msgr2=0x7feb7c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81d73700 1 --2- 172.21.15.177:0/3087298723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b6170 0x7feb7c0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81d73700 1 -- 172.21.15.177:0/3087298723 >> v1:172.21.15.177:6789/0 conn(0x7feb7c147880 legacy=0x7feb7c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81d73700 1 -- 172.21.15.177:0/3087298723 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c06e230 con 0x7feb7c0b65d0 2023-11-27T17:49:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb73fff700 1 -- 172.21.15.177:0/3087298723 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840696223 0 0) 0x7feb7c0b5ce0 con 0x7feb7c147880 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb81d73700 1 --2- 172.21.15.177:0/3087298723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c070a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb74009e50 tx=0x7feb7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fbcc294244a0c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb73fff700 1 -- 172.21.15.177:0/3087298723 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7400e070 con 0x7feb7c0b65d0 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb73fff700 1 -- 172.21.15.177:0/3087298723 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7400b910 con 0x7feb7c0b65d0 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.033+0000 7feb73fff700 1 -- 172.21.15.177:0/3087298723 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7400bcc0 con 0x7feb7c0b65d0 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.034+0000 7feb837d6700 1 -- 172.21.15.177:0/3087298723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 msgr2=0x7feb7c070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.034+0000 7feb837d6700 1 --2- 172.21.15.177:0/3087298723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c070a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb74009e50 tx=0x7feb7400b330 comp rx=0 tx=0).stop 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.034+0000 7feb837d6700 1 -- 172.21.15.177:0/3087298723 shutdown_connections 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.034+0000 7feb837d6700 1 --2- 172.21.15.177:0/3087298723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c070a30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.034+0000 7feb837d6700 1 --2- 172.21.15.177:0/3087298723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b6170 0x7feb7c0704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.034+0000 7feb837d6700 1 -- 172.21.15.177:0/3087298723 >> 172.21.15.177:0/3087298723 conn(0x7feb7c0b2130 msgr2=0x7feb7c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.034+0000 7feb837d6700 1 -- 172.21.15.177:0/3087298723 shutdown_connections 2023-11-27T17:49:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.034+0000 7feb837d6700 1 -- 172.21.15.177:0/3087298723 wait complete. 2023-11-27T17:49:16.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.035+0000 7feb837d6700 1 Processor -- start 2023-11-27T17:49:16.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.035+0000 7feb837d6700 1 -- start start 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb837d6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0b6170 0x7feb7c1f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb837d6700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c0cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb837d6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c147880 0x7feb7c0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb837d6700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0cfc80 con 0x7feb7c0b65d0 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb837d6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1f3f30 con 0x7feb7c0b6170 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb837d6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1f4210 con 0x7feb7c147880 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c0cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c0cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53402/0 (socket says 172.21.15.177:53402) 2023-11-27T17:49:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 -- 172.21.15.177:0/81418993 learned_addr learned my addr 172.21.15.177:0/81418993 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb81d73700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c147880 0x7feb7c0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb81572700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0b6170 0x7feb7c1f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 -- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c147880 msgr2=0x7feb7c0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c147880 0x7feb7c0b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 -- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0b6170 msgr2=0x7feb7c1f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0b6170 0x7feb7c1f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 -- 172.21.15.177:0/81418993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74009b30 con 0x7feb7c0b65d0 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb81572700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0b6170 0x7feb7c1f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb80d71700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c0cf740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feb7800e850 tx=0x7feb7800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb71ffb700 1 -- 172.21.15.177:0/81418993 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780095b0 con 0x7feb7c0b65d0 2023-11-27T17:49:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb71ffb700 1 -- 172.21.15.177:0/81418993 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7800ee50 con 0x7feb7c0b65d0 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c1f44f0 con 0x7feb7c0b65d0 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.036+0000 7feb71ffb700 1 -- 172.21.15.177:0/81418993 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800ca70 con 0x7feb7c0b65d0 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.037+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c0c5ee0 con 0x7feb7c0b65d0 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.038+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c073aa0 con 0x7feb7c0b65d0 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.038+0000 7feb71ffb700 1 -- 172.21.15.177:0/81418993 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7feb7800cbd0 con 0x7feb7c0b65d0 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.039+0000 7feb71ffb700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7feb6006b250 0x7feb6006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.039+0000 7feb81572700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7feb6006b250 0x7feb6006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.039+0000 7feb71ffb700 1 -- 172.21.15.177:0/81418993 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb78089a10 con 0x7feb7c0b65d0 2023-11-27T17:49:16.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.039+0000 7feb81572700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7feb6006b250 0x7feb6006d710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb6c000f60 tx=0x7feb6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.043+0000 7feb71ffb700 1 -- 172.21.15.177:0/81418993 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7feb78054740 con 0x7feb7c0b65d0 2023-11-27T17:49:16.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.229+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb7c06e510 con 0x7feb6006b250 2023-11-27T17:49:16.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.236+0000 7feb71ffb700 1 -- 172.21.15.177:0/81418993 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264541 (secure 0 0 0) 0x7feb6c001ca0 con 0x7feb6006b250 2023-11-27T17:49:16.241 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:16.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7feb6006b250 msgr2=0x7feb6006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7feb6006b250 0x7feb6006d710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb6c000f60 tx=0x7feb6c009040 comp rx=0 tx=0).stop 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 msgr2=0x7feb7c0cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c0cf740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feb7800e850 tx=0x7feb7800ec10 comp rx=0 tx=0).stop 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 shutdown_connections 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7feb6006b250 0x7feb6006d710 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c147880 0x7feb7c0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0b6170 0x7feb7c1f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 --2- 172.21.15.177:0/81418993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb7c0b65d0 0x7feb7c0cf740 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 >> 172.21.15.177:0/81418993 conn(0x7feb7c0b2130 msgr2=0x7feb7c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 shutdown_connections 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.239+0000 7feb837d6700 1 -- 172.21.15.177:0/81418993 wait complete. 2023-11-27T17:49:16.244 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:49:16.254 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-27T17:49:14.631853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219900,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754820,"statfs":{"total":773094113280,"available":772868935680,"internally_reserved":0,"allocated":3776512,"data_stored":2132168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.870173"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763601+0000","last_change":"2023-11-27T17:49:09.763601+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763601+0000","last_undegraded":"2023-11-27T17:49:09.763601+0000","last_fullsized":"2023-11-27T17:49:09.763601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767547+0000","last_change":"2023-11-27T17:49:09.767547+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767547+0000","last_undegraded":"2023-11-27T17:49:09.767547+0000","last_fullsized":"2023-11-27T17:49:09.767547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768339+0000","last_change":"2023-11-27T17:49:09.768339+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768339+0000","last_undegraded":"2023-11-27T17:49:09.768339+0000","last_fullsized":"2023-11-27T17:49:09.768339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765143+0000","last_change":"2023-11-27T17:49:09.765143+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765143+0000","last_undegraded":"2023-11-27T17:49:09.765143+0000","last_fullsized":"2023-11-27T17:49:09.765143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763172+0000","last_change":"2023-11-27T17:49:09.763172+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763172+0000","last_undegraded":"2023-11-27T17:49:09.763172+0000","last_fullsized":"2023-11-27T17:49:09.763172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761610+0000","last_change":"2023-11-27T17:49:09.761610+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761610+0000","last_undegraded":"2023-11-27T17:49:09.761610+0000","last_fullsized":"2023-11-27T17:49:09.761610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768590+0000","last_change":"2023-11-27T17:49:09.768590+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768590+0000","last_undegraded":"2023-11-27T17:49:09.768590+0000","last_fullsized":"2023-11-27T17:49:09.768590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761390+0000","last_change":"2023-11-27T17:49:09.761390+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761390+0000","last_undegraded":"2023-11-27T17:49:09.761390+0000","last_fullsized":"2023-11-27T17:49:09.761390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768846+0000","last_change":"2023-11-27T17:49:09.768846+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768846+0000","last_undegraded":"2023-11-27T17:49:09.768846+0000","last_fullsized":"2023-11-27T17:49:09.768846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767095+0000","last_change":"2023-11-27T17:49:09.767095+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767095+0000","last_undegraded":"2023-11-27T17:49:09.767095+0000","last_fullsized":"2023-11-27T17:49:09.767095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.764648+0000","last_change":"2023-11-27T17:49:09.764648+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.764648+0000","last_undegraded":"2023-11-27T17:49:09.764648+0000","last_fullsized":"2023-11-27T17:49:09.764648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768487+0000","last_change":"2023-11-27T17:49:09.768487+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768487+0000","last_undegraded":"2023-11-27T17:49:09.768487+0000","last_fullsized":"2023-11-27T17:49:09.768487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.762650+0000","last_change":"2023-11-27T17:49:09.762650+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.762650+0000","last_undegraded":"2023-11-27T17:49:09.762650+0000","last_fullsized":"2023-11-27T17:49:09.762650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.766894+0000","last_change":"2023-11-27T17:49:09.766894+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.766894+0000","last_undegraded":"2023-11-27T17:49:09.766894+0000","last_fullsized":"2023-11-27T17:49:09.766894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767346+0000","last_change":"2023-11-27T17:49:09.767346+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767346+0000","last_undegraded":"2023-11-27T17:49:09.767346+0000","last_fullsized":"2023-11-27T17:49:09.767346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.762188+0000","last_change":"2023-11-27T17:49:09.762188+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.762188+0000","last_undegraded":"2023-11-27T17:49:09.762188+0000","last_fullsized":"2023-11-27T17:49:09.762188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761579+0000","last_change":"2023-11-27T17:49:09.761579+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761579+0000","last_undegraded":"2023-11-27T17:49:09.761579+0000","last_fullsized":"2023-11-27T17:49:09.761579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761579+0000","last_change":"2023-11-27T17:49:09.761579+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761579+0000","last_undegraded":"2023-11-27T17:49:09.761579+0000","last_fullsized":"2023-11-27T17:49:09.761579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765626+0000","last_change":"2023-11-27T17:49:09.765626+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765626+0000","last_undegraded":"2023-11-27T17:49:09.765626+0000","last_fullsized":"2023-11-27T17:49:09.765626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763933+0000","last_change":"2023-11-27T17:49:09.763933+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763933+0000","last_undegraded":"2023-11-27T17:49:09.763933+0000","last_fullsized":"2023-11-27T17:49:09.763933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761997+0000","last_change":"2023-11-27T17:49:09.761997+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761997+0000","last_undegraded":"2023-11-27T17:49:09.761997+0000","last_fullsized":"2023-11-27T17:49:09.761997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.764627+0000","last_change":"2023-11-27T17:49:09.764627+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.764627+0000","last_undegraded":"2023-11-27T17:49:09.764627+0000","last_fullsized":"2023-11-27T17:49:09.764627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765974+0000","last_change":"2023-11-27T17:49:09.765974+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765974+0000","last_undegraded":"2023-11-27T17:49:09.765974+0000","last_fullsized":"2023-11-27T17:49:09.765974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765143+0000","last_change":"2023-11-27T17:49:09.765143+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765143+0000","last_undegraded":"2023-11-27T17:49:09.765143+0000","last_fullsized":"2023-11-27T17:49:09.765143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761420+0000","last_change":"2023-11-27T17:49:09.761420+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761420+0000","last_undegraded":"2023-11-27T17:49:09.761420+0000","last_fullsized":"2023-11-27T17:49:09.761420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.766172+0000","last_change":"2023-11-27T17:49:09.766172+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.766172+0000","last_undegraded":"2023-11-27T17:49:09.766172+0000","last_fullsized":"2023-11-27T17:49:09.766172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763571+0000","last_change":"2023-11-27T17:49:09.763571+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763571+0000","last_undegraded":"2023-11-27T17:49:09.763571+0000","last_fullsized":"2023-11-27T17:49:09.763571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:49:04.779667+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:49:04.779667+0000","last_peered":"2023-11-27T17:49:04.779667+0000","last_clean":"2023-11-27T17:49:04.779667+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:49:04.779667+0000","last_undegraded":"2023-11-27T17:49:04.779667+0000","last_fullsized":"2023-11-27T17:49:04.779667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":917504,"data_stored":709297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.63200000000000001}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.378},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.5}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.504},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.317},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.57399999999999995}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.626}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.55000000000000004}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.42199999999999999}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.747}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:49:16.258 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:49:16.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.412+0000 7fc924030700 1 Processor -- start 2023-11-27T17:49:16.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.412+0000 7fc924030700 1 -- start start 2023-11-27T17:49:16.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc924030700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc91c141130 0x7fc91c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc924030700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc91c06e0b0 0x7fc91c15e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc924030700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c142800 con 0x7fc91c15ed40 2023-11-27T17:49:16.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc924030700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c162670 con 0x7fc91c06e0b0 2023-11-27T17:49:16.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc924030700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c06e540 con 0x7fc91c141130 2023-11-27T17:49:16.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc9215cb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc91c06e0b0 0x7fc91c15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc9215cb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc91c06e0b0 0x7fc91c15e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53408/0 (socket says 172.21.15.177:53408) 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc9215cb700 1 -- 172.21.15.177:0/2717315936 learned_addr learned my addr 172.21.15.177:0/2717315936 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc921dcc700 1 --2- 172.21.15.177:0/2717315936 >> v2:172.21.15.178:3300/0 conn(0x7fc91c141130 0x7fc91c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc9215cb700 1 -- 172.21.15.177:0/2717315936 >> v2:172.21.15.178:3300/0 conn(0x7fc91c141130 msgr2=0x7fc91c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc9215cb700 1 --2- 172.21.15.177:0/2717315936 >> v2:172.21.15.178:3300/0 conn(0x7fc91c141130 0x7fc91c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc9215cb700 1 -- 172.21.15.177:0/2717315936 >> v1:172.21.15.178:6789/0 conn(0x7fc91c15ed40 legacy=0x7fc91c0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc9215cb700 1 -- 172.21.15.177:0/2717315936 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c144720 con 0x7fc91c06e0b0 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.413+0000 7fc9215cb700 1 --2- 172.21.15.177:0/2717315936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c06e0b0 0x7fc91c15e800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0b6320 tx=0x7fc90c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa710a751d09a0d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc920dca700 1 -- 172.21.15.177:0/2717315936 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c004230 con 0x7fc91c06e0b0 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc920dca700 1 -- 172.21.15.177:0/2717315936 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c004390 con 0x7fc91c06e0b0 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc920dca700 1 -- 172.21.15.177:0/2717315936 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0036a0 con 0x7fc91c06e0b0 2023-11-27T17:49:16.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc924030700 1 -- 172.21.15.177:0/2717315936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c06e0b0 msgr2=0x7fc91c15e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc924030700 1 --2- 172.21.15.177:0/2717315936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c06e0b0 0x7fc91c15e800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0b6320 tx=0x7fc90c009c00 comp rx=0 tx=0).stop 2023-11-27T17:49:16.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc924030700 1 -- 172.21.15.177:0/2717315936 shutdown_connections 2023-11-27T17:49:16.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc924030700 1 --2- 172.21.15.177:0/2717315936 >> v2:172.21.15.178:3300/0 conn(0x7fc91c141130 0x7fc91c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc924030700 1 --2- 172.21.15.177:0/2717315936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c06e0b0 0x7fc91c15e800 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc924030700 1 -- 172.21.15.177:0/2717315936 >> 172.21.15.177:0/2717315936 conn(0x7fc91c067000 msgr2=0x7fc91c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:16.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc924030700 1 -- 172.21.15.177:0/2717315936 shutdown_connections 2023-11-27T17:49:16.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.414+0000 7fc924030700 1 -- 172.21.15.177:0/2717315936 wait complete. 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.416+0000 7fc924030700 1 Processor -- start 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.416+0000 7fc924030700 1 -- start start 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc924030700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91c06e0b0 0x7fc91c158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc924030700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c141130 0x7fc91c13d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc924030700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc91c15ed40 0x7fc91c13dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc924030700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c1610c0 con 0x7fc91c141130 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc924030700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0aed50 con 0x7fc91c15ed40 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc924030700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c1601f0 con 0x7fc91c06e0b0 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c141130 0x7fc91c13d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c141130 0x7fc91c13d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53416/0 (socket says 172.21.15.177:53416) 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 -- 172.21.15.177:0/1703698338 learned_addr learned my addr 172.21.15.177:0/1703698338 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc921dcc700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91c06e0b0 0x7fc91c158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 -- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91c06e0b0 msgr2=0x7fc91c158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9225cd700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc91c15ed40 0x7fc91c13dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91c06e0b0 0x7fc91c158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 -- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc91c15ed40 msgr2=0x7fc91c13dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc91c15ed40 0x7fc91c13dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 -- 172.21.15.177:0/1703698338 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c009550 con 0x7fc91c141130 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc921dcc700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91c06e0b0 0x7fc91c158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9225cd700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc91c15ed40 0x7fc91c13dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9215cb700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c141130 0x7fc91c13d130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc90c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9127fc700 1 -- 172.21.15.177:0/1703698338 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c003d80 con 0x7fc91c141130 2023-11-27T17:49:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9127fc700 1 -- 172.21.15.177:0/1703698338 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c01f070 con 0x7fc91c141130 2023-11-27T17:49:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c160440 con 0x7fc91c141130 2023-11-27T17:49:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc9127fc700 1 -- 172.21.15.177:0/1703698338 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c011850 con 0x7fc91c141130 2023-11-27T17:49:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.417+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c160a00 con 0x7fc91c141130 2023-11-27T17:49:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.418+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c073aa0 con 0x7fc91c141130 2023-11-27T17:49:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.419+0000 7fc9127fc700 1 -- 172.21.15.177:0/1703698338 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc90c021030 con 0x7fc91c141130 2023-11-27T17:49:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.419+0000 7fc9127fc700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc90006b250 0x7fc90006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.419+0000 7fc9127fc700 1 -- 172.21.15.177:0/1703698338 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc90c08b170 con 0x7fc91c141130 2023-11-27T17:49:16.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.420+0000 7fc921dcc700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc90006b250 0x7fc90006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.420+0000 7fc921dcc700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc90006b250 0x7fc90006d710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc918009a00 tx=0x7fc918008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.424+0000 7fc9127fc700 1 -- 172.21.15.177:0/1703698338 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc90c055fb0 con 0x7fc91c141130 2023-11-27T17:49:16.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.612+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc91c070bb0 con 0x7fc90006b250 2023-11-27T17:49:16.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.619+0000 7fc9127fc700 1 -- 172.21.15.177:0/1703698338 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264541 (secure 0 0 0) 0x7fc91c070bb0 con 0x7fc90006b250 2023-11-27T17:49:16.625 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc90006b250 msgr2=0x7fc90006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc90006b250 0x7fc90006d710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc918009a00 tx=0x7fc918008040 comp rx=0 tx=0).stop 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c141130 msgr2=0x7fc91c13d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c141130 0x7fc91c13d130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc90c004750 comp rx=0 tx=0).stop 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 shutdown_connections 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fc90006b250 0x7fc90006d710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc91c15ed40 0x7fc91c13dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc91c06e0b0 0x7fc91c158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 --2- 172.21.15.177:0/1703698338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc91c141130 0x7fc91c13d130 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 >> 172.21.15.177:0/1703698338 conn(0x7fc91c067000 msgr2=0x7fc91c0b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 shutdown_connections 2023-11-27T17:49:16.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.623+0000 7fc924030700 1 -- 172.21.15.177:0/1703698338 wait complete. 2023-11-27T17:49:16.629 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:49:16.637 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-27T17:49:14.631853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219900,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754820,"statfs":{"total":773094113280,"available":772868935680,"internally_reserved":0,"allocated":3776512,"data_stored":2132168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.870173"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763601+0000","last_change":"2023-11-27T17:49:09.763601+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763601+0000","last_undegraded":"2023-11-27T17:49:09.763601+0000","last_fullsized":"2023-11-27T17:49:09.763601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767547+0000","last_change":"2023-11-27T17:49:09.767547+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767547+0000","last_undegraded":"2023-11-27T17:49:09.767547+0000","last_fullsized":"2023-11-27T17:49:09.767547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768339+0000","last_change":"2023-11-27T17:49:09.768339+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768339+0000","last_undegraded":"2023-11-27T17:49:09.768339+0000","last_fullsized":"2023-11-27T17:49:09.768339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765143+0000","last_change":"2023-11-27T17:49:09.765143+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765143+0000","last_undegraded":"2023-11-27T17:49:09.765143+0000","last_fullsized":"2023-11-27T17:49:09.765143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763172+0000","last_change":"2023-11-27T17:49:09.763172+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763172+0000","last_undegraded":"2023-11-27T17:49:09.763172+0000","last_fullsized":"2023-11-27T17:49:09.763172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761610+0000","last_change":"2023-11-27T17:49:09.761610+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761610+0000","last_undegraded":"2023-11-27T17:49:09.761610+0000","last_fullsized":"2023-11-27T17:49:09.761610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768590+0000","last_change":"2023-11-27T17:49:09.768590+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768590+0000","last_undegraded":"2023-11-27T17:49:09.768590+0000","last_fullsized":"2023-11-27T17:49:09.768590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761390+0000","last_change":"2023-11-27T17:49:09.761390+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761390+0000","last_undegraded":"2023-11-27T17:49:09.761390+0000","last_fullsized":"2023-11-27T17:49:09.761390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768846+0000","last_change":"2023-11-27T17:49:09.768846+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768846+0000","last_undegraded":"2023-11-27T17:49:09.768846+0000","last_fullsized":"2023-11-27T17:49:09.768846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767095+0000","last_change":"2023-11-27T17:49:09.767095+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767095+0000","last_undegraded":"2023-11-27T17:49:09.767095+0000","last_fullsized":"2023-11-27T17:49:09.767095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.764648+0000","last_change":"2023-11-27T17:49:09.764648+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.764648+0000","last_undegraded":"2023-11-27T17:49:09.764648+0000","last_fullsized":"2023-11-27T17:49:09.764648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.768487+0000","last_change":"2023-11-27T17:49:09.768487+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.768487+0000","last_undegraded":"2023-11-27T17:49:09.768487+0000","last_fullsized":"2023-11-27T17:49:09.768487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.762650+0000","last_change":"2023-11-27T17:49:09.762650+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.762650+0000","last_undegraded":"2023-11-27T17:49:09.762650+0000","last_fullsized":"2023-11-27T17:49:09.762650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.766894+0000","last_change":"2023-11-27T17:49:09.766894+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.766894+0000","last_undegraded":"2023-11-27T17:49:09.766894+0000","last_fullsized":"2023-11-27T17:49:09.766894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.767346+0000","last_change":"2023-11-27T17:49:09.767346+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.767346+0000","last_undegraded":"2023-11-27T17:49:09.767346+0000","last_fullsized":"2023-11-27T17:49:09.767346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.762188+0000","last_change":"2023-11-27T17:49:09.762188+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.762188+0000","last_undegraded":"2023-11-27T17:49:09.762188+0000","last_fullsized":"2023-11-27T17:49:09.762188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761579+0000","last_change":"2023-11-27T17:49:09.761579+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761579+0000","last_undegraded":"2023-11-27T17:49:09.761579+0000","last_fullsized":"2023-11-27T17:49:09.761579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761579+0000","last_change":"2023-11-27T17:49:09.761579+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761579+0000","last_undegraded":"2023-11-27T17:49:09.761579+0000","last_fullsized":"2023-11-27T17:49:09.761579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765626+0000","last_change":"2023-11-27T17:49:09.765626+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765626+0000","last_undegraded":"2023-11-27T17:49:09.765626+0000","last_fullsized":"2023-11-27T17:49:09.765626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763933+0000","last_change":"2023-11-27T17:49:09.763933+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763933+0000","last_undegraded":"2023-11-27T17:49:09.763933+0000","last_fullsized":"2023-11-27T17:49:09.763933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761997+0000","last_change":"2023-11-27T17:49:09.761997+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761997+0000","last_undegraded":"2023-11-27T17:49:09.761997+0000","last_fullsized":"2023-11-27T17:49:09.761997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.764627+0000","last_change":"2023-11-27T17:49:09.764627+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.764627+0000","last_undegraded":"2023-11-27T17:49:09.764627+0000","last_fullsized":"2023-11-27T17:49:09.764627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765974+0000","last_change":"2023-11-27T17:49:09.765974+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765974+0000","last_undegraded":"2023-11-27T17:49:09.765974+0000","last_fullsized":"2023-11-27T17:49:09.765974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.765143+0000","last_change":"2023-11-27T17:49:09.765143+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.765143+0000","last_undegraded":"2023-11-27T17:49:09.765143+0000","last_fullsized":"2023-11-27T17:49:09.765143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:09.756740+0000","last_change":"2023-11-27T17:49:09.756740+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.756740+0000","last_undegraded":"2023-11-27T17:49:09.756740+0000","last_fullsized":"2023-11-27T17:49:09.756740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.761420+0000","last_change":"2023-11-27T17:49:09.761420+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.761420+0000","last_undegraded":"2023-11-27T17:49:09.761420+0000","last_fullsized":"2023-11-27T17:49:09.761420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.766172+0000","last_change":"2023-11-27T17:49:09.766172+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.766172+0000","last_undegraded":"2023-11-27T17:49:09.766172+0000","last_fullsized":"2023-11-27T17:49:09.766172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:49:10.758939+0000","last_change":"2023-11-27T17:49:10.758939+0000","last_active":"2023-11-27T17:49:10.758939+0000","last_peered":"2023-11-27T17:49:10.758939+0000","last_clean":"2023-11-27T17:49:10.758939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:10.758939+0000","last_undegraded":"2023-11-27T17:49:10.758939+0000","last_fullsized":"2023-11-27T17:49:10.758939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-27T17:49:09.763571+0000","last_change":"2023-11-27T17:49:09.763571+0000","last_active":"2023-11-27T17:49:09.756740+0000","last_peered":"2023-11-27T17:49:09.756740+0000","last_clean":"2023-11-27T17:49:09.756740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:49:09.763571+0000","last_undegraded":"2023-11-27T17:49:09.763571+0000","last_fullsized":"2023-11-27T17:49:09.763571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:49:04.779667+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:49:04.779667+0000","last_peered":"2023-11-27T17:49:04.779667+0000","last_clean":"2023-11-27T17:49:04.779667+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:49:04.779667+0000","last_undegraded":"2023-11-27T17:49:04.779667+0000","last_fullsized":"2023-11-27T17:49:04.779667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":917504,"data_stored":709297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57799999999999996}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.63200000000000001}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.378},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.5}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.504},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.317},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.57399999999999995}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":118929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.626}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.55000000000000004}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.42199999999999999}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.747}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:49:16.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-27T17:49:16.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-27T17:49:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-27T17:49:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-27T17:49:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-27T17:49:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-27T17:49:16.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-27T17:49:16.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-27T17:49:16.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-27T17:49:16.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-27T17:49:16.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-27T17:49:16.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-27T17:49:16.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-27T17:49:16.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-27T17:49:16.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-27T17:49:16.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-27T17:49:16.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-27T17:49:16.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-27T17:49:16.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-27T17:49:16.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-27T17:49:16.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-27T17:49:16.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-27T17:49:16.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-27T17:49:16.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-27T17:49:16.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-27T17:49:16.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-27T17:49:16.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.763601+0000', 'last_change': '2023-11-27T17:49:09.763601+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.763601+0000', 'last_undegraded': '2023-11-27T17:49:09.763601+0000', 'last_fullsized': '2023-11-27T17:49:09.763601+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T17:49:16.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.767547+0000', 'last_change': '2023-11-27T17:49:09.767547+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.767547+0000', 'last_undegraded': '2023-11-27T17:49:09.767547+0000', 'last_fullsized': '2023-11-27T17:49:09.767547+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.768339+0000', 'last_change': '2023-11-27T17:49:09.768339+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.768339+0000', 'last_undegraded': '2023-11-27T17:49:09.768339+0000', 'last_fullsized': '2023-11-27T17:49:09.768339+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-27T17:49:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-27T17:49:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.765143+0000', 'last_change': '2023-11-27T17:49:09.765143+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.765143+0000', 'last_undegraded': '2023-11-27T17:49:09.765143+0000', 'last_fullsized': '2023-11-27T17:49:09.765143+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T17:49:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-27T17:49:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-27T17:49:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.763172+0000', 'last_change': '2023-11-27T17:49:09.763172+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.763172+0000', 'last_undegraded': '2023-11-27T17:49:09.763172+0000', 'last_fullsized': '2023-11-27T17:49:09.763172+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-27T17:49:16.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-27T17:49:16.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.761610+0000', 'last_change': '2023-11-27T17:49:09.761610+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.761610+0000', 'last_undegraded': '2023-11-27T17:49:09.761610+0000', 'last_fullsized': '2023-11-27T17:49:09.761610+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-27T17:49:16.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-27T17:49:16.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.768590+0000', 'last_change': '2023-11-27T17:49:09.768590+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.768590+0000', 'last_undegraded': '2023-11-27T17:49:09.768590+0000', 'last_fullsized': '2023-11-27T17:49:09.768590+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:49:16.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-27T17:49:16.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.761390+0000', 'last_change': '2023-11-27T17:49:09.761390+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.761390+0000', 'last_undegraded': '2023-11-27T17:49:09.761390+0000', 'last_fullsized': '2023-11-27T17:49:09.761390+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.768846+0000', 'last_change': '2023-11-27T17:49:09.768846+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.768846+0000', 'last_undegraded': '2023-11-27T17:49:09.768846+0000', 'last_fullsized': '2023-11-27T17:49:09.768846+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.767095+0000', 'last_change': '2023-11-27T17:49:09.767095+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.767095+0000', 'last_undegraded': '2023-11-27T17:49:09.767095+0000', 'last_fullsized': '2023-11-27T17:49:09.767095+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.764648+0000', 'last_change': '2023-11-27T17:49:09.764648+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.764648+0000', 'last_undegraded': '2023-11-27T17:49:09.764648+0000', 'last_fullsized': '2023-11-27T17:49:09.764648+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-27T17:49:16.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.768487+0000', 'last_change': '2023-11-27T17:49:09.768487+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.768487+0000', 'last_undegraded': '2023-11-27T17:49:09.768487+0000', 'last_fullsized': '2023-11-27T17:49:09.768487+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.762650+0000', 'last_change': '2023-11-27T17:49:09.762650+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.762650+0000', 'last_undegraded': '2023-11-27T17:49:09.762650+0000', 'last_fullsized': '2023-11-27T17:49:09.762650+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:09.756740+0000', 'last_change': '2023-11-27T17:49:09.756740+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.756740+0000', 'last_undegraded': '2023-11-27T17:49:09.756740+0000', 'last_fullsized': '2023-11-27T17:49:09.756740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-27T17:49:16.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-27T17:49:16.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.766894+0000', 'last_change': '2023-11-27T17:49:09.766894+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.766894+0000', 'last_undegraded': '2023-11-27T17:49:09.766894+0000', 'last_fullsized': '2023-11-27T17:49:09.766894+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:49:16.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-27T17:49:16.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-27T17:49:16.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.767346+0000', 'last_change': '2023-11-27T17:49:09.767346+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.767346+0000', 'last_undegraded': '2023-11-27T17:49:09.767346+0000', 'last_fullsized': '2023-11-27T17:49:09.767346+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:49:16.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-27T17:49:16.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:09.756740+0000', 'last_change': '2023-11-27T17:49:09.756740+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.756740+0000', 'last_undegraded': '2023-11-27T17:49:09.756740+0000', 'last_fullsized': '2023-11-27T17:49:09.756740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.762188+0000', 'last_change': '2023-11-27T17:49:09.762188+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.762188+0000', 'last_undegraded': '2023-11-27T17:49:09.762188+0000', 'last_fullsized': '2023-11-27T17:49:09.762188+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-27T17:49:16.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.761579+0000', 'last_change': '2023-11-27T17:49:09.761579+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.761579+0000', 'last_undegraded': '2023-11-27T17:49:09.761579+0000', 'last_fullsized': '2023-11-27T17:49:09.761579+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-27T17:49:16.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-27T17:49:16.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.761579+0000', 'last_change': '2023-11-27T17:49:09.761579+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.761579+0000', 'last_undegraded': '2023-11-27T17:49:09.761579+0000', 'last_fullsized': '2023-11-27T17:49:09.761579+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-27T17:49:16.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-27T17:49:16.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.765626+0000', 'last_change': '2023-11-27T17:49:09.765626+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.765626+0000', 'last_undegraded': '2023-11-27T17:49:09.765626+0000', 'last_fullsized': '2023-11-27T17:49:09.765626+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.763933+0000', 'last_change': '2023-11-27T17:49:09.763933+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.763933+0000', 'last_undegraded': '2023-11-27T17:49:09.763933+0000', 'last_fullsized': '2023-11-27T17:49:09.763933+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.761997+0000', 'last_change': '2023-11-27T17:49:09.761997+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.761997+0000', 'last_undegraded': '2023-11-27T17:49:09.761997+0000', 'last_fullsized': '2023-11-27T17:49:09.761997+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-27T17:49:16.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.764627+0000', 'last_change': '2023-11-27T17:49:09.764627+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.764627+0000', 'last_undegraded': '2023-11-27T17:49:09.764627+0000', 'last_fullsized': '2023-11-27T17:49:09.764627+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:09.756740+0000', 'last_change': '2023-11-27T17:49:09.756740+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.756740+0000', 'last_undegraded': '2023-11-27T17:49:09.756740+0000', 'last_fullsized': '2023-11-27T17:49:09.756740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.765974+0000', 'last_change': '2023-11-27T17:49:09.765974+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.765974+0000', 'last_undegraded': '2023-11-27T17:49:09.765974+0000', 'last_fullsized': '2023-11-27T17:49:09.765974+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:09.756740+0000', 'last_change': '2023-11-27T17:49:09.756740+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.756740+0000', 'last_undegraded': '2023-11-27T17:49:09.756740+0000', 'last_fullsized': '2023-11-27T17:49:09.756740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-27T17:49:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.765143+0000', 'last_change': '2023-11-27T17:49:09.765143+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.765143+0000', 'last_undegraded': '2023-11-27T17:49:09.765143+0000', 'last_fullsized': '2023-11-27T17:49:09.765143+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:09.756740+0000', 'last_change': '2023-11-27T17:49:09.756740+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.756740+0000', 'last_undegraded': '2023-11-27T17:49:09.756740+0000', 'last_fullsized': '2023-11-27T17:49:09.756740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.761420+0000', 'last_change': '2023-11-27T17:49:09.761420+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.761420+0000', 'last_undegraded': '2023-11-27T17:49:09.761420+0000', 'last_fullsized': '2023-11-27T17:49:09.761420+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-27T17:49:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-27T17:49:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.766172+0000', 'last_change': '2023-11-27T17:49:09.766172+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.766172+0000', 'last_undegraded': '2023-11-27T17:49:09.766172+0000', 'last_fullsized': '2023-11-27T17:49:09.766172+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:49:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-27T17:49:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:49:10.758939+0000', 'last_change': '2023-11-27T17:49:10.758939+0000', 'last_active': '2023-11-27T17:49:10.758939+0000', 'last_peered': '2023-11-27T17:49:10.758939+0000', 'last_clean': '2023-11-27T17:49:10.758939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:10.758939+0000', 'last_undegraded': '2023-11-27T17:49:10.758939+0000', 'last_fullsized': '2023-11-27T17:49:10.758939+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:10.758939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:49:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-27T17:49:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:49:09.763571+0000', 'last_change': '2023-11-27T17:49:09.763571+0000', 'last_active': '2023-11-27T17:49:09.756740+0000', 'last_peered': '2023-11-27T17:49:09.756740+0000', 'last_clean': '2023-11-27T17:49:09.756740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:49:09.763571+0000', 'last_undegraded': '2023-11-27T17:49:09.763571+0000', 'last_fullsized': '2023-11-27T17:49:09.763571+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'last_clean_scrub_stamp': '2023-11-27T17:49:09.756740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T17:49:16.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-27T17:49:16.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.794+0000 7f992792b700 1 Processor -- start 2023-11-27T17:49:16.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.794+0000 7f992792b700 1 -- start start 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f992792b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920072d20 0x7f992006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f992792b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f992006dd00 0x7f9920143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f992792b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992006e510 con 0x7f9920141030 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f992792b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9920161ac0 con 0x7f992006dd00 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f992792b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9920141410 con 0x7f9920072d20 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9925ec8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f992006dd00 0x7f9920143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9924ec6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920072d20 0x7f992006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9925ec8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f992006dd00 0x7f9920143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.177:33216/0 (socket says 172.21.15.177:33216) 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9924ec6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920072d20 0x7f992006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:40890/0 (socket says 172.21.15.177:40890) 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9925ec8700 1 -- 172.21.15.177:0/4291533561 learned_addr learned my addr 172.21.15.177:0/4291533561 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f99256c7700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9920141030 0x7f9920072610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:46718/0 (socket says 172.21.15.177:46718) 2023-11-27T17:49:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9925ec8700 1 -- 172.21.15.177:0/4291533561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920072d20 msgr2=0x7f992006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9925ec8700 1 --2- 172.21.15.177:0/4291533561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920072d20 0x7f992006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9925ec8700 1 -- 172.21.15.177:0/4291533561 >> v1:172.21.15.178:6789/0 conn(0x7f9920141030 legacy=0x7f9920072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9925ec8700 1 -- 172.21.15.177:0/4291533561 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920161ca0 con 0x7f992006dd00 2023-11-27T17:49:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.795+0000 7f9924ec6700 1 --2- 172.21.15.177:0/4291533561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920072d20 0x7f992006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.796+0000 7f9925ec8700 1 --2- 172.21.15.177:0/4291533561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992006dd00 0x7f9920143620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9918009e50 tx=0x7f991800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76ea7089575ca678 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.797+0000 7f9917fff700 1 -- 172.21.15.177:0/4291533561 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991800e070 con 0x7f992006dd00 2023-11-27T17:49:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.797+0000 7f9917fff700 1 -- 172.21.15.177:0/4291533561 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991800b910 con 0x7f992006dd00 2023-11-27T17:49:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.797+0000 7f9917fff700 1 -- 172.21.15.177:0/4291533561 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991800bcc0 con 0x7f992006dd00 2023-11-27T17:49:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.798+0000 7f992792b700 1 -- 172.21.15.177:0/4291533561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992006dd00 msgr2=0x7f9920143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.798+0000 7f992792b700 1 --2- 172.21.15.177:0/4291533561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992006dd00 0x7f9920143620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9918009e50 tx=0x7f991800b330 comp rx=0 tx=0).stop 2023-11-27T17:49:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.798+0000 7f992792b700 1 -- 172.21.15.177:0/4291533561 shutdown_connections 2023-11-27T17:49:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.798+0000 7f992792b700 1 --2- 172.21.15.177:0/4291533561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f992006dd00 0x7f9920143620 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.798+0000 7f992792b700 1 --2- 172.21.15.177:0/4291533561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920072d20 0x7f992006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.798+0000 7f992792b700 1 -- 172.21.15.177:0/4291533561 >> 172.21.15.177:0/4291533561 conn(0x7f992006aff0 msgr2=0x7f992006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.798+0000 7f992792b700 1 -- 172.21.15.177:0/4291533561 shutdown_connections 2023-11-27T17:49:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.798+0000 7f992792b700 1 -- 172.21.15.177:0/4291533561 wait complete. 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.799+0000 7f992792b700 1 Processor -- start 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.799+0000 7f992792b700 1 -- start start 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f992792b700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f992006dd00 0x7f99200b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f992792b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920072d20 0x7f9920157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f992792b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920141030 0x7f992015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f992792b700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200b1510 con 0x7f992006dd00 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f992792b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920158130 con 0x7f9920072d20 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f992792b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200aff30 con 0x7f9920141030 2023-11-27T17:49:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f992006dd00 0x7f99200b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f992006dd00 0x7f99200b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53428/0 (socket says 172.21.15.177:53428) 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 -- 172.21.15.177:0/2201945360 learned_addr learned my addr 172.21.15.177:0/2201945360 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f9925ec8700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920141030 0x7f992015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f9924ec6700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920072d20 0x7f9920157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 -- 172.21.15.177:0/2201945360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920141030 msgr2=0x7f992015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920141030 0x7f992015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 -- 172.21.15.177:0/2201945360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920072d20 msgr2=0x7f9920157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920072d20 0x7f9920157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 -- 172.21.15.177:0/2201945360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100094a0 con 0x7f992006dd00 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f99256c7700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f992006dd00 0x7f99200b0fd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f991c00c520 tx=0x7f991c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f9915ffb700 1 -- 172.21.15.177:0/2201945360 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c005cb0 con 0x7f992006dd00 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f9915ffb700 1 -- 172.21.15.177:0/2201945360 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c005e10 con 0x7f992006dd00 2023-11-27T17:49:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9918009b30 con 0x7f992006dd00 2023-11-27T17:49:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.800+0000 7f9915ffb700 1 -- 172.21.15.177:0/2201945360 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0072d0 con 0x7f992006dd00 2023-11-27T17:49:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.801+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99200b04f0 con 0x7f992006dd00 2023-11-27T17:49:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.801+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920073aa0 con 0x7f992006dd00 2023-11-27T17:49:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.802+0000 7f9915ffb700 1 -- 172.21.15.177:0/2201945360 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f991c007430 con 0x7f992006dd00 2023-11-27T17:49:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.802+0000 7f9915ffb700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f990406b250 0x7f990406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:16.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.802+0000 7f9915ffb700 1 -- 172.21.15.177:0/2201945360 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f991c088a50 con 0x7f992006dd00 2023-11-27T17:49:16.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.802+0000 7f9924ec6700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f990406b250 0x7f990406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:16.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.803+0000 7f9924ec6700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f990406b250 0x7f990406d710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9910009d70 tx=0x7f9910009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:16.807+0000 7f9915ffb700 1 -- 172.21.15.177:0/2201945360 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f991c0538c0 con 0x7f992006dd00 2023-11-27T17:49:17.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.078+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f992006e510 con 0x7f992006dd00 2023-11-27T17:49:17.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.078+0000 7f9915ffb700 1 -- 172.21.15.177:0/2201945360 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1560 (secure 0 0 0) 0x7f992006e510 con 0x7f992006dd00 2023-11-27T17:49:17.080 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:17.081 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1701107288,"num_in_osds":8,"osd_in_since":1701107281,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":225619968,"bytes_avail":772868493312,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5034}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-27T17:49:10.631280+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-27T17:49:17.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f990406b250 msgr2=0x7f990406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:17.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f990406b250 0x7f990406d710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9910009d70 tx=0x7f9910009210 comp rx=0 tx=0).stop 2023-11-27T17:49:17.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f992006dd00 msgr2=0x7f99200b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:17.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f992006dd00 0x7f99200b0fd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f991c00c520 tx=0x7f991c00c830 comp rx=0 tx=0).stop 2023-11-27T17:49:17.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 shutdown_connections 2023-11-27T17:49:17.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f990406b250 0x7f990406d710 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9920141030 0x7f992015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f992006dd00 0x7f99200b0fd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 --2- 172.21.15.177:0/2201945360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920072d20 0x7f9920157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 >> 172.21.15.177:0/2201945360 conn(0x7f992006aff0 msgr2=0x7f992013f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:17.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 shutdown_connections 2023-11-27T17:49:17.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.080+0000 7f992792b700 1 -- 172.21.15.177:0/2201945360 wait complete. 2023-11-27T17:49:17.095 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-27T17:49:17.095 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:49:17.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.212+0000 7fb4fa4dc700 1 Processor -- start 2023-11-27T17:49:17.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.212+0000 7fb4fa4dc700 1 -- start start 2023-11-27T17:49:17.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4fa4dc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb4f415ad60 0x7fb4f40b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:17.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4fa4dc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415b140 0x7fb4f40b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:17.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4fa4dc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb4f415f680 0x7fb4f40cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:17.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4fa4dc700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f40b6020 con 0x7fb4f415ad60 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4fa4dc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f4071b10 con 0x7fb4f415f680 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4fa4dc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b5d40 con 0x7fb4f415b140 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb4f415ad60 0x7fb4f40b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f3fff700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb4f415ad60 0x7fb4f40b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53436/0 (socket says 172.21.15.177:53436) 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f3fff700 1 -- 172.21.15.177:0/1899163668 learned_addr learned my addr 172.21.15.177:0/1899163668 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f8a79700 1 --2- 172.21.15.177:0/1899163668 >> v2:172.21.15.178:3300/0 conn(0x7fb4f415f680 0x7fb4f40cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f37fe700 1 --2- 172.21.15.177:0/1899163668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415b140 0x7fb4f40b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f3fff700 1 -- 172.21.15.177:0/1899163668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415b140 msgr2=0x7fb4f40b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f3fff700 1 --2- 172.21.15.177:0/1899163668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415b140 0x7fb4f40b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f3fff700 1 -- 172.21.15.177:0/1899163668 >> v2:172.21.15.178:3300/0 conn(0x7fb4f415f680 msgr2=0x7fb4f40cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f3fff700 1 --2- 172.21.15.177:0/1899163668 >> v2:172.21.15.178:3300/0 conn(0x7fb4f415f680 0x7fb4f40cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f3fff700 1 -- 172.21.15.177:0/1899163668 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f415eba0 con 0x7fb4f415ad60 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f8a79700 1 --2- 172.21.15.177:0/1899163668 >> v2:172.21.15.178:3300/0 conn(0x7fb4f415f680 0x7fb4f40cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.213+0000 7fb4f37fe700 1 --2- 172.21.15.177:0/1899163668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415b140 0x7fb4f40b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4f3fff700 1 --2- 172.21.15.177:0/1899163668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f40b51d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40d0470 tx=0x7fb4e400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c80e2dc31659a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4f2ffd700 1 -- 172.21.15.177:0/1899163668 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400dd30 con 0x7fb4f415ad60 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4f2ffd700 1 -- 172.21.15.177:0/1899163668 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e400de90 con 0x7fb4f415ad60 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4f2ffd700 1 -- 172.21.15.177:0/1899163668 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4010690 con 0x7fb4f415ad60 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/1899163668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 msgr2=0x7fb4f40b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/1899163668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f40b51d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40d0470 tx=0x7fb4e400be70 comp rx=0 tx=0).stop 2023-11-27T17:49:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/1899163668 shutdown_connections 2023-11-27T17:49:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/1899163668 >> v2:172.21.15.178:3300/0 conn(0x7fb4f415f680 0x7fb4f40cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/1899163668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f40b51d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/1899163668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415b140 0x7fb4f40b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/1899163668 >> 172.21.15.177:0/1899163668 conn(0x7fb4f4067000 msgr2=0x7fb4f40b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/1899163668 shutdown_connections 2023-11-27T17:49:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.214+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/1899163668 wait complete. 2023-11-27T17:49:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.216+0000 7fb4fa4dc700 1 Processor -- start 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.216+0000 7fb4fa4dc700 1 -- start start 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.216+0000 7fb4fa4dc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f4156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.216+0000 7fb4fa4dc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4f415b140 0x7fb4f4151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.216+0000 7fb4fa4dc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415f680 0x7fb4f4070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.216+0000 7fb4fa4dc700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f415dfe0 con 0x7fb4f415ad60 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.216+0000 7fb4fa4dc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f41571d0 con 0x7fb4f415b140 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.216+0000 7fb4fa4dc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4159650 con 0x7fb4f415f680 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f4156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f4156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53442/0 (socket says 172.21.15.177:53442) 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 -- 172.21.15.177:0/2085214912 learned_addr learned my addr 172.21.15.177:0/2085214912 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f37fe700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4f415b140 0x7fb4f4151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f8a79700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415f680 0x7fb4f4070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 -- 172.21.15.177:0/2085214912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415f680 msgr2=0x7fb4f4070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415f680 0x7fb4f4070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 -- 172.21.15.177:0/2085214912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4f415b140 msgr2=0x7fb4f4151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4f415b140 0x7fb4f4151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 -- 172.21.15.177:0/2085214912 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e400b7f0 con 0x7fb4f415ad60 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f3fff700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f4156b40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400beb0 tx=0x7fb4e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f0ff9700 1 -- 172.21.15.177:0/2085214912 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e401f070 con 0x7fb4f415ad60 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f0ff9700 1 -- 172.21.15.177:0/2085214912 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4003970 con 0x7fb4f415ad60 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f4159930 con 0x7fb4f415ad60 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4f0ff9700 1 -- 172.21.15.177:0/2085214912 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4003d00 con 0x7fb4f415ad60 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.217+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f4151d40 con 0x7fb4f415ad60 2023-11-27T17:49:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.218+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f4073aa0 con 0x7fb4f415ad60 2023-11-27T17:49:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.219+0000 7fb4f0ff9700 1 -- 172.21.15.177:0/2085214912 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb4e4019400 con 0x7fb4f415ad60 2023-11-27T17:49:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.219+0000 7fb4f0ff9700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb4d406b250 0x7fb4d406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.219+0000 7fb4f0ff9700 1 -- 172.21.15.177:0/2085214912 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e408ccd0 con 0x7fb4f415ad60 2023-11-27T17:49:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.219+0000 7fb4f37fe700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb4d406b250 0x7fb4d406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.219+0000 7fb4f37fe700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb4d406b250 0x7fb4d406d710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40ae960 tx=0x7fb4dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.223+0000 7fb4f0ff9700 1 -- 172.21.15.177:0/2085214912 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb4e4057a90 con 0x7fb4f415ad60 2023-11-27T17:49:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.408+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4f415f160 con 0x7fb4d406b250 2023-11-27T17:49:17.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.416+0000 7fb4f0ff9700 1 -- 172.21.15.177:0/2085214912 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289106 (secure 0 0 0) 0x7fb4dc004260 con 0x7fb4d406b250 2023-11-27T17:49:17.423 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:17.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb4d406b250 msgr2=0x7fb4d406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:17.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb4d406b250 0x7fb4d406d710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40ae960 tx=0x7fb4dc008040 comp rx=0 tx=0).stop 2023-11-27T17:49:17.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 msgr2=0x7fb4f4156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:17.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f4156b40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400beb0 tx=0x7fb4e4004750 comp rx=0 tx=0).stop 2023-11-27T17:49:17.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 shutdown_connections 2023-11-27T17:49:17.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fb4d406b250 0x7fb4d406d710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4f415f680 0x7fb4f4070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4f415ad60 0x7fb4f4156b40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 --2- 172.21.15.177:0/2085214912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4f415b140 0x7fb4f4151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:17.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 >> 172.21.15.177:0/2085214912 conn(0x7fb4f4067000 msgr2=0x7fb4f4074520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:17.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 shutdown_connections 2023-11-27T17:49:17.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:17.419+0000 7fb4fa4dc700 1 -- 172.21.15.177:0/2085214912 wait complete. 2023-11-27T17:49:17.426 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:49:17.434 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-11-27T17:49:16.632198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220332,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754388,"statfs":{"total":773094113280,"available":772868493312,"internally_reserved":0,"allocated":4235264,"data_stored":2338260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001048"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029745+0000","last_change":"2023-11-27T17:49:11.782705+0000","last_active":"2023-11-27T17:49:13.029745+0000","last_peered":"2023-11-27T17:49:13.029745+0000","last_clean":"2023-11-27T17:49:13.029745+0000","last_became_active":"2023-11-27T17:49:11.782476+0000","last_became_peered":"2023-11-27T17:49:11.782476+0000","last_unstale":"2023-11-27T17:49:13.029745+0000","last_undegraded":"2023-11-27T17:49:13.029745+0000","last_fullsized":"2023-11-27T17:49:13.029745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:42:35.028409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028115+0000","last_change":"2023-11-27T17:49:11.784305+0000","last_active":"2023-11-27T17:49:13.028115+0000","last_peered":"2023-11-27T17:49:13.028115+0000","last_clean":"2023-11-27T17:49:13.028115+0000","last_became_active":"2023-11-27T17:49:11.784031+0000","last_became_peered":"2023-11-27T17:49:11.784031+0000","last_unstale":"2023-11-27T17:49:13.028115+0000","last_undegraded":"2023-11-27T17:49:13.028115+0000","last_fullsized":"2023-11-27T17:49:13.028115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:17:27.695296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029212+0000","last_change":"2023-11-27T17:49:11.801358+0000","last_active":"2023-11-27T17:49:13.029212+0000","last_peered":"2023-11-27T17:49:13.029212+0000","last_clean":"2023-11-27T17:49:13.029212+0000","last_became_active":"2023-11-27T17:49:11.801000+0000","last_became_peered":"2023-11-27T17:49:11.801000+0000","last_unstale":"2023-11-27T17:49:13.029212+0000","last_undegraded":"2023-11-27T17:49:13.029212+0000","last_fullsized":"2023-11-27T17:49:13.029212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:50.396975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.784998+0000","last_change":"2023-11-27T17:49:11.794888+0000","last_active":"2023-11-27T17:49:12.784998+0000","last_peered":"2023-11-27T17:49:12.784998+0000","last_clean":"2023-11-27T17:49:12.784998+0000","last_became_active":"2023-11-27T17:49:11.794627+0000","last_became_peered":"2023-11-27T17:49:11.794627+0000","last_unstale":"2023-11-27T17:49:12.784998+0000","last_undegraded":"2023-11-27T17:49:12.784998+0000","last_fullsized":"2023-11-27T17:49:12.784998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:49:47.270687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815471+0000","last_change":"2023-11-27T17:49:11.784941+0000","last_active":"2023-11-27T17:49:12.815471+0000","last_peered":"2023-11-27T17:49:12.815471+0000","last_clean":"2023-11-27T17:49:12.815471+0000","last_became_active":"2023-11-27T17:49:11.784646+0000","last_became_peered":"2023-11-27T17:49:11.784646+0000","last_unstale":"2023-11-27T17:49:12.815471+0000","last_undegraded":"2023-11-27T17:49:12.815471+0000","last_fullsized":"2023-11-27T17:49:12.815471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:47:10.098471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027999+0000","last_change":"2023-11-27T17:49:11.782220+0000","last_active":"2023-11-27T17:49:13.027999+0000","last_peered":"2023-11-27T17:49:13.027999+0000","last_clean":"2023-11-27T17:49:13.027999+0000","last_became_active":"2023-11-27T17:49:11.781938+0000","last_became_peered":"2023-11-27T17:49:11.781938+0000","last_unstale":"2023-11-27T17:49:13.027999+0000","last_undegraded":"2023-11-27T17:49:13.027999+0000","last_fullsized":"2023-11-27T17:49:13.027999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:54.213596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029030+0000","last_change":"2023-11-27T17:49:11.787652+0000","last_active":"2023-11-27T17:49:13.029030+0000","last_peered":"2023-11-27T17:49:13.029030+0000","last_clean":"2023-11-27T17:49:13.029030+0000","last_became_active":"2023-11-27T17:49:11.785950+0000","last_became_peered":"2023-11-27T17:49:11.785950+0000","last_unstale":"2023-11-27T17:49:13.029030+0000","last_undegraded":"2023-11-27T17:49:13.029030+0000","last_fullsized":"2023-11-27T17:49:13.029030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:50.396975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028330+0000","last_change":"2023-11-27T17:49:11.784645+0000","last_active":"2023-11-27T17:49:13.028330+0000","last_peered":"2023-11-27T17:49:13.028330+0000","last_clean":"2023-11-27T17:49:13.028330+0000","last_became_active":"2023-11-27T17:49:11.784385+0000","last_became_peered":"2023-11-27T17:49:11.784385+0000","last_unstale":"2023-11-27T17:49:13.028330+0000","last_undegraded":"2023-11-27T17:49:13.028330+0000","last_fullsized":"2023-11-27T17:49:13.028330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:32:29.678284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786997+0000","last_change":"2023-11-27T17:49:11.797982+0000","last_active":"2023-11-27T17:49:12.786997+0000","last_peered":"2023-11-27T17:49:12.786997+0000","last_clean":"2023-11-27T17:49:12.786997+0000","last_became_active":"2023-11-27T17:49:11.797701+0000","last_became_peered":"2023-11-27T17:49:11.797701+0000","last_unstale":"2023-11-27T17:49:12.786997+0000","last_undegraded":"2023-11-27T17:49:12.786997+0000","last_fullsized":"2023-11-27T17:49:12.786997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:18:02.419567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785367+0000","last_change":"2023-11-27T17:49:11.793699+0000","last_active":"2023-11-27T17:49:12.785367+0000","last_peered":"2023-11-27T17:49:12.785367+0000","last_clean":"2023-11-27T17:49:12.785367+0000","last_became_active":"2023-11-27T17:49:11.793445+0000","last_became_peered":"2023-11-27T17:49:11.793445+0000","last_unstale":"2023-11-27T17:49:12.785367+0000","last_undegraded":"2023-11-27T17:49:12.785367+0000","last_fullsized":"2023-11-27T17:49:12.785367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:48.409642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028608+0000","last_change":"2023-11-27T17:49:11.801236+0000","last_active":"2023-11-27T17:49:13.028608+0000","last_peered":"2023-11-27T17:49:13.028608+0000","last_clean":"2023-11-27T17:49:13.028608+0000","last_became_active":"2023-11-27T17:49:11.800945+0000","last_became_peered":"2023-11-27T17:49:11.800945+0000","last_unstale":"2023-11-27T17:49:13.028608+0000","last_undegraded":"2023-11-27T17:49:13.028608+0000","last_fullsized":"2023-11-27T17:49:13.028608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:48.409642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029070+0000","last_change":"2023-11-27T17:49:11.791557+0000","last_active":"2023-11-27T17:49:13.029070+0000","last_peered":"2023-11-27T17:49:13.029070+0000","last_clean":"2023-11-27T17:49:13.029070+0000","last_became_active":"2023-11-27T17:49:11.791278+0000","last_became_peered":"2023-11-27T17:49:11.791278+0000","last_unstale":"2023-11-27T17:49:13.029070+0000","last_undegraded":"2023-11-27T17:49:13.029070+0000","last_fullsized":"2023-11-27T17:49:13.029070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:28.297452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815601+0000","last_change":"2023-11-27T17:49:11.794273+0000","last_active":"2023-11-27T17:49:12.815601+0000","last_peered":"2023-11-27T17:49:12.815601+0000","last_clean":"2023-11-27T17:49:12.815601+0000","last_became_active":"2023-11-27T17:49:11.793938+0000","last_became_peered":"2023-11-27T17:49:11.793938+0000","last_unstale":"2023-11-27T17:49:12.815601+0000","last_undegraded":"2023-11-27T17:49:12.815601+0000","last_fullsized":"2023-11-27T17:49:12.815601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:43:57.675652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027866+0000","last_change":"2023-11-27T17:49:11.783942+0000","last_active":"2023-11-27T17:49:13.027866+0000","last_peered":"2023-11-27T17:49:13.027866+0000","last_clean":"2023-11-27T17:49:13.027866+0000","last_became_active":"2023-11-27T17:49:11.783642+0000","last_became_peered":"2023-11-27T17:49:11.783642+0000","last_unstale":"2023-11-27T17:49:13.027866+0000","last_undegraded":"2023-11-27T17:49:13.027866+0000","last_fullsized":"2023-11-27T17:49:13.027866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:41.741265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029067+0000","last_change":"2023-11-27T17:49:11.792711+0000","last_active":"2023-11-27T17:49:13.029067+0000","last_peered":"2023-11-27T17:49:13.029067+0000","last_clean":"2023-11-27T17:49:13.029067+0000","last_became_active":"2023-11-27T17:49:11.792432+0000","last_became_peered":"2023-11-27T17:49:11.792432+0000","last_unstale":"2023-11-27T17:49:13.029067+0000","last_undegraded":"2023-11-27T17:49:13.029067+0000","last_fullsized":"2023-11-27T17:49:13.029067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:22:29.473085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028482+0000","last_change":"2023-11-27T17:49:11.778111+0000","last_active":"2023-11-27T17:49:13.028482+0000","last_peered":"2023-11-27T17:49:13.028482+0000","last_clean":"2023-11-27T17:49:13.028482+0000","last_became_active":"2023-11-27T17:49:11.777833+0000","last_became_peered":"2023-11-27T17:49:11.777833+0000","last_unstale":"2023-11-27T17:49:13.028482+0000","last_undegraded":"2023-11-27T17:49:13.028482+0000","last_fullsized":"2023-11-27T17:49:13.028482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:35.672002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029543+0000","last_change":"2023-11-27T17:49:11.778763+0000","last_active":"2023-11-27T17:49:13.029543+0000","last_peered":"2023-11-27T17:49:13.029543+0000","last_clean":"2023-11-27T17:49:13.029543+0000","last_became_active":"2023-11-27T17:49:11.778457+0000","last_became_peered":"2023-11-27T17:49:11.778457+0000","last_unstale":"2023-11-27T17:49:13.029543+0000","last_undegraded":"2023-11-27T17:49:13.029543+0000","last_fullsized":"2023-11-27T17:49:13.029543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:25.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028205+0000","last_change":"2023-11-27T17:49:11.796205+0000","last_active":"2023-11-27T17:49:13.028205+0000","last_peered":"2023-11-27T17:49:13.028205+0000","last_clean":"2023-11-27T17:49:13.028205+0000","last_became_active":"2023-11-27T17:49:11.795960+0000","last_became_peered":"2023-11-27T17:49:11.795960+0000","last_unstale":"2023-11-27T17:49:13.028205+0000","last_undegraded":"2023-11-27T17:49:13.028205+0000","last_fullsized":"2023-11-27T17:49:13.028205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:48:56.035018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027994+0000","last_change":"2023-11-27T17:49:11.793915+0000","last_active":"2023-11-27T17:49:13.027994+0000","last_peered":"2023-11-27T17:49:13.027994+0000","last_clean":"2023-11-27T17:49:13.027994+0000","last_became_active":"2023-11-27T17:49:11.793636+0000","last_became_peered":"2023-11-27T17:49:11.793636+0000","last_unstale":"2023-11-27T17:49:13.027994+0000","last_undegraded":"2023-11-27T17:49:13.027994+0000","last_fullsized":"2023-11-27T17:49:13.027994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:52.479589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815586+0000","last_change":"2023-11-27T17:49:11.782411+0000","last_active":"2023-11-27T17:49:12.815586+0000","last_peered":"2023-11-27T17:49:12.815586+0000","last_clean":"2023-11-27T17:49:12.815586+0000","last_became_active":"2023-11-27T17:49:11.782108+0000","last_became_peered":"2023-11-27T17:49:11.782108+0000","last_unstale":"2023-11-27T17:49:12.815586+0000","last_undegraded":"2023-11-27T17:49:12.815586+0000","last_fullsized":"2023-11-27T17:49:12.815586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:21:05.562040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785528+0000","last_change":"2023-11-27T17:49:11.787186+0000","last_active":"2023-11-27T17:49:12.785528+0000","last_peered":"2023-11-27T17:49:12.785528+0000","last_clean":"2023-11-27T17:49:12.785528+0000","last_became_active":"2023-11-27T17:49:11.786897+0000","last_became_peered":"2023-11-27T17:49:11.786897+0000","last_unstale":"2023-11-27T17:49:12.785528+0000","last_undegraded":"2023-11-27T17:49:12.785528+0000","last_fullsized":"2023-11-27T17:49:12.785528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:02:35.207902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785735+0000","last_change":"2023-11-27T17:49:11.786009+0000","last_active":"2023-11-27T17:49:12.785735+0000","last_peered":"2023-11-27T17:49:12.785735+0000","last_clean":"2023-11-27T17:49:12.785735+0000","last_became_active":"2023-11-27T17:49:11.785724+0000","last_became_peered":"2023-11-27T17:49:11.785724+0000","last_unstale":"2023-11-27T17:49:12.785735+0000","last_undegraded":"2023-11-27T17:49:12.785735+0000","last_fullsized":"2023-11-27T17:49:12.785735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:49:47.270687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785940+0000","last_change":"2023-11-27T17:49:11.788565+0000","last_active":"2023-11-27T17:49:12.785940+0000","last_peered":"2023-11-27T17:49:12.785940+0000","last_clean":"2023-11-27T17:49:12.785940+0000","last_became_active":"2023-11-27T17:49:11.788300+0000","last_became_peered":"2023-11-27T17:49:11.788300+0000","last_unstale":"2023-11-27T17:49:12.785940+0000","last_undegraded":"2023-11-27T17:49:12.785940+0000","last_fullsized":"2023-11-27T17:49:12.785940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:23.875253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028315+0000","last_change":"2023-11-27T17:49:11.782409+0000","last_active":"2023-11-27T17:49:13.028315+0000","last_peered":"2023-11-27T17:49:13.028315+0000","last_clean":"2023-11-27T17:49:13.028315+0000","last_became_active":"2023-11-27T17:49:11.782151+0000","last_became_peered":"2023-11-27T17:49:11.782151+0000","last_unstale":"2023-11-27T17:49:13.028315+0000","last_undegraded":"2023-11-27T17:49:13.028315+0000","last_fullsized":"2023-11-27T17:49:13.028315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:48.409642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785167+0000","last_change":"2023-11-27T17:49:11.795605+0000","last_active":"2023-11-27T17:49:12.785167+0000","last_peered":"2023-11-27T17:49:12.785167+0000","last_clean":"2023-11-27T17:49:12.785167+0000","last_became_active":"2023-11-27T17:49:11.795289+0000","last_became_peered":"2023-11-27T17:49:11.795289+0000","last_unstale":"2023-11-27T17:49:12.785167+0000","last_undegraded":"2023-11-27T17:49:12.785167+0000","last_fullsized":"2023-11-27T17:49:12.785167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:10.562789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028213+0000","last_change":"2023-11-27T17:49:11.779660+0000","last_active":"2023-11-27T17:49:13.028213+0000","last_peered":"2023-11-27T17:49:13.028213+0000","last_clean":"2023-11-27T17:49:13.028213+0000","last_became_active":"2023-11-27T17:49:11.778208+0000","last_became_peered":"2023-11-27T17:49:11.778208+0000","last_unstale":"2023-11-27T17:49:13.028213+0000","last_undegraded":"2023-11-27T17:49:13.028213+0000","last_fullsized":"2023-11-27T17:49:13.028213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:22.498398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785458+0000","last_change":"2023-11-27T17:49:11.796912+0000","last_active":"2023-11-27T17:49:12.785458+0000","last_peered":"2023-11-27T17:49:12.785458+0000","last_clean":"2023-11-27T17:49:12.785458+0000","last_became_active":"2023-11-27T17:49:11.796704+0000","last_became_peered":"2023-11-27T17:49:11.796704+0000","last_unstale":"2023-11-27T17:49:12.785458+0000","last_undegraded":"2023-11-27T17:49:12.785458+0000","last_fullsized":"2023-11-27T17:49:12.785458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:18:02.419567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028961+0000","last_change":"2023-11-27T17:49:11.789768+0000","last_active":"2023-11-27T17:49:13.028961+0000","last_peered":"2023-11-27T17:49:13.028961+0000","last_clean":"2023-11-27T17:49:13.028961+0000","last_became_active":"2023-11-27T17:49:11.789483+0000","last_became_peered":"2023-11-27T17:49:11.789483+0000","last_unstale":"2023-11-27T17:49:13.028961+0000","last_undegraded":"2023-11-27T17:49:13.028961+0000","last_fullsized":"2023-11-27T17:49:13.028961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:18.765889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785656+0000","last_change":"2023-11-27T17:49:11.782813+0000","last_active":"2023-11-27T17:49:12.785656+0000","last_peered":"2023-11-27T17:49:12.785656+0000","last_clean":"2023-11-27T17:49:12.785656+0000","last_became_active":"2023-11-27T17:49:11.782536+0000","last_became_peered":"2023-11-27T17:49:11.782536+0000","last_unstale":"2023-11-27T17:49:12.785656+0000","last_undegraded":"2023-11-27T17:49:12.785656+0000","last_fullsized":"2023-11-27T17:49:12.785656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:32:29.678284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029015+0000","last_change":"2023-11-27T17:49:11.783544+0000","last_active":"2023-11-27T17:49:13.029015+0000","last_peered":"2023-11-27T17:49:13.029015+0000","last_clean":"2023-11-27T17:49:13.029015+0000","last_became_active":"2023-11-27T17:49:11.781065+0000","last_became_peered":"2023-11-27T17:49:11.781065+0000","last_unstale":"2023-11-27T17:49:13.029015+0000","last_undegraded":"2023-11-27T17:49:13.029015+0000","last_fullsized":"2023-11-27T17:49:13.029015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:18.765889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029680+0000","last_change":"2023-11-27T17:49:11.784541+0000","last_active":"2023-11-27T17:49:13.029680+0000","last_peered":"2023-11-27T17:49:13.029680+0000","last_clean":"2023-11-27T17:49:13.029680+0000","last_became_active":"2023-11-27T17:49:11.783897+0000","last_became_peered":"2023-11-27T17:49:11.783897+0000","last_unstale":"2023-11-27T17:49:13.029680+0000","last_undegraded":"2023-11-27T17:49:13.029680+0000","last_fullsized":"2023-11-27T17:49:13.029680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:31:29.242685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028983+0000","last_change":"2023-11-27T17:49:11.787586+0000","last_active":"2023-11-27T17:49:13.028983+0000","last_peered":"2023-11-27T17:49:13.028983+0000","last_clean":"2023-11-27T17:49:13.028983+0000","last_became_active":"2023-11-27T17:49:11.787219+0000","last_became_peered":"2023-11-27T17:49:11.787219+0000","last_unstale":"2023-11-27T17:49:13.028983+0000","last_undegraded":"2023-11-27T17:49:13.028983+0000","last_fullsized":"2023-11-27T17:49:13.028983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:29:55.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786685+0000","last_change":"2023-11-27T17:49:11.788886+0000","last_active":"2023-11-27T17:49:12.786685+0000","last_peered":"2023-11-27T17:49:12.786685+0000","last_clean":"2023-11-27T17:49:12.786685+0000","last_became_active":"2023-11-27T17:49:11.788599+0000","last_became_peered":"2023-11-27T17:49:11.788599+0000","last_unstale":"2023-11-27T17:49:12.786685+0000","last_undegraded":"2023-11-27T17:49:12.786685+0000","last_fullsized":"2023-11-27T17:49:12.786685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:49:47.270687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.792517+0000","last_change":"2023-11-27T17:49:10.784272+0000","last_active":"2023-11-27T17:49:11.792517+0000","last_peered":"2023-11-27T17:49:11.792517+0000","last_clean":"2023-11-27T17:49:11.792517+0000","last_became_active":"2023-11-27T17:49:10.784001+0000","last_became_peered":"2023-11-27T17:49:10.784001+0000","last_unstale":"2023-11-27T17:49:11.792517+0000","last_undegraded":"2023-11-27T17:49:11.792517+0000","last_fullsized":"2023-11-27T17:49:11.792517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:10:37.890409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029830+0000","last_change":"2023-11-27T17:49:11.777277+0000","last_active":"2023-11-27T17:49:13.029830+0000","last_peered":"2023-11-27T17:49:13.029830+0000","last_clean":"2023-11-27T17:49:13.029830+0000","last_became_active":"2023-11-27T17:49:11.776959+0000","last_became_peered":"2023-11-27T17:49:11.776959+0000","last_unstale":"2023-11-27T17:49:13.029830+0000","last_undegraded":"2023-11-27T17:49:13.029830+0000","last_fullsized":"2023-11-27T17:49:13.029830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:23.875253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.788334+0000","last_change":"2023-11-27T17:49:10.780494+0000","last_active":"2023-11-27T17:49:11.788334+0000","last_peered":"2023-11-27T17:49:11.788334+0000","last_clean":"2023-11-27T17:49:11.788334+0000","last_became_active":"2023-11-27T17:49:10.780246+0000","last_became_peered":"2023-11-27T17:49:10.780246+0000","last_unstale":"2023-11-27T17:49:11.788334+0000","last_undegraded":"2023-11-27T17:49:11.788334+0000","last_fullsized":"2023-11-27T17:49:11.788334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:10:37.890409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785615+0000","last_change":"2023-11-27T17:49:11.786688+0000","last_active":"2023-11-27T17:49:12.785615+0000","last_peered":"2023-11-27T17:49:12.785615+0000","last_clean":"2023-11-27T17:49:12.785615+0000","last_became_active":"2023-11-27T17:49:11.785576+0000","last_became_peered":"2023-11-27T17:49:11.785576+0000","last_unstale":"2023-11-27T17:49:12.785615+0000","last_undegraded":"2023-11-27T17:49:12.785615+0000","last_fullsized":"2023-11-27T17:49:12.785615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:10.562789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.798226+0000","last_change":"2023-11-27T17:49:10.778094+0000","last_active":"2023-11-27T17:49:11.798226+0000","last_peered":"2023-11-27T17:49:11.798226+0000","last_clean":"2023-11-27T17:49:11.798226+0000","last_became_active":"2023-11-27T17:49:10.777823+0000","last_became_peered":"2023-11-27T17:49:10.777823+0000","last_unstale":"2023-11-27T17:49:11.798226+0000","last_undegraded":"2023-11-27T17:49:11.798226+0000","last_fullsized":"2023-11-27T17:49:11.798226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:47.407443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785578+0000","last_change":"2023-11-27T17:49:11.796504+0000","last_active":"2023-11-27T17:49:12.785578+0000","last_peered":"2023-11-27T17:49:12.785578+0000","last_clean":"2023-11-27T17:49:12.785578+0000","last_became_active":"2023-11-27T17:49:11.795985+0000","last_became_peered":"2023-11-27T17:49:11.795985+0000","last_unstale":"2023-11-27T17:49:12.785578+0000","last_undegraded":"2023-11-27T17:49:12.785578+0000","last_fullsized":"2023-11-27T17:49:12.785578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:18.765889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.797876+0000","last_change":"2023-11-27T17:49:10.779711+0000","last_active":"2023-11-27T17:49:11.797876+0000","last_peered":"2023-11-27T17:49:11.797876+0000","last_clean":"2023-11-27T17:49:11.797876+0000","last_became_active":"2023-11-27T17:49:10.779418+0000","last_became_peered":"2023-11-27T17:49:10.779418+0000","last_unstale":"2023-11-27T17:49:11.797876+0000","last_undegraded":"2023-11-27T17:49:11.797876+0000","last_fullsized":"2023-11-27T17:49:11.797876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:44:39.615894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028647+0000","last_change":"2023-11-27T17:49:11.787449+0000","last_active":"2023-11-27T17:49:13.028647+0000","last_peered":"2023-11-27T17:49:13.028647+0000","last_clean":"2023-11-27T17:49:13.028647+0000","last_became_active":"2023-11-27T17:49:11.787142+0000","last_became_peered":"2023-11-27T17:49:11.787142+0000","last_unstale":"2023-11-27T17:49:13.028647+0000","last_undegraded":"2023-11-27T17:49:13.028647+0000","last_fullsized":"2023-11-27T17:49:13.028647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:18:02.419567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.790905+0000","last_change":"2023-11-27T17:49:10.773591+0000","last_active":"2023-11-27T17:49:11.790905+0000","last_peered":"2023-11-27T17:49:11.790905+0000","last_clean":"2023-11-27T17:49:11.790905+0000","last_became_active":"2023-11-27T17:49:10.772599+0000","last_became_peered":"2023-11-27T17:49:10.772599+0000","last_unstale":"2023-11-27T17:49:11.790905+0000","last_undegraded":"2023-11-27T17:49:11.790905+0000","last_fullsized":"2023-11-27T17:49:11.790905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:31:28.240486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028850+0000","last_change":"2023-11-27T17:49:11.790280+0000","last_active":"2023-11-27T17:49:13.028850+0000","last_peered":"2023-11-27T17:49:13.028850+0000","last_clean":"2023-11-27T17:49:13.028850+0000","last_became_active":"2023-11-27T17:49:11.789930+0000","last_became_peered":"2023-11-27T17:49:11.789930+0000","last_unstale":"2023-11-27T17:49:13.028850+0000","last_undegraded":"2023-11-27T17:49:13.028850+0000","last_fullsized":"2023-11-27T17:49:13.028850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:18:02.419567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.790932+0000","last_change":"2023-11-27T17:49:10.773472+0000","last_active":"2023-11-27T17:49:11.790932+0000","last_peered":"2023-11-27T17:49:11.790932+0000","last_clean":"2023-11-27T17:49:11.790932+0000","last_became_active":"2023-11-27T17:49:10.773184+0000","last_became_peered":"2023-11-27T17:49:10.773184+0000","last_unstale":"2023-11-27T17:49:11.790932+0000","last_undegraded":"2023-11-27T17:49:11.790932+0000","last_fullsized":"2023-11-27T17:49:11.790932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:21.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785853+0000","last_change":"2023-11-27T17:49:11.777183+0000","last_active":"2023-11-27T17:49:12.785853+0000","last_peered":"2023-11-27T17:49:12.785853+0000","last_clean":"2023-11-27T17:49:12.785853+0000","last_became_active":"2023-11-27T17:49:11.776898+0000","last_became_peered":"2023-11-27T17:49:11.776898+0000","last_unstale":"2023-11-27T17:49:12.785853+0000","last_undegraded":"2023-11-27T17:49:12.785853+0000","last_fullsized":"2023-11-27T17:49:12.785853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:35.672002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.768221+0000","last_change":"2023-11-27T17:49:10.784886+0000","last_active":"2023-11-27T17:49:11.768221+0000","last_peered":"2023-11-27T17:49:11.768221+0000","last_clean":"2023-11-27T17:49:11.768221+0000","last_became_active":"2023-11-27T17:49:10.784604+0000","last_became_peered":"2023-11-27T17:49:10.784604+0000","last_unstale":"2023-11-27T17:49:11.768221+0000","last_undegraded":"2023-11-27T17:49:11.768221+0000","last_fullsized":"2023-11-27T17:49:11.768221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:33.582615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785016+0000","last_change":"2023-11-27T17:49:11.787111+0000","last_active":"2023-11-27T17:49:12.785016+0000","last_peered":"2023-11-27T17:49:12.785016+0000","last_clean":"2023-11-27T17:49:12.785016+0000","last_became_active":"2023-11-27T17:49:11.786864+0000","last_became_peered":"2023-11-27T17:49:11.786864+0000","last_unstale":"2023-11-27T17:49:12.785016+0000","last_undegraded":"2023-11-27T17:49:12.785016+0000","last_fullsized":"2023-11-27T17:49:12.785016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:02:35.207902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.768533+0000","last_change":"2023-11-27T17:49:10.779088+0000","last_active":"2023-11-27T17:49:11.768533+0000","last_peered":"2023-11-27T17:49:11.768533+0000","last_clean":"2023-11-27T17:49:11.768533+0000","last_became_active":"2023-11-27T17:49:10.778801+0000","last_became_peered":"2023-11-27T17:49:10.778801+0000","last_unstale":"2023-11-27T17:49:11.768533+0000","last_undegraded":"2023-11-27T17:49:11.768533+0000","last_fullsized":"2023-11-27T17:49:11.768533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:22.229090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029088+0000","last_change":"2023-11-27T17:49:11.791541+0000","last_active":"2023-11-27T17:49:13.029088+0000","last_peered":"2023-11-27T17:49:13.029088+0000","last_clean":"2023-11-27T17:49:13.029088+0000","last_became_active":"2023-11-27T17:49:11.791245+0000","last_became_peered":"2023-11-27T17:49:11.791245+0000","last_unstale":"2023-11-27T17:49:13.029088+0000","last_undegraded":"2023-11-27T17:49:13.029088+0000","last_fullsized":"2023-11-27T17:49:13.029088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:29:55.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.769967+0000","last_change":"2023-11-27T17:49:10.783149+0000","last_active":"2023-11-27T17:49:11.769967+0000","last_peered":"2023-11-27T17:49:11.769967+0000","last_clean":"2023-11-27T17:49:11.769967+0000","last_became_active":"2023-11-27T17:49:10.782905+0000","last_became_peered":"2023-11-27T17:49:10.782905+0000","last_unstale":"2023-11-27T17:49:11.769967+0000","last_undegraded":"2023-11-27T17:49:11.769967+0000","last_fullsized":"2023-11-27T17:49:11.769967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:22:28.470886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028174+0000","last_change":"2023-11-27T17:49:11.796432+0000","last_active":"2023-11-27T17:49:13.028174+0000","last_peered":"2023-11-27T17:49:13.028174+0000","last_clean":"2023-11-27T17:49:13.028174+0000","last_became_active":"2023-11-27T17:49:11.795534+0000","last_became_peered":"2023-11-27T17:49:11.795534+0000","last_unstale":"2023-11-27T17:49:13.028174+0000","last_undegraded":"2023-11-27T17:49:13.028174+0000","last_fullsized":"2023-11-27T17:49:13.028174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:02:31.422070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.775906+0000","last_change":"2023-11-27T17:49:10.774400+0000","last_active":"2023-11-27T17:49:11.775906+0000","last_peered":"2023-11-27T17:49:11.775906+0000","last_clean":"2023-11-27T17:49:11.775906+0000","last_became_active":"2023-11-27T17:49:10.774111+0000","last_became_peered":"2023-11-27T17:49:10.774111+0000","last_unstale":"2023-11-27T17:49:11.775906+0000","last_undegraded":"2023-11-27T17:49:11.775906+0000","last_fullsized":"2023-11-27T17:49:11.775906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:31:28.240486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028040+0000","last_change":"2023-11-27T17:49:11.778825+0000","last_active":"2023-11-27T17:49:13.028040+0000","last_peered":"2023-11-27T17:49:13.028040+0000","last_clean":"2023-11-27T17:49:13.028040+0000","last_became_active":"2023-11-27T17:49:11.778535+0000","last_became_peered":"2023-11-27T17:49:11.778535+0000","last_unstale":"2023-11-27T17:49:13.028040+0000","last_undegraded":"2023-11-27T17:49:13.028040+0000","last_fullsized":"2023-11-27T17:49:13.028040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:23:24.460806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.792608+0000","last_change":"2023-11-27T17:49:10.782746+0000","last_active":"2023-11-27T17:49:11.792608+0000","last_peered":"2023-11-27T17:49:11.792608+0000","last_clean":"2023-11-27T17:49:11.792608+0000","last_became_active":"2023-11-27T17:49:10.782490+0000","last_became_peered":"2023-11-27T17:49:10.782490+0000","last_unstale":"2023-11-27T17:49:11.792608+0000","last_undegraded":"2023-11-27T17:49:11.792608+0000","last_fullsized":"2023-11-27T17:49:11.792608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:34.669802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029360+0000","last_change":"2023-11-27T17:49:11.796472+0000","last_active":"2023-11-27T17:49:13.029360+0000","last_peered":"2023-11-27T17:49:13.029360+0000","last_clean":"2023-11-27T17:49:13.029360+0000","last_became_active":"2023-11-27T17:49:11.796211+0000","last_became_peered":"2023-11-27T17:49:11.796211+0000","last_unstale":"2023-11-27T17:49:13.029360+0000","last_undegraded":"2023-11-27T17:49:13.029360+0000","last_fullsized":"2023-11-27T17:49:13.029360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:52.479589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.803418+0000","last_change":"2023-11-27T17:49:10.778021+0000","last_active":"2023-11-27T17:49:11.803418+0000","last_peered":"2023-11-27T17:49:11.803418+0000","last_clean":"2023-11-27T17:49:11.803418+0000","last_became_active":"2023-11-27T17:49:10.777713+0000","last_became_peered":"2023-11-27T17:49:10.777713+0000","last_unstale":"2023-11-27T17:49:11.803418+0000","last_undegraded":"2023-11-27T17:49:11.803418+0000","last_fullsized":"2023-11-27T17:49:11.803418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:49.190489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785243+0000","last_change":"2023-11-27T17:49:11.794234+0000","last_active":"2023-11-27T17:49:12.785243+0000","last_peered":"2023-11-27T17:49:12.785243+0000","last_clean":"2023-11-27T17:49:12.785243+0000","last_became_active":"2023-11-27T17:49:11.793955+0000","last_became_peered":"2023-11-27T17:49:11.793955+0000","last_unstale":"2023-11-27T17:49:12.785243+0000","last_undegraded":"2023-11-27T17:49:12.785243+0000","last_fullsized":"2023-11-27T17:49:12.785243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:35.672002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.791387+0000","last_change":"2023-11-27T17:49:10.782154+0000","last_active":"2023-11-27T17:49:11.791387+0000","last_peered":"2023-11-27T17:49:11.791387+0000","last_clean":"2023-11-27T17:49:11.791387+0000","last_became_active":"2023-11-27T17:49:10.781780+0000","last_became_peered":"2023-11-27T17:49:10.781780+0000","last_unstale":"2023-11-27T17:49:11.791387+0000","last_undegraded":"2023-11-27T17:49:11.791387+0000","last_fullsized":"2023-11-27T17:49:11.791387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:42:34.026210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027896+0000","last_change":"2023-11-27T17:49:11.784380+0000","last_active":"2023-11-27T17:49:13.027896+0000","last_peered":"2023-11-27T17:49:13.027896+0000","last_clean":"2023-11-27T17:49:13.027896+0000","last_became_active":"2023-11-27T17:49:11.784115+0000","last_became_peered":"2023-11-27T17:49:11.784115+0000","last_unstale":"2023-11-27T17:49:13.027896+0000","last_undegraded":"2023-11-27T17:49:13.027896+0000","last_fullsized":"2023-11-27T17:49:13.027896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:25.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785331+0000","last_change":"2023-11-27T17:49:10.782073+0000","last_active":"2023-11-27T17:49:12.785331+0000","last_peered":"2023-11-27T17:49:12.785331+0000","last_clean":"2023-11-27T17:49:12.785331+0000","last_became_active":"2023-11-27T17:49:10.781708+0000","last_became_peered":"2023-11-27T17:49:10.781708+0000","last_unstale":"2023-11-27T17:49:12.785331+0000","last_undegraded":"2023-11-27T17:49:12.785331+0000","last_fullsized":"2023-11-27T17:49:12.785331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:31:28.240486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028833+0000","last_change":"2023-11-27T17:49:11.787215+0000","last_active":"2023-11-27T17:49:13.028833+0000","last_peered":"2023-11-27T17:49:13.028833+0000","last_clean":"2023-11-27T17:49:13.028833+0000","last_became_active":"2023-11-27T17:49:11.785778+0000","last_became_peered":"2023-11-27T17:49:11.785778+0000","last_unstale":"2023-11-27T17:49:13.028833+0000","last_undegraded":"2023-11-27T17:49:13.028833+0000","last_fullsized":"2023-11-27T17:49:13.028833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:22:29.473085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.768369+0000","last_change":"2023-11-27T17:49:10.783166+0000","last_active":"2023-11-27T17:49:11.768369+0000","last_peered":"2023-11-27T17:49:11.768369+0000","last_clean":"2023-11-27T17:49:11.768369+0000","last_became_active":"2023-11-27T17:49:10.782859+0000","last_became_peered":"2023-11-27T17:49:10.782859+0000","last_unstale":"2023-11-27T17:49:11.768369+0000","last_undegraded":"2023-11-27T17:49:11.768369+0000","last_fullsized":"2023-11-27T17:49:11.768369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:42:34.026210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029547+0000","last_change":"2023-11-27T17:49:11.789007+0000","last_active":"2023-11-27T17:49:13.029547+0000","last_peered":"2023-11-27T17:49:13.029547+0000","last_clean":"2023-11-27T17:49:13.029547+0000","last_became_active":"2023-11-27T17:49:11.788280+0000","last_became_peered":"2023-11-27T17:49:11.788280+0000","last_unstale":"2023-11-27T17:49:13.029547+0000","last_undegraded":"2023-11-27T17:49:13.029547+0000","last_fullsized":"2023-11-27T17:49:13.029547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:34.584815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.798278+0000","last_change":"2023-11-27T17:49:10.778591+0000","last_active":"2023-11-27T17:49:11.798278+0000","last_peered":"2023-11-27T17:49:11.798278+0000","last_clean":"2023-11-27T17:49:11.798278+0000","last_became_active":"2023-11-27T17:49:10.778312+0000","last_became_peered":"2023-11-27T17:49:10.778312+0000","last_unstale":"2023-11-27T17:49:11.798278+0000","last_undegraded":"2023-11-27T17:49:11.798278+0000","last_fullsized":"2023-11-27T17:49:11.798278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:02:34.205702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786111+0000","last_change":"2023-11-27T17:49:11.780320+0000","last_active":"2023-11-27T17:49:12.786111+0000","last_peered":"2023-11-27T17:49:12.786111+0000","last_clean":"2023-11-27T17:49:12.786111+0000","last_became_active":"2023-11-27T17:49:11.779991+0000","last_became_peered":"2023-11-27T17:49:11.779991+0000","last_unstale":"2023-11-27T17:49:12.786111+0000","last_undegraded":"2023-11-27T17:49:12.786111+0000","last_fullsized":"2023-11-27T17:49:12.786111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:48.409642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785284+0000","last_change":"2023-11-27T17:49:10.775791+0000","last_active":"2023-11-27T17:49:12.785284+0000","last_peered":"2023-11-27T17:49:12.785284+0000","last_clean":"2023-11-27T17:49:12.785284+0000","last_became_active":"2023-11-27T17:49:10.775493+0000","last_became_peered":"2023-11-27T17:49:10.775493+0000","last_unstale":"2023-11-27T17:49:12.785284+0000","last_undegraded":"2023-11-27T17:49:12.785284+0000","last_fullsized":"2023-11-27T17:49:12.785284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:47.249922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029284+0000","last_change":"2023-11-27T17:49:11.789819+0000","last_active":"2023-11-27T17:49:13.029284+0000","last_peered":"2023-11-27T17:49:13.029284+0000","last_clean":"2023-11-27T17:49:13.029284+0000","last_became_active":"2023-11-27T17:49:11.789531+0000","last_became_peered":"2023-11-27T17:49:11.789531+0000","last_unstale":"2023-11-27T17:49:13.029284+0000","last_undegraded":"2023-11-27T17:49:13.029284+0000","last_fullsized":"2023-11-27T17:49:13.029284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:25.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.791873+0000","last_change":"2023-11-27T17:49:10.781994+0000","last_active":"2023-11-27T17:49:11.791873+0000","last_peered":"2023-11-27T17:49:11.791873+0000","last_clean":"2023-11-27T17:49:11.791873+0000","last_became_active":"2023-11-27T17:49:10.781672+0000","last_became_peered":"2023-11-27T17:49:10.781672+0000","last_unstale":"2023-11-27T17:49:11.791873+0000","last_undegraded":"2023-11-27T17:49:11.791873+0000","last_fullsized":"2023-11-27T17:49:11.791873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:22.873053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785213+0000","last_change":"2023-11-27T17:49:11.794775+0000","last_active":"2023-11-27T17:49:12.785213+0000","last_peered":"2023-11-27T17:49:12.785213+0000","last_clean":"2023-11-27T17:49:12.785213+0000","last_became_active":"2023-11-27T17:49:11.794542+0000","last_became_peered":"2023-11-27T17:49:11.794542+0000","last_unstale":"2023-11-27T17:49:12.785213+0000","last_undegraded":"2023-11-27T17:49:12.785213+0000","last_fullsized":"2023-11-27T17:49:12.785213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:32:29.678284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.784666+0000","last_change":"2023-11-27T17:49:10.775527+0000","last_active":"2023-11-27T17:49:11.784666+0000","last_peered":"2023-11-27T17:49:11.784666+0000","last_clean":"2023-11-27T17:49:11.784666+0000","last_became_active":"2023-11-27T17:49:10.775260+0000","last_became_peered":"2023-11-27T17:49:10.775260+0000","last_unstale":"2023-11-27T17:49:11.784666+0000","last_undegraded":"2023-11-27T17:49:11.784666+0000","last_fullsized":"2023-11-27T17:49:11.784666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:43:56.673453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815550+0000","last_change":"2023-11-27T17:49:11.780494+0000","last_active":"2023-11-27T17:49:12.815550+0000","last_peered":"2023-11-27T17:49:12.815550+0000","last_clean":"2023-11-27T17:49:12.815550+0000","last_became_active":"2023-11-27T17:49:11.779131+0000","last_became_peered":"2023-11-27T17:49:11.779131+0000","last_unstale":"2023-11-27T17:49:12.815550+0000","last_undegraded":"2023-11-27T17:49:12.815550+0000","last_fullsized":"2023-11-27T17:49:12.815550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:16:47.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.770107+0000","last_change":"2023-11-27T17:49:10.778336+0000","last_active":"2023-11-27T17:49:11.770107+0000","last_peered":"2023-11-27T17:49:11.770107+0000","last_clean":"2023-11-27T17:49:11.770107+0000","last_became_active":"2023-11-27T17:49:10.777973+0000","last_became_peered":"2023-11-27T17:49:10.777973+0000","last_unstale":"2023-11-27T17:49:11.770107+0000","last_undegraded":"2023-11-27T17:49:11.770107+0000","last_fullsized":"2023-11-27T17:49:11.770107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:08:58.597735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815474+0000","last_change":"2023-11-27T17:49:11.787985+0000","last_active":"2023-11-27T17:49:12.815474+0000","last_peered":"2023-11-27T17:49:12.815474+0000","last_clean":"2023-11-27T17:49:12.815474+0000","last_became_active":"2023-11-27T17:49:11.787479+0000","last_became_peered":"2023-11-27T17:49:11.787479+0000","last_unstale":"2023-11-27T17:49:12.815474+0000","last_undegraded":"2023-11-27T17:49:12.815474+0000","last_fullsized":"2023-11-27T17:49:12.815474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:23.231290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.800964+0000","last_change":"2023-11-27T17:49:10.776352+0000","last_active":"2023-11-27T17:49:11.800964+0000","last_peered":"2023-11-27T17:49:11.800964+0000","last_clean":"2023-11-27T17:49:11.800964+0000","last_became_active":"2023-11-27T17:49:10.776045+0000","last_became_peered":"2023-11-27T17:49:10.776045+0000","last_unstale":"2023-11-27T17:49:11.800964+0000","last_undegraded":"2023-11-27T17:49:11.800964+0000","last_fullsized":"2023-11-27T17:49:11.800964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:33.582615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815502+0000","last_change":"2023-11-27T17:49:11.787196+0000","last_active":"2023-11-27T17:49:12.815502+0000","last_peered":"2023-11-27T17:49:12.815502+0000","last_clean":"2023-11-27T17:49:12.815502+0000","last_became_active":"2023-11-27T17:49:11.785165+0000","last_became_peered":"2023-11-27T17:49:11.785165+0000","last_unstale":"2023-11-27T17:49:12.815502+0000","last_undegraded":"2023-11-27T17:49:12.815502+0000","last_fullsized":"2023-11-27T17:49:12.815502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:45.974646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.777981+0000","last_change":"2023-11-27T17:49:10.784514+0000","last_active":"2023-11-27T17:49:11.777981+0000","last_peered":"2023-11-27T17:49:11.777981+0000","last_clean":"2023-11-27T17:49:11.777981+0000","last_became_active":"2023-11-27T17:49:10.784237+0000","last_became_peered":"2023-11-27T17:49:10.784237+0000","last_unstale":"2023-11-27T17:49:11.777981+0000","last_undegraded":"2023-11-27T17:49:11.777981+0000","last_fullsized":"2023-11-27T17:49:11.777981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:21.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815670+0000","last_change":"2023-11-27T17:49:11.784738+0000","last_active":"2023-11-27T17:49:12.815670+0000","last_peered":"2023-11-27T17:49:12.815670+0000","last_clean":"2023-11-27T17:49:12.815670+0000","last_became_active":"2023-11-27T17:49:11.784492+0000","last_became_peered":"2023-11-27T17:49:11.784492+0000","last_unstale":"2023-11-27T17:49:12.815670+0000","last_undegraded":"2023-11-27T17:49:12.815670+0000","last_fullsized":"2023-11-27T17:49:12.815670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:22.508957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.768807+0000","last_change":"2023-11-27T17:49:10.778006+0000","last_active":"2023-11-27T17:49:11.768807+0000","last_peered":"2023-11-27T17:49:11.768807+0000","last_clean":"2023-11-27T17:49:11.768807+0000","last_became_active":"2023-11-27T17:49:10.777681+0000","last_became_peered":"2023-11-27T17:49:10.777681+0000","last_unstale":"2023-11-27T17:49:11.768807+0000","last_undegraded":"2023-11-27T17:49:11.768807+0000","last_fullsized":"2023-11-27T17:49:11.768807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:44.972447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029162+0000","last_change":"2023-11-27T17:49:11.787049+0000","last_active":"2023-11-27T17:49:13.029162+0000","last_peered":"2023-11-27T17:49:13.029162+0000","last_clean":"2023-11-27T17:49:13.029162+0000","last_became_active":"2023-11-27T17:49:11.785596+0000","last_became_peered":"2023-11-27T17:49:11.785596+0000","last_unstale":"2023-11-27T17:49:13.029162+0000","last_undegraded":"2023-11-27T17:49:13.029162+0000","last_fullsized":"2023-11-27T17:49:13.029162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:41.741265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.776683+0000","last_change":"2023-11-27T17:49:10.782683+0000","last_active":"2023-11-27T17:49:11.776683+0000","last_peered":"2023-11-27T17:49:11.776683+0000","last_clean":"2023-11-27T17:49:11.776683+0000","last_became_active":"2023-11-27T17:49:10.782398+0000","last_became_peered":"2023-11-27T17:49:10.782398+0000","last_unstale":"2023-11-27T17:49:11.776683+0000","last_undegraded":"2023-11-27T17:49:11.776683+0000","last_fullsized":"2023-11-27T17:49:11.776683+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:32:28.676085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815586+0000","last_change":"2023-11-27T17:49:11.782223+0000","last_active":"2023-11-27T17:49:12.815586+0000","last_peered":"2023-11-27T17:49:12.815586+0000","last_clean":"2023-11-27T17:49:12.815586+0000","last_became_active":"2023-11-27T17:49:11.781954+0000","last_became_peered":"2023-11-27T17:49:11.781954+0000","last_unstale":"2023-11-27T17:49:12.815586+0000","last_undegraded":"2023-11-27T17:49:12.815586+0000","last_fullsized":"2023-11-27T17:49:12.815586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:14:42.333151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785159+0000","last_change":"2023-11-27T17:49:10.780937+0000","last_active":"2023-11-27T17:49:12.785159+0000","last_peered":"2023-11-27T17:49:12.785159+0000","last_clean":"2023-11-27T17:49:12.785159+0000","last_became_active":"2023-11-27T17:49:10.780645+0000","last_became_peered":"2023-11-27T17:49:10.780645+0000","last_unstale":"2023-11-27T17:49:12.785159+0000","last_undegraded":"2023-11-27T17:49:12.785159+0000","last_fullsized":"2023-11-27T17:49:12.785159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:49.190489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029732+0000","last_change":"2023-11-27T17:49:11.801293+0000","last_active":"2023-11-27T17:49:13.029732+0000","last_peered":"2023-11-27T17:49:13.029732+0000","last_clean":"2023-11-27T17:49:13.029732+0000","last_became_active":"2023-11-27T17:49:11.801010+0000","last_became_peered":"2023-11-27T17:49:11.801010+0000","last_unstale":"2023-11-27T17:49:13.029732+0000","last_undegraded":"2023-11-27T17:49:13.029732+0000","last_fullsized":"2023-11-27T17:49:13.029732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:41.741265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786955+0000","last_change":"2023-11-27T17:49:10.780245+0000","last_active":"2023-11-27T17:49:12.786955+0000","last_peered":"2023-11-27T17:49:12.786955+0000","last_clean":"2023-11-27T17:49:12.786955+0000","last_became_active":"2023-11-27T17:49:10.779835+0000","last_became_peered":"2023-11-27T17:49:10.779835+0000","last_unstale":"2023-11-27T17:49:12.786955+0000","last_undegraded":"2023-11-27T17:49:12.786955+0000","last_fullsized":"2023-11-27T17:49:12.786955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:42:34.026210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786544+0000","last_change":"2023-11-27T17:49:11.797811+0000","last_active":"2023-11-27T17:49:12.786544+0000","last_peered":"2023-11-27T17:49:12.786544+0000","last_clean":"2023-11-27T17:49:12.786544+0000","last_became_active":"2023-11-27T17:49:11.797534+0000","last_became_peered":"2023-11-27T17:49:11.797534+0000","last_unstale":"2023-11-27T17:49:12.786544+0000","last_undegraded":"2023-11-27T17:49:12.786544+0000","last_fullsized":"2023-11-27T17:49:12.786544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:50.192689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785293+0000","last_change":"2023-11-27T17:49:10.782302+0000","last_active":"2023-11-27T17:49:12.785293+0000","last_peered":"2023-11-27T17:49:12.785293+0000","last_clean":"2023-11-27T17:49:12.785293+0000","last_became_active":"2023-11-27T17:49:10.782038+0000","last_became_peered":"2023-11-27T17:49:10.782038+0000","last_unstale":"2023-11-27T17:49:12.785293+0000","last_undegraded":"2023-11-27T17:49:12.785293+0000","last_fullsized":"2023-11-27T17:49:12.785293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:33.582615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029520+0000","last_change":"2023-11-27T17:49:11.784928+0000","last_active":"2023-11-27T17:49:13.029520+0000","last_peered":"2023-11-27T17:49:13.029520+0000","last_clean":"2023-11-27T17:49:13.029520+0000","last_became_active":"2023-11-27T17:49:11.784216+0000","last_became_peered":"2023-11-27T17:49:11.784216+0000","last_unstale":"2023-11-27T17:49:13.029520+0000","last_undegraded":"2023-11-27T17:49:13.029520+0000","last_fullsized":"2023-11-27T17:49:13.029520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:08:59.599935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.775811+0000","last_change":"2023-11-27T17:49:10.780243+0000","last_active":"2023-11-27T17:49:11.775811+0000","last_peered":"2023-11-27T17:49:11.775811+0000","last_clean":"2023-11-27T17:49:11.775811+0000","last_became_active":"2023-11-27T17:49:10.779813+0000","last_became_peered":"2023-11-27T17:49:10.779813+0000","last_unstale":"2023-11-27T17:49:11.775811+0000","last_undegraded":"2023-11-27T17:49:11.775811+0000","last_fullsized":"2023-11-27T17:49:11.775811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:08:58.597735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786442+0000","last_change":"2023-11-27T17:49:11.786416+0000","last_active":"2023-11-27T17:49:12.786442+0000","last_peered":"2023-11-27T17:49:12.786442+0000","last_clean":"2023-11-27T17:49:12.786442+0000","last_became_active":"2023-11-27T17:49:11.786121+0000","last_became_peered":"2023-11-27T17:49:11.786121+0000","last_unstale":"2023-11-27T17:49:12.786442+0000","last_undegraded":"2023-11-27T17:49:12.786442+0000","last_fullsized":"2023-11-27T17:49:12.786442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:48.252121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785419+0000","last_change":"2023-11-27T17:49:10.778520+0000","last_active":"2023-11-27T17:49:12.785419+0000","last_peered":"2023-11-27T17:49:12.785419+0000","last_clean":"2023-11-27T17:49:12.785419+0000","last_became_active":"2023-11-27T17:49:10.778228+0000","last_became_peered":"2023-11-27T17:49:10.778228+0000","last_unstale":"2023-11-27T17:49:12.785419+0000","last_undegraded":"2023-11-27T17:49:12.785419+0000","last_fullsized":"2023-11-27T17:49:12.785419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:22.873053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027722+0000","last_change":"2023-11-27T17:49:11.789077+0000","last_active":"2023-11-27T17:49:13.027722+0000","last_peered":"2023-11-27T17:49:13.027722+0000","last_clean":"2023-11-27T17:49:13.027722+0000","last_became_active":"2023-11-27T17:49:11.788786+0000","last_became_peered":"2023-11-27T17:49:11.788786+0000","last_unstale":"2023-11-27T17:49:13.027722+0000","last_undegraded":"2023-11-27T17:49:13.027722+0000","last_fullsized":"2023-11-27T17:49:13.027722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:50.396975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.771013+0000","last_change":"2023-11-27T17:49:10.781488+0000","last_active":"2023-11-27T17:49:11.771013+0000","last_peered":"2023-11-27T17:49:11.771013+0000","last_clean":"2023-11-27T17:49:11.771013+0000","last_became_active":"2023-11-27T17:49:10.780865+0000","last_became_peered":"2023-11-27T17:49:10.780865+0000","last_unstale":"2023-11-27T17:49:11.771013+0000","last_undegraded":"2023-11-27T17:49:11.771013+0000","last_fullsized":"2023-11-27T17:49:11.771013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:47.249922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785356+0000","last_change":"2023-11-27T17:49:11.782683+0000","last_active":"2023-11-27T17:49:12.785356+0000","last_peered":"2023-11-27T17:49:12.785356+0000","last_clean":"2023-11-27T17:49:12.785356+0000","last_became_active":"2023-11-27T17:49:11.782388+0000","last_became_peered":"2023-11-27T17:49:11.782388+0000","last_unstale":"2023-11-27T17:49:12.785356+0000","last_undegraded":"2023-11-27T17:49:12.785356+0000","last_fullsized":"2023-11-27T17:49:12.785356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:50.192689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.769119+0000","last_change":"2023-11-27T17:49:10.783469+0000","last_active":"2023-11-27T17:49:11.769119+0000","last_peered":"2023-11-27T17:49:11.769119+0000","last_clean":"2023-11-27T17:49:11.769119+0000","last_became_active":"2023-11-27T17:49:10.783245+0000","last_became_peered":"2023-11-27T17:49:10.783245+0000","last_unstale":"2023-11-27T17:49:11.769119+0000","last_undegraded":"2023-11-27T17:49:11.769119+0000","last_fullsized":"2023-11-27T17:49:11.769119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:09.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028718+0000","last_change":"2023-11-27T17:49:11.784771+0000","last_active":"2023-11-27T17:49:13.028718+0000","last_peered":"2023-11-27T17:49:13.028718+0000","last_clean":"2023-11-27T17:49:13.028718+0000","last_became_active":"2023-11-27T17:49:11.784543+0000","last_became_peered":"2023-11-27T17:49:11.784543+0000","last_unstale":"2023-11-27T17:49:13.028718+0000","last_undegraded":"2023-11-27T17:49:13.028718+0000","last_fullsized":"2023-11-27T17:49:13.028718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:28.297452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.777376+0000","last_change":"2023-11-27T17:49:10.784466+0000","last_active":"2023-11-27T17:49:11.777376+0000","last_peered":"2023-11-27T17:49:11.777376+0000","last_clean":"2023-11-27T17:49:11.777376+0000","last_became_active":"2023-11-27T17:49:10.783698+0000","last_became_peered":"2023-11-27T17:49:10.783698+0000","last_unstale":"2023-11-27T17:49:11.777376+0000","last_undegraded":"2023-11-27T17:49:11.777376+0000","last_fullsized":"2023-11-27T17:49:11.777376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:43:56.673453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.769267+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:49:11.769267+0000","last_peered":"2023-11-27T17:49:11.769267+0000","last_clean":"2023-11-27T17:49:11.769267+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:49:11.769267+0000","last_undegraded":"2023-11-27T17:49:11.769267+0000","last_fullsized":"2023-11-27T17:49:11.769267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":734546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.372}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52600000000000002}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.432},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":144704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.625},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.45300000000000001}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.435},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.501}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":145722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.376}]},{"osd":2,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.317},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.35899999999999999}]},{"osd":3,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.33200000000000002}]},{"osd":4,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44600000000000001}]},{"osd":5,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52800000000000002}]},{"osd":6,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.41399999999999998}]},{"osd":7,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":734456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":8.0570000000000004,"5min":8.0570000000000004,"15min":8.0570000000000004},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.497},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.53300000000000003}]},{"osd":3,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":10.025,"5min":10.025,"15min":10.025},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78300000000000003}]},{"osd":5,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.84099999999999997}]},{"osd":6,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.874}]},{"osd":7,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":144158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":9.516,"5min":9.516,"15min":9.516},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.5990000000000002,"5min":3.5990000000000002,"15min":3.5990000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.375}]},{"osd":3,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.6459999999999999,"5min":3.6459999999999999,"15min":3.6459999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.32500000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.6859999999999999,"5min":3.6859999999999999,"15min":3.6859999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":145722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.317},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.57399999999999995}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":144192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.47199999999999998}]},{"osd":3,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":9.8960000000000008,"5min":9.8960000000000008,"15min":9.8960000000000008},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":9.875,"5min":9.875,"15min":9.875},"last":0.62}]},{"osd":5,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.434}]},{"osd":6,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40899999999999997}]},{"osd":7,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":144760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.501},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.437}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.624}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:49:20.193 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:49:20.196 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:49:20.440 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:49:20.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.570+0000 7fca9b0e7700 1 Processor -- start 2023-11-27T17:49:20.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.571+0000 7fca9b0e7700 1 -- start start 2023-11-27T17:49:20.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.571+0000 7fca9b0e7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94070c00 0x7fca94169010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.571+0000 7fca9b0e7700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca940b5ce0 con 0x7fca940b6170 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.571+0000 7fca9b0e7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca940b5700 con 0x7fca94147880 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.571+0000 7fca9b0e7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9406e020 con 0x7fca94070c00 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca93fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fca940b6170 0x7fca940704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47770/0 (socket says 172.21.15.177:47770) 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca93fff700 1 -- 172.21.15.177:0/3340091295 learned_addr learned my addr 172.21.15.177:0/3340091295 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca99684700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94070c00 0x7fca94169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663360402 0 0) 0x7fca940b5ce0 con 0x7fca940b6170 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca840035b0 con 0x7fca940b6170 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 <== mon.0 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939880893 0 0) 0x7fca840035b0 con 0x7fca940b6170 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94070c00 msgr2=0x7fca94169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94070c00 0x7fca94169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 >> v1:172.21.15.178:6789/0 conn(0x7fca94147880 legacy=0x7fca9406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9406e230 con 0x7fca940b6170 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 <== mon.0 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 954009178 0 0) 0x7fca80001670 con 0x7fca940b6170 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 >> v1:172.21.15.177:6789/0 conn(0x7fca940b6170 legacy=0x7fca940704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca84003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca84004850 0x7fca84004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94070c00 0x7fca84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9406e020 con 0x7fca84003a30 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8400baf0 con 0x7fca84004850 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8400bcb0 con 0x7fca94070c00 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca98e83700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca84003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca93fff700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca84004850 0x7fca84004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.572+0000 7fca99684700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94070c00 0x7fca84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca98e83700 1 -- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94070c00 msgr2=0x7fca84005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca98e83700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94070c00 0x7fca84005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca98e83700 1 -- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca84004850 msgr2=0x7fca84004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca98e83700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca84004850 0x7fca84004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca98e83700 1 -- 172.21.15.177:0/3340091295 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca840035b0 con 0x7fca84003a30 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca98e83700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca84003e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca88007fd0 tx=0x7fca84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80152085d5ed9e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880052d0 con 0x7fca84003a30 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca88005470 con 0x7fca84003a30 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca937fe700 1 -- 172.21.15.177:0/3340091295 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880038c0 con 0x7fca84003a30 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca9b0e7700 1 -- 172.21.15.177:0/3340091295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 msgr2=0x7fca84003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca9b0e7700 1 --2- 172.21.15.177:0/3340091295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca84003e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca88007fd0 tx=0x7fca84005880 comp rx=0 tx=0).stop 2023-11-27T17:49:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.573+0000 7fca99684700 1 -- 172.21.15.177:0/3340091295 reap_dead start 2023-11-27T17:49:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.574+0000 7fca9b0e7700 1 -- 172.21.15.177:0/3340091295 shutdown_connections 2023-11-27T17:49:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.574+0000 7fca9b0e7700 1 -- 172.21.15.177:0/3340091295 >> 172.21.15.177:0/3340091295 conn(0x7fca940b2130 msgr2=0x7fca940b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.574+0000 7fca9b0e7700 1 -- 172.21.15.177:0/3340091295 shutdown_connections 2023-11-27T17:49:20.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.574+0000 7fca9b0e7700 1 -- 172.21.15.177:0/3340091295 wait complete. 2023-11-27T17:49:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.575+0000 7fca9b0e7700 1 Processor -- start 2023-11-27T17:49:20.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.575+0000 7fca9b0e7700 1 -- start start 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca9b0e7700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca941f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca9b0e7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94145070 0x7fca941454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca9b0e7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca94133760 0x7fca94133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca9b0e7700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94135150 con 0x7fca84003a30 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca9b0e7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94145a30 con 0x7fca94133760 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca9b0e7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca941344d0 con 0x7fca94145070 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca941f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca941f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53462/0 (socket says 172.21.15.177:53462) 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 -- 172.21.15.177:0/1305863616 learned_addr learned my addr 172.21.15.177:0/1305863616 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca93fff700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94145070 0x7fca941454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 -- 172.21.15.177:0/1305863616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94145070 msgr2=0x7fca941454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94145070 0x7fca941454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 -- 172.21.15.177:0/1305863616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca94133760 msgr2=0x7fca94133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca94133760 0x7fca94133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 -- 172.21.15.177:0/1305863616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca941347b0 con 0x7fca84003a30 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca98e83700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca941f3320 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fca88004000 tx=0x7fca88001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca917fa700 1 -- 172.21.15.177:0/1305863616 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88007240 con 0x7fca84003a30 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca917fa700 1 -- 172.21.15.177:0/1305863616 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880073a0 con 0x7fca84003a30 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca94134a90 con 0x7fca84003a30 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca917fa700 1 -- 172.21.15.177:0/1305863616 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88001290 con 0x7fca84003a30 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.576+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca941f3860 con 0x7fca84003a30 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.578+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca94073aa0 con 0x7fca84003a30 2023-11-27T17:49:20.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.578+0000 7fca917fa700 1 -- 172.21.15.177:0/1305863616 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fca88003680 con 0x7fca84003a30 2023-11-27T17:49:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.578+0000 7fca917fa700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fca7806b250 0x7fca7806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.578+0000 7fca93fff700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fca7806b250 0x7fca7806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.578+0000 7fca917fa700 1 -- 172.21.15.177:0/1305863616 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca8808a5f0 con 0x7fca84003a30 2023-11-27T17:49:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.579+0000 7fca93fff700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fca7806b250 0x7fca7806d710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca940b28e0 tx=0x7fca80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:20.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.583+0000 7fca917fa700 1 -- 172.21.15.177:0/1305863616 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fca880554d0 con 0x7fca84003a30 2023-11-27T17:49:20.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.770+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 --> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca9406e510 con 0x7fca7806b250 2023-11-27T17:49:20.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.778+0000 7fca917fa700 1 -- 172.21.15.177:0/1305863616 <== mgr.4100 v2:172.21.15.177:6832/2467053977 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288994 (secure 0 0 0) 0x7fca80004d90 con 0x7fca7806b250 2023-11-27T17:49:20.783 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:20.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fca7806b250 msgr2=0x7fca7806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fca7806b250 0x7fca7806d710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca940b28e0 tx=0x7fca80009040 comp rx=0 tx=0).stop 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 msgr2=0x7fca941f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca941f3320 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fca88004000 tx=0x7fca88001120 comp rx=0 tx=0).stop 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 shutdown_connections 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7fca7806b250 0x7fca7806d710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca94133760 0x7fca94133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca84003a30 0x7fca941f3320 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 --2- 172.21.15.177:0/1305863616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca94145070 0x7fca941454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 >> 172.21.15.177:0/1305863616 conn(0x7fca940b2130 msgr2=0x7fca940b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 shutdown_connections 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.781+0000 7fca9b0e7700 1 -- 172.21.15.177:0/1305863616 wait complete. 2023-11-27T17:49:20.786 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-11-27T17:49:20.795 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-11-27T17:49:20.633134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220332,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754388,"statfs":{"total":773094113280,"available":772868493312,"internally_reserved":0,"allocated":4235264,"data_stored":2338260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.867088"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029745+0000","last_change":"2023-11-27T17:49:11.782705+0000","last_active":"2023-11-27T17:49:13.029745+0000","last_peered":"2023-11-27T17:49:13.029745+0000","last_clean":"2023-11-27T17:49:13.029745+0000","last_became_active":"2023-11-27T17:49:11.782476+0000","last_became_peered":"2023-11-27T17:49:11.782476+0000","last_unstale":"2023-11-27T17:49:13.029745+0000","last_undegraded":"2023-11-27T17:49:13.029745+0000","last_fullsized":"2023-11-27T17:49:13.029745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:42:35.028409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028115+0000","last_change":"2023-11-27T17:49:11.784305+0000","last_active":"2023-11-27T17:49:13.028115+0000","last_peered":"2023-11-27T17:49:13.028115+0000","last_clean":"2023-11-27T17:49:13.028115+0000","last_became_active":"2023-11-27T17:49:11.784031+0000","last_became_peered":"2023-11-27T17:49:11.784031+0000","last_unstale":"2023-11-27T17:49:13.028115+0000","last_undegraded":"2023-11-27T17:49:13.028115+0000","last_fullsized":"2023-11-27T17:49:13.028115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:17:27.695296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029212+0000","last_change":"2023-11-27T17:49:11.801358+0000","last_active":"2023-11-27T17:49:13.029212+0000","last_peered":"2023-11-27T17:49:13.029212+0000","last_clean":"2023-11-27T17:49:13.029212+0000","last_became_active":"2023-11-27T17:49:11.801000+0000","last_became_peered":"2023-11-27T17:49:11.801000+0000","last_unstale":"2023-11-27T17:49:13.029212+0000","last_undegraded":"2023-11-27T17:49:13.029212+0000","last_fullsized":"2023-11-27T17:49:13.029212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:50.396975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.784998+0000","last_change":"2023-11-27T17:49:11.794888+0000","last_active":"2023-11-27T17:49:12.784998+0000","last_peered":"2023-11-27T17:49:12.784998+0000","last_clean":"2023-11-27T17:49:12.784998+0000","last_became_active":"2023-11-27T17:49:11.794627+0000","last_became_peered":"2023-11-27T17:49:11.794627+0000","last_unstale":"2023-11-27T17:49:12.784998+0000","last_undegraded":"2023-11-27T17:49:12.784998+0000","last_fullsized":"2023-11-27T17:49:12.784998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:49:47.270687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815471+0000","last_change":"2023-11-27T17:49:11.784941+0000","last_active":"2023-11-27T17:49:12.815471+0000","last_peered":"2023-11-27T17:49:12.815471+0000","last_clean":"2023-11-27T17:49:12.815471+0000","last_became_active":"2023-11-27T17:49:11.784646+0000","last_became_peered":"2023-11-27T17:49:11.784646+0000","last_unstale":"2023-11-27T17:49:12.815471+0000","last_undegraded":"2023-11-27T17:49:12.815471+0000","last_fullsized":"2023-11-27T17:49:12.815471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:47:10.098471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027999+0000","last_change":"2023-11-27T17:49:11.782220+0000","last_active":"2023-11-27T17:49:13.027999+0000","last_peered":"2023-11-27T17:49:13.027999+0000","last_clean":"2023-11-27T17:49:13.027999+0000","last_became_active":"2023-11-27T17:49:11.781938+0000","last_became_peered":"2023-11-27T17:49:11.781938+0000","last_unstale":"2023-11-27T17:49:13.027999+0000","last_undegraded":"2023-11-27T17:49:13.027999+0000","last_fullsized":"2023-11-27T17:49:13.027999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:34:54.213596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029030+0000","last_change":"2023-11-27T17:49:11.787652+0000","last_active":"2023-11-27T17:49:13.029030+0000","last_peered":"2023-11-27T17:49:13.029030+0000","last_clean":"2023-11-27T17:49:13.029030+0000","last_became_active":"2023-11-27T17:49:11.785950+0000","last_became_peered":"2023-11-27T17:49:11.785950+0000","last_unstale":"2023-11-27T17:49:13.029030+0000","last_undegraded":"2023-11-27T17:49:13.029030+0000","last_fullsized":"2023-11-27T17:49:13.029030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:50.396975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028330+0000","last_change":"2023-11-27T17:49:11.784645+0000","last_active":"2023-11-27T17:49:13.028330+0000","last_peered":"2023-11-27T17:49:13.028330+0000","last_clean":"2023-11-27T17:49:13.028330+0000","last_became_active":"2023-11-27T17:49:11.784385+0000","last_became_peered":"2023-11-27T17:49:11.784385+0000","last_unstale":"2023-11-27T17:49:13.028330+0000","last_undegraded":"2023-11-27T17:49:13.028330+0000","last_fullsized":"2023-11-27T17:49:13.028330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:32:29.678284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786997+0000","last_change":"2023-11-27T17:49:11.797982+0000","last_active":"2023-11-27T17:49:12.786997+0000","last_peered":"2023-11-27T17:49:12.786997+0000","last_clean":"2023-11-27T17:49:12.786997+0000","last_became_active":"2023-11-27T17:49:11.797701+0000","last_became_peered":"2023-11-27T17:49:11.797701+0000","last_unstale":"2023-11-27T17:49:12.786997+0000","last_undegraded":"2023-11-27T17:49:12.786997+0000","last_fullsized":"2023-11-27T17:49:12.786997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:18:02.419567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785367+0000","last_change":"2023-11-27T17:49:11.793699+0000","last_active":"2023-11-27T17:49:12.785367+0000","last_peered":"2023-11-27T17:49:12.785367+0000","last_clean":"2023-11-27T17:49:12.785367+0000","last_became_active":"2023-11-27T17:49:11.793445+0000","last_became_peered":"2023-11-27T17:49:11.793445+0000","last_unstale":"2023-11-27T17:49:12.785367+0000","last_undegraded":"2023-11-27T17:49:12.785367+0000","last_fullsized":"2023-11-27T17:49:12.785367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:48.409642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028608+0000","last_change":"2023-11-27T17:49:11.801236+0000","last_active":"2023-11-27T17:49:13.028608+0000","last_peered":"2023-11-27T17:49:13.028608+0000","last_clean":"2023-11-27T17:49:13.028608+0000","last_became_active":"2023-11-27T17:49:11.800945+0000","last_became_peered":"2023-11-27T17:49:11.800945+0000","last_unstale":"2023-11-27T17:49:13.028608+0000","last_undegraded":"2023-11-27T17:49:13.028608+0000","last_fullsized":"2023-11-27T17:49:13.028608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:48.409642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029070+0000","last_change":"2023-11-27T17:49:11.791557+0000","last_active":"2023-11-27T17:49:13.029070+0000","last_peered":"2023-11-27T17:49:13.029070+0000","last_clean":"2023-11-27T17:49:13.029070+0000","last_became_active":"2023-11-27T17:49:11.791278+0000","last_became_peered":"2023-11-27T17:49:11.791278+0000","last_unstale":"2023-11-27T17:49:13.029070+0000","last_undegraded":"2023-11-27T17:49:13.029070+0000","last_fullsized":"2023-11-27T17:49:13.029070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:28.297452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815601+0000","last_change":"2023-11-27T17:49:11.794273+0000","last_active":"2023-11-27T17:49:12.815601+0000","last_peered":"2023-11-27T17:49:12.815601+0000","last_clean":"2023-11-27T17:49:12.815601+0000","last_became_active":"2023-11-27T17:49:11.793938+0000","last_became_peered":"2023-11-27T17:49:11.793938+0000","last_unstale":"2023-11-27T17:49:12.815601+0000","last_undegraded":"2023-11-27T17:49:12.815601+0000","last_fullsized":"2023-11-27T17:49:12.815601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:43:57.675652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027866+0000","last_change":"2023-11-27T17:49:11.783942+0000","last_active":"2023-11-27T17:49:13.027866+0000","last_peered":"2023-11-27T17:49:13.027866+0000","last_clean":"2023-11-27T17:49:13.027866+0000","last_became_active":"2023-11-27T17:49:11.783642+0000","last_became_peered":"2023-11-27T17:49:11.783642+0000","last_unstale":"2023-11-27T17:49:13.027866+0000","last_undegraded":"2023-11-27T17:49:13.027866+0000","last_fullsized":"2023-11-27T17:49:13.027866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:41.741265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029067+0000","last_change":"2023-11-27T17:49:11.792711+0000","last_active":"2023-11-27T17:49:13.029067+0000","last_peered":"2023-11-27T17:49:13.029067+0000","last_clean":"2023-11-27T17:49:13.029067+0000","last_became_active":"2023-11-27T17:49:11.792432+0000","last_became_peered":"2023-11-27T17:49:11.792432+0000","last_unstale":"2023-11-27T17:49:13.029067+0000","last_undegraded":"2023-11-27T17:49:13.029067+0000","last_fullsized":"2023-11-27T17:49:13.029067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:22:29.473085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028482+0000","last_change":"2023-11-27T17:49:11.778111+0000","last_active":"2023-11-27T17:49:13.028482+0000","last_peered":"2023-11-27T17:49:13.028482+0000","last_clean":"2023-11-27T17:49:13.028482+0000","last_became_active":"2023-11-27T17:49:11.777833+0000","last_became_peered":"2023-11-27T17:49:11.777833+0000","last_unstale":"2023-11-27T17:49:13.028482+0000","last_undegraded":"2023-11-27T17:49:13.028482+0000","last_fullsized":"2023-11-27T17:49:13.028482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:35.672002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029543+0000","last_change":"2023-11-27T17:49:11.778763+0000","last_active":"2023-11-27T17:49:13.029543+0000","last_peered":"2023-11-27T17:49:13.029543+0000","last_clean":"2023-11-27T17:49:13.029543+0000","last_became_active":"2023-11-27T17:49:11.778457+0000","last_became_peered":"2023-11-27T17:49:11.778457+0000","last_unstale":"2023-11-27T17:49:13.029543+0000","last_undegraded":"2023-11-27T17:49:13.029543+0000","last_fullsized":"2023-11-27T17:49:13.029543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:25.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028205+0000","last_change":"2023-11-27T17:49:11.796205+0000","last_active":"2023-11-27T17:49:13.028205+0000","last_peered":"2023-11-27T17:49:13.028205+0000","last_clean":"2023-11-27T17:49:13.028205+0000","last_became_active":"2023-11-27T17:49:11.795960+0000","last_became_peered":"2023-11-27T17:49:11.795960+0000","last_unstale":"2023-11-27T17:49:13.028205+0000","last_undegraded":"2023-11-27T17:49:13.028205+0000","last_fullsized":"2023-11-27T17:49:13.028205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:48:56.035018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027994+0000","last_change":"2023-11-27T17:49:11.793915+0000","last_active":"2023-11-27T17:49:13.027994+0000","last_peered":"2023-11-27T17:49:13.027994+0000","last_clean":"2023-11-27T17:49:13.027994+0000","last_became_active":"2023-11-27T17:49:11.793636+0000","last_became_peered":"2023-11-27T17:49:11.793636+0000","last_unstale":"2023-11-27T17:49:13.027994+0000","last_undegraded":"2023-11-27T17:49:13.027994+0000","last_fullsized":"2023-11-27T17:49:13.027994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:52.479589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815586+0000","last_change":"2023-11-27T17:49:11.782411+0000","last_active":"2023-11-27T17:49:12.815586+0000","last_peered":"2023-11-27T17:49:12.815586+0000","last_clean":"2023-11-27T17:49:12.815586+0000","last_became_active":"2023-11-27T17:49:11.782108+0000","last_became_peered":"2023-11-27T17:49:11.782108+0000","last_unstale":"2023-11-27T17:49:12.815586+0000","last_undegraded":"2023-11-27T17:49:12.815586+0000","last_fullsized":"2023-11-27T17:49:12.815586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:21:05.562040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785528+0000","last_change":"2023-11-27T17:49:11.787186+0000","last_active":"2023-11-27T17:49:12.785528+0000","last_peered":"2023-11-27T17:49:12.785528+0000","last_clean":"2023-11-27T17:49:12.785528+0000","last_became_active":"2023-11-27T17:49:11.786897+0000","last_became_peered":"2023-11-27T17:49:11.786897+0000","last_unstale":"2023-11-27T17:49:12.785528+0000","last_undegraded":"2023-11-27T17:49:12.785528+0000","last_fullsized":"2023-11-27T17:49:12.785528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:02:35.207902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785735+0000","last_change":"2023-11-27T17:49:11.786009+0000","last_active":"2023-11-27T17:49:12.785735+0000","last_peered":"2023-11-27T17:49:12.785735+0000","last_clean":"2023-11-27T17:49:12.785735+0000","last_became_active":"2023-11-27T17:49:11.785724+0000","last_became_peered":"2023-11-27T17:49:11.785724+0000","last_unstale":"2023-11-27T17:49:12.785735+0000","last_undegraded":"2023-11-27T17:49:12.785735+0000","last_fullsized":"2023-11-27T17:49:12.785735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:49:47.270687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785940+0000","last_change":"2023-11-27T17:49:11.788565+0000","last_active":"2023-11-27T17:49:12.785940+0000","last_peered":"2023-11-27T17:49:12.785940+0000","last_clean":"2023-11-27T17:49:12.785940+0000","last_became_active":"2023-11-27T17:49:11.788300+0000","last_became_peered":"2023-11-27T17:49:11.788300+0000","last_unstale":"2023-11-27T17:49:12.785940+0000","last_undegraded":"2023-11-27T17:49:12.785940+0000","last_fullsized":"2023-11-27T17:49:12.785940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:23.875253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028315+0000","last_change":"2023-11-27T17:49:11.782409+0000","last_active":"2023-11-27T17:49:13.028315+0000","last_peered":"2023-11-27T17:49:13.028315+0000","last_clean":"2023-11-27T17:49:13.028315+0000","last_became_active":"2023-11-27T17:49:11.782151+0000","last_became_peered":"2023-11-27T17:49:11.782151+0000","last_unstale":"2023-11-27T17:49:13.028315+0000","last_undegraded":"2023-11-27T17:49:13.028315+0000","last_fullsized":"2023-11-27T17:49:13.028315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:48.409642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785167+0000","last_change":"2023-11-27T17:49:11.795605+0000","last_active":"2023-11-27T17:49:12.785167+0000","last_peered":"2023-11-27T17:49:12.785167+0000","last_clean":"2023-11-27T17:49:12.785167+0000","last_became_active":"2023-11-27T17:49:11.795289+0000","last_became_peered":"2023-11-27T17:49:11.795289+0000","last_unstale":"2023-11-27T17:49:12.785167+0000","last_undegraded":"2023-11-27T17:49:12.785167+0000","last_fullsized":"2023-11-27T17:49:12.785167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:10.562789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028213+0000","last_change":"2023-11-27T17:49:11.779660+0000","last_active":"2023-11-27T17:49:13.028213+0000","last_peered":"2023-11-27T17:49:13.028213+0000","last_clean":"2023-11-27T17:49:13.028213+0000","last_became_active":"2023-11-27T17:49:11.778208+0000","last_became_peered":"2023-11-27T17:49:11.778208+0000","last_unstale":"2023-11-27T17:49:13.028213+0000","last_undegraded":"2023-11-27T17:49:13.028213+0000","last_fullsized":"2023-11-27T17:49:13.028213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:49:22.498398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785458+0000","last_change":"2023-11-27T17:49:11.796912+0000","last_active":"2023-11-27T17:49:12.785458+0000","last_peered":"2023-11-27T17:49:12.785458+0000","last_clean":"2023-11-27T17:49:12.785458+0000","last_became_active":"2023-11-27T17:49:11.796704+0000","last_became_peered":"2023-11-27T17:49:11.796704+0000","last_unstale":"2023-11-27T17:49:12.785458+0000","last_undegraded":"2023-11-27T17:49:12.785458+0000","last_fullsized":"2023-11-27T17:49:12.785458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:18:02.419567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028961+0000","last_change":"2023-11-27T17:49:11.789768+0000","last_active":"2023-11-27T17:49:13.028961+0000","last_peered":"2023-11-27T17:49:13.028961+0000","last_clean":"2023-11-27T17:49:13.028961+0000","last_became_active":"2023-11-27T17:49:11.789483+0000","last_became_peered":"2023-11-27T17:49:11.789483+0000","last_unstale":"2023-11-27T17:49:13.028961+0000","last_undegraded":"2023-11-27T17:49:13.028961+0000","last_fullsized":"2023-11-27T17:49:13.028961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:18.765889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785656+0000","last_change":"2023-11-27T17:49:11.782813+0000","last_active":"2023-11-27T17:49:12.785656+0000","last_peered":"2023-11-27T17:49:12.785656+0000","last_clean":"2023-11-27T17:49:12.785656+0000","last_became_active":"2023-11-27T17:49:11.782536+0000","last_became_peered":"2023-11-27T17:49:11.782536+0000","last_unstale":"2023-11-27T17:49:12.785656+0000","last_undegraded":"2023-11-27T17:49:12.785656+0000","last_fullsized":"2023-11-27T17:49:12.785656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:32:29.678284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029015+0000","last_change":"2023-11-27T17:49:11.783544+0000","last_active":"2023-11-27T17:49:13.029015+0000","last_peered":"2023-11-27T17:49:13.029015+0000","last_clean":"2023-11-27T17:49:13.029015+0000","last_became_active":"2023-11-27T17:49:11.781065+0000","last_became_peered":"2023-11-27T17:49:11.781065+0000","last_unstale":"2023-11-27T17:49:13.029015+0000","last_undegraded":"2023-11-27T17:49:13.029015+0000","last_fullsized":"2023-11-27T17:49:13.029015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:18.765889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029680+0000","last_change":"2023-11-27T17:49:11.784541+0000","last_active":"2023-11-27T17:49:13.029680+0000","last_peered":"2023-11-27T17:49:13.029680+0000","last_clean":"2023-11-27T17:49:13.029680+0000","last_became_active":"2023-11-27T17:49:11.783897+0000","last_became_peered":"2023-11-27T17:49:11.783897+0000","last_unstale":"2023-11-27T17:49:13.029680+0000","last_undegraded":"2023-11-27T17:49:13.029680+0000","last_fullsized":"2023-11-27T17:49:13.029680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:31:29.242685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028983+0000","last_change":"2023-11-27T17:49:11.787586+0000","last_active":"2023-11-27T17:49:13.028983+0000","last_peered":"2023-11-27T17:49:13.028983+0000","last_clean":"2023-11-27T17:49:13.028983+0000","last_became_active":"2023-11-27T17:49:11.787219+0000","last_became_peered":"2023-11-27T17:49:11.787219+0000","last_unstale":"2023-11-27T17:49:13.028983+0000","last_undegraded":"2023-11-27T17:49:13.028983+0000","last_fullsized":"2023-11-27T17:49:13.028983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:29:55.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786685+0000","last_change":"2023-11-27T17:49:11.788886+0000","last_active":"2023-11-27T17:49:12.786685+0000","last_peered":"2023-11-27T17:49:12.786685+0000","last_clean":"2023-11-27T17:49:12.786685+0000","last_became_active":"2023-11-27T17:49:11.788599+0000","last_became_peered":"2023-11-27T17:49:11.788599+0000","last_unstale":"2023-11-27T17:49:12.786685+0000","last_undegraded":"2023-11-27T17:49:12.786685+0000","last_fullsized":"2023-11-27T17:49:12.786685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:49:47.270687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.792517+0000","last_change":"2023-11-27T17:49:10.784272+0000","last_active":"2023-11-27T17:49:11.792517+0000","last_peered":"2023-11-27T17:49:11.792517+0000","last_clean":"2023-11-27T17:49:11.792517+0000","last_became_active":"2023-11-27T17:49:10.784001+0000","last_became_peered":"2023-11-27T17:49:10.784001+0000","last_unstale":"2023-11-27T17:49:11.792517+0000","last_undegraded":"2023-11-27T17:49:11.792517+0000","last_fullsized":"2023-11-27T17:49:11.792517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:10:37.890409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029830+0000","last_change":"2023-11-27T17:49:11.777277+0000","last_active":"2023-11-27T17:49:13.029830+0000","last_peered":"2023-11-27T17:49:13.029830+0000","last_clean":"2023-11-27T17:49:13.029830+0000","last_became_active":"2023-11-27T17:49:11.776959+0000","last_became_peered":"2023-11-27T17:49:11.776959+0000","last_unstale":"2023-11-27T17:49:13.029830+0000","last_undegraded":"2023-11-27T17:49:13.029830+0000","last_fullsized":"2023-11-27T17:49:13.029830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:23.875253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.788334+0000","last_change":"2023-11-27T17:49:10.780494+0000","last_active":"2023-11-27T17:49:11.788334+0000","last_peered":"2023-11-27T17:49:11.788334+0000","last_clean":"2023-11-27T17:49:11.788334+0000","last_became_active":"2023-11-27T17:49:10.780246+0000","last_became_peered":"2023-11-27T17:49:10.780246+0000","last_unstale":"2023-11-27T17:49:11.788334+0000","last_undegraded":"2023-11-27T17:49:11.788334+0000","last_fullsized":"2023-11-27T17:49:11.788334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:10:37.890409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785615+0000","last_change":"2023-11-27T17:49:11.786688+0000","last_active":"2023-11-27T17:49:12.785615+0000","last_peered":"2023-11-27T17:49:12.785615+0000","last_clean":"2023-11-27T17:49:12.785615+0000","last_became_active":"2023-11-27T17:49:11.785576+0000","last_became_peered":"2023-11-27T17:49:11.785576+0000","last_unstale":"2023-11-27T17:49:12.785615+0000","last_undegraded":"2023-11-27T17:49:12.785615+0000","last_fullsized":"2023-11-27T17:49:12.785615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:10.562789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.798226+0000","last_change":"2023-11-27T17:49:10.778094+0000","last_active":"2023-11-27T17:49:11.798226+0000","last_peered":"2023-11-27T17:49:11.798226+0000","last_clean":"2023-11-27T17:49:11.798226+0000","last_became_active":"2023-11-27T17:49:10.777823+0000","last_became_peered":"2023-11-27T17:49:10.777823+0000","last_unstale":"2023-11-27T17:49:11.798226+0000","last_undegraded":"2023-11-27T17:49:11.798226+0000","last_fullsized":"2023-11-27T17:49:11.798226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:47.407443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785578+0000","last_change":"2023-11-27T17:49:11.796504+0000","last_active":"2023-11-27T17:49:12.785578+0000","last_peered":"2023-11-27T17:49:12.785578+0000","last_clean":"2023-11-27T17:49:12.785578+0000","last_became_active":"2023-11-27T17:49:11.795985+0000","last_became_peered":"2023-11-27T17:49:11.795985+0000","last_unstale":"2023-11-27T17:49:12.785578+0000","last_undegraded":"2023-11-27T17:49:12.785578+0000","last_fullsized":"2023-11-27T17:49:12.785578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:43:18.765889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.797876+0000","last_change":"2023-11-27T17:49:10.779711+0000","last_active":"2023-11-27T17:49:11.797876+0000","last_peered":"2023-11-27T17:49:11.797876+0000","last_clean":"2023-11-27T17:49:11.797876+0000","last_became_active":"2023-11-27T17:49:10.779418+0000","last_became_peered":"2023-11-27T17:49:10.779418+0000","last_unstale":"2023-11-27T17:49:11.797876+0000","last_undegraded":"2023-11-27T17:49:11.797876+0000","last_fullsized":"2023-11-27T17:49:11.797876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:44:39.615894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028647+0000","last_change":"2023-11-27T17:49:11.787449+0000","last_active":"2023-11-27T17:49:13.028647+0000","last_peered":"2023-11-27T17:49:13.028647+0000","last_clean":"2023-11-27T17:49:13.028647+0000","last_became_active":"2023-11-27T17:49:11.787142+0000","last_became_peered":"2023-11-27T17:49:11.787142+0000","last_unstale":"2023-11-27T17:49:13.028647+0000","last_undegraded":"2023-11-27T17:49:13.028647+0000","last_fullsized":"2023-11-27T17:49:13.028647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:18:02.419567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.790905+0000","last_change":"2023-11-27T17:49:10.773591+0000","last_active":"2023-11-27T17:49:11.790905+0000","last_peered":"2023-11-27T17:49:11.790905+0000","last_clean":"2023-11-27T17:49:11.790905+0000","last_became_active":"2023-11-27T17:49:10.772599+0000","last_became_peered":"2023-11-27T17:49:10.772599+0000","last_unstale":"2023-11-27T17:49:11.790905+0000","last_undegraded":"2023-11-27T17:49:11.790905+0000","last_fullsized":"2023-11-27T17:49:11.790905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:31:28.240486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028850+0000","last_change":"2023-11-27T17:49:11.790280+0000","last_active":"2023-11-27T17:49:13.028850+0000","last_peered":"2023-11-27T17:49:13.028850+0000","last_clean":"2023-11-27T17:49:13.028850+0000","last_became_active":"2023-11-27T17:49:11.789930+0000","last_became_peered":"2023-11-27T17:49:11.789930+0000","last_unstale":"2023-11-27T17:49:13.028850+0000","last_undegraded":"2023-11-27T17:49:13.028850+0000","last_fullsized":"2023-11-27T17:49:13.028850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:18:02.419567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.790932+0000","last_change":"2023-11-27T17:49:10.773472+0000","last_active":"2023-11-27T17:49:11.790932+0000","last_peered":"2023-11-27T17:49:11.790932+0000","last_clean":"2023-11-27T17:49:11.790932+0000","last_became_active":"2023-11-27T17:49:10.773184+0000","last_became_peered":"2023-11-27T17:49:10.773184+0000","last_unstale":"2023-11-27T17:49:11.790932+0000","last_undegraded":"2023-11-27T17:49:11.790932+0000","last_fullsized":"2023-11-27T17:49:11.790932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:21.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785853+0000","last_change":"2023-11-27T17:49:11.777183+0000","last_active":"2023-11-27T17:49:12.785853+0000","last_peered":"2023-11-27T17:49:12.785853+0000","last_clean":"2023-11-27T17:49:12.785853+0000","last_became_active":"2023-11-27T17:49:11.776898+0000","last_became_peered":"2023-11-27T17:49:11.776898+0000","last_unstale":"2023-11-27T17:49:12.785853+0000","last_undegraded":"2023-11-27T17:49:12.785853+0000","last_fullsized":"2023-11-27T17:49:12.785853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:35.672002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.768221+0000","last_change":"2023-11-27T17:49:10.784886+0000","last_active":"2023-11-27T17:49:11.768221+0000","last_peered":"2023-11-27T17:49:11.768221+0000","last_clean":"2023-11-27T17:49:11.768221+0000","last_became_active":"2023-11-27T17:49:10.784604+0000","last_became_peered":"2023-11-27T17:49:10.784604+0000","last_unstale":"2023-11-27T17:49:11.768221+0000","last_undegraded":"2023-11-27T17:49:11.768221+0000","last_fullsized":"2023-11-27T17:49:11.768221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:33.582615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785016+0000","last_change":"2023-11-27T17:49:11.787111+0000","last_active":"2023-11-27T17:49:12.785016+0000","last_peered":"2023-11-27T17:49:12.785016+0000","last_clean":"2023-11-27T17:49:12.785016+0000","last_became_active":"2023-11-27T17:49:11.786864+0000","last_became_peered":"2023-11-27T17:49:11.786864+0000","last_unstale":"2023-11-27T17:49:12.785016+0000","last_undegraded":"2023-11-27T17:49:12.785016+0000","last_fullsized":"2023-11-27T17:49:12.785016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:02:35.207902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.768533+0000","last_change":"2023-11-27T17:49:10.779088+0000","last_active":"2023-11-27T17:49:11.768533+0000","last_peered":"2023-11-27T17:49:11.768533+0000","last_clean":"2023-11-27T17:49:11.768533+0000","last_became_active":"2023-11-27T17:49:10.778801+0000","last_became_peered":"2023-11-27T17:49:10.778801+0000","last_unstale":"2023-11-27T17:49:11.768533+0000","last_undegraded":"2023-11-27T17:49:11.768533+0000","last_fullsized":"2023-11-27T17:49:11.768533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:22.229090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029088+0000","last_change":"2023-11-27T17:49:11.791541+0000","last_active":"2023-11-27T17:49:13.029088+0000","last_peered":"2023-11-27T17:49:13.029088+0000","last_clean":"2023-11-27T17:49:13.029088+0000","last_became_active":"2023-11-27T17:49:11.791245+0000","last_became_peered":"2023-11-27T17:49:11.791245+0000","last_unstale":"2023-11-27T17:49:13.029088+0000","last_undegraded":"2023-11-27T17:49:13.029088+0000","last_fullsized":"2023-11-27T17:49:13.029088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:29:55.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.769967+0000","last_change":"2023-11-27T17:49:10.783149+0000","last_active":"2023-11-27T17:49:11.769967+0000","last_peered":"2023-11-27T17:49:11.769967+0000","last_clean":"2023-11-27T17:49:11.769967+0000","last_became_active":"2023-11-27T17:49:10.782905+0000","last_became_peered":"2023-11-27T17:49:10.782905+0000","last_unstale":"2023-11-27T17:49:11.769967+0000","last_undegraded":"2023-11-27T17:49:11.769967+0000","last_fullsized":"2023-11-27T17:49:11.769967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:22:28.470886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028174+0000","last_change":"2023-11-27T17:49:11.796432+0000","last_active":"2023-11-27T17:49:13.028174+0000","last_peered":"2023-11-27T17:49:13.028174+0000","last_clean":"2023-11-27T17:49:13.028174+0000","last_became_active":"2023-11-27T17:49:11.795534+0000","last_became_peered":"2023-11-27T17:49:11.795534+0000","last_unstale":"2023-11-27T17:49:13.028174+0000","last_undegraded":"2023-11-27T17:49:13.028174+0000","last_fullsized":"2023-11-27T17:49:13.028174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:02:31.422070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.775906+0000","last_change":"2023-11-27T17:49:10.774400+0000","last_active":"2023-11-27T17:49:11.775906+0000","last_peered":"2023-11-27T17:49:11.775906+0000","last_clean":"2023-11-27T17:49:11.775906+0000","last_became_active":"2023-11-27T17:49:10.774111+0000","last_became_peered":"2023-11-27T17:49:10.774111+0000","last_unstale":"2023-11-27T17:49:11.775906+0000","last_undegraded":"2023-11-27T17:49:11.775906+0000","last_fullsized":"2023-11-27T17:49:11.775906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:31:28.240486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028040+0000","last_change":"2023-11-27T17:49:11.778825+0000","last_active":"2023-11-27T17:49:13.028040+0000","last_peered":"2023-11-27T17:49:13.028040+0000","last_clean":"2023-11-27T17:49:13.028040+0000","last_became_active":"2023-11-27T17:49:11.778535+0000","last_became_peered":"2023-11-27T17:49:11.778535+0000","last_unstale":"2023-11-27T17:49:13.028040+0000","last_undegraded":"2023-11-27T17:49:13.028040+0000","last_fullsized":"2023-11-27T17:49:13.028040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:23:24.460806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.792608+0000","last_change":"2023-11-27T17:49:10.782746+0000","last_active":"2023-11-27T17:49:11.792608+0000","last_peered":"2023-11-27T17:49:11.792608+0000","last_clean":"2023-11-27T17:49:11.792608+0000","last_became_active":"2023-11-27T17:49:10.782490+0000","last_became_peered":"2023-11-27T17:49:10.782490+0000","last_unstale":"2023-11-27T17:49:11.792608+0000","last_undegraded":"2023-11-27T17:49:11.792608+0000","last_fullsized":"2023-11-27T17:49:11.792608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:34.669802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029360+0000","last_change":"2023-11-27T17:49:11.796472+0000","last_active":"2023-11-27T17:49:13.029360+0000","last_peered":"2023-11-27T17:49:13.029360+0000","last_clean":"2023-11-27T17:49:13.029360+0000","last_became_active":"2023-11-27T17:49:11.796211+0000","last_became_peered":"2023-11-27T17:49:11.796211+0000","last_unstale":"2023-11-27T17:49:13.029360+0000","last_undegraded":"2023-11-27T17:49:13.029360+0000","last_fullsized":"2023-11-27T17:49:13.029360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:29:52.479589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.803418+0000","last_change":"2023-11-27T17:49:10.778021+0000","last_active":"2023-11-27T17:49:11.803418+0000","last_peered":"2023-11-27T17:49:11.803418+0000","last_clean":"2023-11-27T17:49:11.803418+0000","last_became_active":"2023-11-27T17:49:10.777713+0000","last_became_peered":"2023-11-27T17:49:10.777713+0000","last_unstale":"2023-11-27T17:49:11.803418+0000","last_undegraded":"2023-11-27T17:49:11.803418+0000","last_fullsized":"2023-11-27T17:49:11.803418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:49.190489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785243+0000","last_change":"2023-11-27T17:49:11.794234+0000","last_active":"2023-11-27T17:49:12.785243+0000","last_peered":"2023-11-27T17:49:12.785243+0000","last_clean":"2023-11-27T17:49:12.785243+0000","last_became_active":"2023-11-27T17:49:11.793955+0000","last_became_peered":"2023-11-27T17:49:11.793955+0000","last_unstale":"2023-11-27T17:49:12.785243+0000","last_undegraded":"2023-11-27T17:49:12.785243+0000","last_fullsized":"2023-11-27T17:49:12.785243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:26:35.672002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.791387+0000","last_change":"2023-11-27T17:49:10.782154+0000","last_active":"2023-11-27T17:49:11.791387+0000","last_peered":"2023-11-27T17:49:11.791387+0000","last_clean":"2023-11-27T17:49:11.791387+0000","last_became_active":"2023-11-27T17:49:10.781780+0000","last_became_peered":"2023-11-27T17:49:10.781780+0000","last_unstale":"2023-11-27T17:49:11.791387+0000","last_undegraded":"2023-11-27T17:49:11.791387+0000","last_fullsized":"2023-11-27T17:49:11.791387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:42:34.026210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027896+0000","last_change":"2023-11-27T17:49:11.784380+0000","last_active":"2023-11-27T17:49:13.027896+0000","last_peered":"2023-11-27T17:49:13.027896+0000","last_clean":"2023-11-27T17:49:13.027896+0000","last_became_active":"2023-11-27T17:49:11.784115+0000","last_became_peered":"2023-11-27T17:49:11.784115+0000","last_unstale":"2023-11-27T17:49:13.027896+0000","last_undegraded":"2023-11-27T17:49:13.027896+0000","last_fullsized":"2023-11-27T17:49:13.027896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:25.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785331+0000","last_change":"2023-11-27T17:49:10.782073+0000","last_active":"2023-11-27T17:49:12.785331+0000","last_peered":"2023-11-27T17:49:12.785331+0000","last_clean":"2023-11-27T17:49:12.785331+0000","last_became_active":"2023-11-27T17:49:10.781708+0000","last_became_peered":"2023-11-27T17:49:10.781708+0000","last_unstale":"2023-11-27T17:49:12.785331+0000","last_undegraded":"2023-11-27T17:49:12.785331+0000","last_fullsized":"2023-11-27T17:49:12.785331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:31:28.240486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028833+0000","last_change":"2023-11-27T17:49:11.787215+0000","last_active":"2023-11-27T17:49:13.028833+0000","last_peered":"2023-11-27T17:49:13.028833+0000","last_clean":"2023-11-27T17:49:13.028833+0000","last_became_active":"2023-11-27T17:49:11.785778+0000","last_became_peered":"2023-11-27T17:49:11.785778+0000","last_unstale":"2023-11-27T17:49:13.028833+0000","last_undegraded":"2023-11-27T17:49:13.028833+0000","last_fullsized":"2023-11-27T17:49:13.028833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:22:29.473085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.768369+0000","last_change":"2023-11-27T17:49:10.783166+0000","last_active":"2023-11-27T17:49:11.768369+0000","last_peered":"2023-11-27T17:49:11.768369+0000","last_clean":"2023-11-27T17:49:11.768369+0000","last_became_active":"2023-11-27T17:49:10.782859+0000","last_became_peered":"2023-11-27T17:49:10.782859+0000","last_unstale":"2023-11-27T17:49:11.768369+0000","last_undegraded":"2023-11-27T17:49:11.768369+0000","last_fullsized":"2023-11-27T17:49:11.768369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:42:34.026210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029547+0000","last_change":"2023-11-27T17:49:11.789007+0000","last_active":"2023-11-27T17:49:13.029547+0000","last_peered":"2023-11-27T17:49:13.029547+0000","last_clean":"2023-11-27T17:49:13.029547+0000","last_became_active":"2023-11-27T17:49:11.788280+0000","last_became_peered":"2023-11-27T17:49:11.788280+0000","last_unstale":"2023-11-27T17:49:13.029547+0000","last_undegraded":"2023-11-27T17:49:13.029547+0000","last_fullsized":"2023-11-27T17:49:13.029547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:34.584815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.798278+0000","last_change":"2023-11-27T17:49:10.778591+0000","last_active":"2023-11-27T17:49:11.798278+0000","last_peered":"2023-11-27T17:49:11.798278+0000","last_clean":"2023-11-27T17:49:11.798278+0000","last_became_active":"2023-11-27T17:49:10.778312+0000","last_became_peered":"2023-11-27T17:49:10.778312+0000","last_unstale":"2023-11-27T17:49:11.798278+0000","last_undegraded":"2023-11-27T17:49:11.798278+0000","last_fullsized":"2023-11-27T17:49:11.798278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:02:34.205702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786111+0000","last_change":"2023-11-27T17:49:11.780320+0000","last_active":"2023-11-27T17:49:12.786111+0000","last_peered":"2023-11-27T17:49:12.786111+0000","last_clean":"2023-11-27T17:49:12.786111+0000","last_became_active":"2023-11-27T17:49:11.779991+0000","last_became_peered":"2023-11-27T17:49:11.779991+0000","last_unstale":"2023-11-27T17:49:12.786111+0000","last_undegraded":"2023-11-27T17:49:12.786111+0000","last_fullsized":"2023-11-27T17:49:12.786111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:47:48.409642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785284+0000","last_change":"2023-11-27T17:49:10.775791+0000","last_active":"2023-11-27T17:49:12.785284+0000","last_peered":"2023-11-27T17:49:12.785284+0000","last_clean":"2023-11-27T17:49:12.785284+0000","last_became_active":"2023-11-27T17:49:10.775493+0000","last_became_peered":"2023-11-27T17:49:10.775493+0000","last_unstale":"2023-11-27T17:49:12.785284+0000","last_undegraded":"2023-11-27T17:49:12.785284+0000","last_fullsized":"2023-11-27T17:49:12.785284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:47.249922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029284+0000","last_change":"2023-11-27T17:49:11.789819+0000","last_active":"2023-11-27T17:49:13.029284+0000","last_peered":"2023-11-27T17:49:13.029284+0000","last_clean":"2023-11-27T17:49:13.029284+0000","last_became_active":"2023-11-27T17:49:11.789531+0000","last_became_peered":"2023-11-27T17:49:11.789531+0000","last_unstale":"2023-11-27T17:49:13.029284+0000","last_undegraded":"2023-11-27T17:49:13.029284+0000","last_fullsized":"2023-11-27T17:49:13.029284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:25:25.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.791873+0000","last_change":"2023-11-27T17:49:10.781994+0000","last_active":"2023-11-27T17:49:11.791873+0000","last_peered":"2023-11-27T17:49:11.791873+0000","last_clean":"2023-11-27T17:49:11.791873+0000","last_became_active":"2023-11-27T17:49:10.781672+0000","last_became_peered":"2023-11-27T17:49:10.781672+0000","last_unstale":"2023-11-27T17:49:11.791873+0000","last_undegraded":"2023-11-27T17:49:11.791873+0000","last_fullsized":"2023-11-27T17:49:11.791873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:22.873053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785213+0000","last_change":"2023-11-27T17:49:11.794775+0000","last_active":"2023-11-27T17:49:12.785213+0000","last_peered":"2023-11-27T17:49:12.785213+0000","last_clean":"2023-11-27T17:49:12.785213+0000","last_became_active":"2023-11-27T17:49:11.794542+0000","last_became_peered":"2023-11-27T17:49:11.794542+0000","last_unstale":"2023-11-27T17:49:12.785213+0000","last_undegraded":"2023-11-27T17:49:12.785213+0000","last_fullsized":"2023-11-27T17:49:12.785213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:32:29.678284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.784666+0000","last_change":"2023-11-27T17:49:10.775527+0000","last_active":"2023-11-27T17:49:11.784666+0000","last_peered":"2023-11-27T17:49:11.784666+0000","last_clean":"2023-11-27T17:49:11.784666+0000","last_became_active":"2023-11-27T17:49:10.775260+0000","last_became_peered":"2023-11-27T17:49:10.775260+0000","last_unstale":"2023-11-27T17:49:11.784666+0000","last_undegraded":"2023-11-27T17:49:11.784666+0000","last_fullsized":"2023-11-27T17:49:11.784666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:43:56.673453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815550+0000","last_change":"2023-11-27T17:49:11.780494+0000","last_active":"2023-11-27T17:49:12.815550+0000","last_peered":"2023-11-27T17:49:12.815550+0000","last_clean":"2023-11-27T17:49:12.815550+0000","last_became_active":"2023-11-27T17:49:11.779131+0000","last_became_peered":"2023-11-27T17:49:11.779131+0000","last_unstale":"2023-11-27T17:49:12.815550+0000","last_undegraded":"2023-11-27T17:49:12.815550+0000","last_fullsized":"2023-11-27T17:49:12.815550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:16:47.967392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.770107+0000","last_change":"2023-11-27T17:49:10.778336+0000","last_active":"2023-11-27T17:49:11.770107+0000","last_peered":"2023-11-27T17:49:11.770107+0000","last_clean":"2023-11-27T17:49:11.770107+0000","last_became_active":"2023-11-27T17:49:10.777973+0000","last_became_peered":"2023-11-27T17:49:10.777973+0000","last_unstale":"2023-11-27T17:49:11.770107+0000","last_undegraded":"2023-11-27T17:49:11.770107+0000","last_fullsized":"2023-11-27T17:49:11.770107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:08:58.597735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815474+0000","last_change":"2023-11-27T17:49:11.787985+0000","last_active":"2023-11-27T17:49:12.815474+0000","last_peered":"2023-11-27T17:49:12.815474+0000","last_clean":"2023-11-27T17:49:12.815474+0000","last_became_active":"2023-11-27T17:49:11.787479+0000","last_became_peered":"2023-11-27T17:49:11.787479+0000","last_unstale":"2023-11-27T17:49:12.815474+0000","last_undegraded":"2023-11-27T17:49:12.815474+0000","last_fullsized":"2023-11-27T17:49:12.815474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:23.231290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.800964+0000","last_change":"2023-11-27T17:49:10.776352+0000","last_active":"2023-11-27T17:49:11.800964+0000","last_peered":"2023-11-27T17:49:11.800964+0000","last_clean":"2023-11-27T17:49:11.800964+0000","last_became_active":"2023-11-27T17:49:10.776045+0000","last_became_peered":"2023-11-27T17:49:10.776045+0000","last_unstale":"2023-11-27T17:49:11.800964+0000","last_undegraded":"2023-11-27T17:49:11.800964+0000","last_fullsized":"2023-11-27T17:49:11.800964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:33.582615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815502+0000","last_change":"2023-11-27T17:49:11.787196+0000","last_active":"2023-11-27T17:49:12.815502+0000","last_peered":"2023-11-27T17:49:12.815502+0000","last_clean":"2023-11-27T17:49:12.815502+0000","last_became_active":"2023-11-27T17:49:11.785165+0000","last_became_peered":"2023-11-27T17:49:11.785165+0000","last_unstale":"2023-11-27T17:49:12.815502+0000","last_undegraded":"2023-11-27T17:49:12.815502+0000","last_fullsized":"2023-11-27T17:49:12.815502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:45.974646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.777981+0000","last_change":"2023-11-27T17:49:10.784514+0000","last_active":"2023-11-27T17:49:11.777981+0000","last_peered":"2023-11-27T17:49:11.777981+0000","last_clean":"2023-11-27T17:49:11.777981+0000","last_became_active":"2023-11-27T17:49:10.784237+0000","last_became_peered":"2023-11-27T17:49:10.784237+0000","last_unstale":"2023-11-27T17:49:11.777981+0000","last_undegraded":"2023-11-27T17:49:11.777981+0000","last_fullsized":"2023-11-27T17:49:11.777981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:21.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815670+0000","last_change":"2023-11-27T17:49:11.784738+0000","last_active":"2023-11-27T17:49:12.815670+0000","last_peered":"2023-11-27T17:49:12.815670+0000","last_clean":"2023-11-27T17:49:12.815670+0000","last_became_active":"2023-11-27T17:49:11.784492+0000","last_became_peered":"2023-11-27T17:49:11.784492+0000","last_unstale":"2023-11-27T17:49:12.815670+0000","last_undegraded":"2023-11-27T17:49:12.815670+0000","last_fullsized":"2023-11-27T17:49:12.815670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:50:22.508957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.768807+0000","last_change":"2023-11-27T17:49:10.778006+0000","last_active":"2023-11-27T17:49:11.768807+0000","last_peered":"2023-11-27T17:49:11.768807+0000","last_clean":"2023-11-27T17:49:11.768807+0000","last_became_active":"2023-11-27T17:49:10.777681+0000","last_became_peered":"2023-11-27T17:49:10.777681+0000","last_unstale":"2023-11-27T17:49:11.768807+0000","last_undegraded":"2023-11-27T17:49:11.768807+0000","last_fullsized":"2023-11-27T17:49:11.768807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:36:44.972447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029162+0000","last_change":"2023-11-27T17:49:11.787049+0000","last_active":"2023-11-27T17:49:13.029162+0000","last_peered":"2023-11-27T17:49:13.029162+0000","last_clean":"2023-11-27T17:49:13.029162+0000","last_became_active":"2023-11-27T17:49:11.785596+0000","last_became_peered":"2023-11-27T17:49:11.785596+0000","last_unstale":"2023-11-27T17:49:13.029162+0000","last_undegraded":"2023-11-27T17:49:13.029162+0000","last_fullsized":"2023-11-27T17:49:13.029162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:41.741265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.776683+0000","last_change":"2023-11-27T17:49:10.782683+0000","last_active":"2023-11-27T17:49:11.776683+0000","last_peered":"2023-11-27T17:49:11.776683+0000","last_clean":"2023-11-27T17:49:11.776683+0000","last_became_active":"2023-11-27T17:49:10.782398+0000","last_became_peered":"2023-11-27T17:49:10.782398+0000","last_unstale":"2023-11-27T17:49:11.776683+0000","last_undegraded":"2023-11-27T17:49:11.776683+0000","last_fullsized":"2023-11-27T17:49:11.776683+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:32:28.676085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.815586+0000","last_change":"2023-11-27T17:49:11.782223+0000","last_active":"2023-11-27T17:49:12.815586+0000","last_peered":"2023-11-27T17:49:12.815586+0000","last_clean":"2023-11-27T17:49:12.815586+0000","last_became_active":"2023-11-27T17:49:11.781954+0000","last_became_peered":"2023-11-27T17:49:11.781954+0000","last_unstale":"2023-11-27T17:49:12.815586+0000","last_undegraded":"2023-11-27T17:49:12.815586+0000","last_fullsized":"2023-11-27T17:49:12.815586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:14:42.333151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785159+0000","last_change":"2023-11-27T17:49:10.780937+0000","last_active":"2023-11-27T17:49:12.785159+0000","last_peered":"2023-11-27T17:49:12.785159+0000","last_clean":"2023-11-27T17:49:12.785159+0000","last_became_active":"2023-11-27T17:49:10.780645+0000","last_became_peered":"2023-11-27T17:49:10.780645+0000","last_unstale":"2023-11-27T17:49:12.785159+0000","last_undegraded":"2023-11-27T17:49:12.785159+0000","last_fullsized":"2023-11-27T17:49:12.785159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:49.190489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029732+0000","last_change":"2023-11-27T17:49:11.801293+0000","last_active":"2023-11-27T17:49:13.029732+0000","last_peered":"2023-11-27T17:49:13.029732+0000","last_clean":"2023-11-27T17:49:13.029732+0000","last_became_active":"2023-11-27T17:49:11.801010+0000","last_became_peered":"2023-11-27T17:49:11.801010+0000","last_unstale":"2023-11-27T17:49:13.029732+0000","last_undegraded":"2023-11-27T17:49:13.029732+0000","last_fullsized":"2023-11-27T17:49:13.029732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:35:41.741265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786955+0000","last_change":"2023-11-27T17:49:10.780245+0000","last_active":"2023-11-27T17:49:12.786955+0000","last_peered":"2023-11-27T17:49:12.786955+0000","last_clean":"2023-11-27T17:49:12.786955+0000","last_became_active":"2023-11-27T17:49:10.779835+0000","last_became_peered":"2023-11-27T17:49:10.779835+0000","last_unstale":"2023-11-27T17:49:12.786955+0000","last_undegraded":"2023-11-27T17:49:12.786955+0000","last_fullsized":"2023-11-27T17:49:12.786955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:42:34.026210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786544+0000","last_change":"2023-11-27T17:49:11.797811+0000","last_active":"2023-11-27T17:49:12.786544+0000","last_peered":"2023-11-27T17:49:12.786544+0000","last_clean":"2023-11-27T17:49:12.786544+0000","last_became_active":"2023-11-27T17:49:11.797534+0000","last_became_peered":"2023-11-27T17:49:11.797534+0000","last_unstale":"2023-11-27T17:49:12.786544+0000","last_undegraded":"2023-11-27T17:49:12.786544+0000","last_fullsized":"2023-11-27T17:49:12.786544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:50.192689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785293+0000","last_change":"2023-11-27T17:49:10.782302+0000","last_active":"2023-11-27T17:49:12.785293+0000","last_peered":"2023-11-27T17:49:12.785293+0000","last_clean":"2023-11-27T17:49:12.785293+0000","last_became_active":"2023-11-27T17:49:10.782038+0000","last_became_peered":"2023-11-27T17:49:10.782038+0000","last_unstale":"2023-11-27T17:49:12.785293+0000","last_undegraded":"2023-11-27T17:49:12.785293+0000","last_fullsized":"2023-11-27T17:49:12.785293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:20:33.582615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.029520+0000","last_change":"2023-11-27T17:49:11.784928+0000","last_active":"2023-11-27T17:49:13.029520+0000","last_peered":"2023-11-27T17:49:13.029520+0000","last_clean":"2023-11-27T17:49:13.029520+0000","last_became_active":"2023-11-27T17:49:11.784216+0000","last_became_peered":"2023-11-27T17:49:11.784216+0000","last_unstale":"2023-11-27T17:49:13.029520+0000","last_undegraded":"2023-11-27T17:49:13.029520+0000","last_fullsized":"2023-11-27T17:49:13.029520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:08:59.599935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.775811+0000","last_change":"2023-11-27T17:49:10.780243+0000","last_active":"2023-11-27T17:49:11.775811+0000","last_peered":"2023-11-27T17:49:11.775811+0000","last_clean":"2023-11-27T17:49:11.775811+0000","last_became_active":"2023-11-27T17:49:10.779813+0000","last_became_peered":"2023-11-27T17:49:10.779813+0000","last_unstale":"2023-11-27T17:49:11.775811+0000","last_undegraded":"2023-11-27T17:49:11.775811+0000","last_fullsized":"2023-11-27T17:49:11.775811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:08:58.597735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.786442+0000","last_change":"2023-11-27T17:49:11.786416+0000","last_active":"2023-11-27T17:49:12.786442+0000","last_peered":"2023-11-27T17:49:12.786442+0000","last_clean":"2023-11-27T17:49:12.786442+0000","last_became_active":"2023-11-27T17:49:11.786121+0000","last_became_peered":"2023-11-27T17:49:11.786121+0000","last_unstale":"2023-11-27T17:49:12.786442+0000","last_undegraded":"2023-11-27T17:49:12.786442+0000","last_fullsized":"2023-11-27T17:49:12.786442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:48.252121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785419+0000","last_change":"2023-11-27T17:49:10.778520+0000","last_active":"2023-11-27T17:49:12.785419+0000","last_peered":"2023-11-27T17:49:12.785419+0000","last_clean":"2023-11-27T17:49:12.785419+0000","last_became_active":"2023-11-27T17:49:10.778228+0000","last_became_peered":"2023-11-27T17:49:10.778228+0000","last_unstale":"2023-11-27T17:49:12.785419+0000","last_undegraded":"2023-11-27T17:49:12.785419+0000","last_fullsized":"2023-11-27T17:49:12.785419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:16:22.873053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.027722+0000","last_change":"2023-11-27T17:49:11.789077+0000","last_active":"2023-11-27T17:49:13.027722+0000","last_peered":"2023-11-27T17:49:13.027722+0000","last_clean":"2023-11-27T17:49:13.027722+0000","last_became_active":"2023-11-27T17:49:11.788786+0000","last_became_peered":"2023-11-27T17:49:11.788786+0000","last_unstale":"2023-11-27T17:49:13.027722+0000","last_undegraded":"2023-11-27T17:49:13.027722+0000","last_fullsized":"2023-11-27T17:49:13.027722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:54:50.396975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.771013+0000","last_change":"2023-11-27T17:49:10.781488+0000","last_active":"2023-11-27T17:49:11.771013+0000","last_peered":"2023-11-27T17:49:11.771013+0000","last_clean":"2023-11-27T17:49:11.771013+0000","last_became_active":"2023-11-27T17:49:10.780865+0000","last_became_peered":"2023-11-27T17:49:10.780865+0000","last_unstale":"2023-11-27T17:49:11.771013+0000","last_undegraded":"2023-11-27T17:49:11.771013+0000","last_fullsized":"2023-11-27T17:49:11.771013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:36:47.249922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:12.785356+0000","last_change":"2023-11-27T17:49:11.782683+0000","last_active":"2023-11-27T17:49:12.785356+0000","last_peered":"2023-11-27T17:49:12.785356+0000","last_clean":"2023-11-27T17:49:12.785356+0000","last_became_active":"2023-11-27T17:49:11.782388+0000","last_became_peered":"2023-11-27T17:49:11.782388+0000","last_unstale":"2023-11-27T17:49:12.785356+0000","last_undegraded":"2023-11-27T17:49:12.785356+0000","last_fullsized":"2023-11-27T17:49:12.785356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:57:50.192689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.769119+0000","last_change":"2023-11-27T17:49:10.783469+0000","last_active":"2023-11-27T17:49:11.769119+0000","last_peered":"2023-11-27T17:49:11.769119+0000","last_clean":"2023-11-27T17:49:11.769119+0000","last_became_active":"2023-11-27T17:49:10.783245+0000","last_became_peered":"2023-11-27T17:49:10.783245+0000","last_unstale":"2023-11-27T17:49:11.769119+0000","last_undegraded":"2023-11-27T17:49:11.769119+0000","last_fullsized":"2023-11-27T17:49:11.769119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:23:09.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T17:49:13.028718+0000","last_change":"2023-11-27T17:49:11.784771+0000","last_active":"2023-11-27T17:49:13.028718+0000","last_peered":"2023-11-27T17:49:13.028718+0000","last_clean":"2023-11-27T17:49:13.028718+0000","last_became_active":"2023-11-27T17:49:11.784543+0000","last_became_peered":"2023-11-27T17:49:11.784543+0000","last_unstale":"2023-11-27T17:49:13.028718+0000","last_undegraded":"2023-11-27T17:49:13.028718+0000","last_fullsized":"2023-11-27T17:49:13.028718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:10.758939+0000","last_clean_scrub_stamp":"2023-11-27T17:49:10.758939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:55:28.297452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.777376+0000","last_change":"2023-11-27T17:49:10.784466+0000","last_active":"2023-11-27T17:49:11.777376+0000","last_peered":"2023-11-27T17:49:11.777376+0000","last_clean":"2023-11-27T17:49:11.777376+0000","last_became_active":"2023-11-27T17:49:10.783698+0000","last_became_peered":"2023-11-27T17:49:10.783698+0000","last_unstale":"2023-11-27T17:49:11.777376+0000","last_undegraded":"2023-11-27T17:49:11.777376+0000","last_fullsized":"2023-11-27T17:49:11.777376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:49:09.756740+0000","last_clean_scrub_stamp":"2023-11-27T17:49:09.756740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:43:56.673453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-27T17:49:11.769267+0000","last_change":"2023-11-27T17:48:12.450229+0000","last_active":"2023-11-27T17:49:11.769267+0000","last_peered":"2023-11-27T17:49:11.769267+0000","last_clean":"2023-11-27T17:49:11.769267+0000","last_became_active":"2023-11-27T17:48:12.449215+0000","last_became_peered":"2023-11-27T17:48:12.449215+0000","last_unstale":"2023-11-27T17:49:11.769267+0000","last_undegraded":"2023-11-27T17:49:11.769267+0000","last_fullsized":"2023-11-27T17:49:11.769267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:48:11.138365+0000","last_clean_scrub_stamp":"2023-11-27T17:48:11.138365+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:57:30.150528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":734546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.49299999999999999}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.61799999999999999}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.505}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.308},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.33600000000000002}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41899999999999998}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.377},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":144704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.504}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.496},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68600000000000005}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.63200000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.36299999999999999}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.443},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":145722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.255},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.31}]},{"osd":3,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.29599999999999999}]},{"osd":4,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Nov 27 17:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.64000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":734456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":8.0570000000000004,"5min":8.0570000000000004,"15min":8.0570000000000004},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.375}]},{"osd":3,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":10.025,"5min":10.025,"15min":10.025},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.52700000000000002}]},{"osd":5,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.495},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59499999999999997}]},{"osd":6,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":144158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":9.516,"5min":9.516,"15min":9.516},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":3.5990000000000002,"5min":3.5990000000000002,"15min":3.5990000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.439}]},{"osd":3,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.6459999999999999,"5min":3.6459999999999999,"15min":3.6459999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.6859999999999999,"5min":3.6859999999999999,"15min":3.6859999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Nov 27 17:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":145722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.25600000000000001}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.30499999999999999}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54600000000000004}]},{"osd":5,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":144192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70299999999999996}]},{"osd":1,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.503},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.44900000000000001}]},{"osd":3,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":9.8960000000000008,"5min":9.8960000000000008,"15min":9.8960000000000008},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":9.875,"5min":9.875,"15min":9.875},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.76600000000000001}]},{"osd":6,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.624},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Mon Nov 27 17:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":144760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.40300000000000002}]},{"osd":1,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.499}]},{"osd":2,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.434}]},{"osd":3,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.63}]},{"osd":4,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.66900000000000004}]},{"osd":6,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Nov 27 17:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:49:20.801 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T17:49:20.801 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-27T17:49:20.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.961+0000 7f852c395700 1 Processor -- start 2023-11-27T17:49:20.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.961+0000 7f852c395700 1 -- start start 2023-11-27T17:49:20.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852c395700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f85240b64f0 0x7f85240704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852c395700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8524070a30 0x7f852415f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852c395700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852406e200 con 0x7f8524147810 2023-11-27T17:49:20.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852c395700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8524070ec0 con 0x7f8524070a30 2023-11-27T17:49:20.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852c395700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852406e4e0 con 0x7f85240b64f0 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852a932700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8524070a30 0x7f852415f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852a932700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8524070a30 0x7f852415f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53474/0 (socket says 172.21.15.177:53474) 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852a131700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f8524147810 0x7f852406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47788/0 (socket says 172.21.15.177:47788) 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852a932700 1 -- 172.21.15.177:0/580302405 learned_addr learned my addr 172.21.15.177:0/580302405 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f852a932700 1 -- 172.21.15.177:0/580302405 >> v2:172.21.15.178:3300/0 conn(0x7f85240b64f0 msgr2=0x7f85240704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.962+0000 7f8529930700 1 --2- 172.21.15.177:0/580302405 >> v2:172.21.15.178:3300/0 conn(0x7f85240b64f0 0x7f85240704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852a932700 1 --2- 172.21.15.177:0/580302405 >> v2:172.21.15.178:3300/0 conn(0x7f85240b64f0 0x7f85240704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852a932700 1 -- 172.21.15.177:0/580302405 >> v1:172.21.15.177:6789/0 conn(0x7f8524147810 legacy=0x7f852406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852a932700 1 -- 172.21.15.177:0/580302405 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852415e970 con 0x7f8524070a30 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852912f700 1 -- 172.21.15.177:0/580302405 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528590446 0 0) 0x7f852406e200 con 0x7f8524147810 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852a932700 1 --2- 172.21.15.177:0/580302405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8524070a30 0x7f852415f170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f85240b1ef0 tx=0x7f851c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a2241f5b5df827 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:20.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852912f700 1 -- 172.21.15.177:0/580302405 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00e070 con 0x7f8524070a30 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852912f700 1 -- 172.21.15.177:0/580302405 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00b9c0 con 0x7f8524070a30 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852912f700 1 -- 172.21.15.177:0/580302405 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00bd70 con 0x7f8524070a30 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852c395700 1 -- 172.21.15.177:0/580302405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8524070a30 msgr2=0x7f852415f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852c395700 1 --2- 172.21.15.177:0/580302405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8524070a30 0x7f852415f170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f85240b1ef0 tx=0x7f851c00b330 comp rx=0 tx=0).stop 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852c395700 1 -- 172.21.15.177:0/580302405 shutdown_connections 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852c395700 1 --2- 172.21.15.177:0/580302405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8524070a30 0x7f852415f170 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852c395700 1 --2- 172.21.15.177:0/580302405 >> v2:172.21.15.178:3300/0 conn(0x7f85240b64f0 0x7f85240704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852c395700 1 -- 172.21.15.177:0/580302405 >> 172.21.15.177:0/580302405 conn(0x7f85240b2130 msgr2=0x7f85240b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.963+0000 7f852c395700 1 -- 172.21.15.177:0/580302405 shutdown_connections 2023-11-27T17:49:20.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.964+0000 7f852c395700 1 -- 172.21.15.177:0/580302405 wait complete. 2023-11-27T17:49:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f852c395700 1 Processor -- start 2023-11-27T17:49:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f852c395700 1 -- start start 2023-11-27T17:49:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f852c395700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8524070a30 0x7f8524142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f852c395700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b64f0 0x7f852413e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f852c395700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8524147810 0x7f852415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f852c395700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852413c650 con 0x7f85240b64f0 2023-11-27T17:49:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f852c395700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85241431b0 con 0x7f8524147810 2023-11-27T17:49:20.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f852c395700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8524143490 con 0x7f8524070a30 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f8529930700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b64f0 0x7f852413e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f8529930700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b64f0 0x7f852413e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53476/0 (socket says 172.21.15.177:53476) 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.965+0000 7f8529930700 1 -- 172.21.15.177:0/3386981281 learned_addr learned my addr 172.21.15.177:0/3386981281 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f8529930700 1 -- 172.21.15.177:0/3386981281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8524070a30 msgr2=0x7f8524142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f852a131700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8524070a30 0x7f8524142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f852a932700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8524147810 0x7f852415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f8529930700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8524070a30 0x7f8524142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f8529930700 1 -- 172.21.15.177:0/3386981281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8524147810 msgr2=0x7f852415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f8529930700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8524147810 0x7f852415d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f8529930700 1 -- 172.21.15.177:0/3386981281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009b30 con 0x7f85240b64f0 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f8529930700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b64f0 0x7f852413e670 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f852000c7f0 tx=0x7f852000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:20.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f851affd700 1 -- 172.21.15.177:0/3386981281 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520011800 con 0x7f85240b64f0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f851affd700 1 -- 172.21.15.177:0/3386981281 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520011960 con 0x7f85240b64f0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852413c2e0 con 0x7f85240b64f0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f851affd700 1 -- 172.21.15.177:0/3386981281 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520011cf0 con 0x7f85240b64f0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.966+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852415d9c0 con 0x7f85240b64f0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.967+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8524073aa0 con 0x7f85240b64f0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.967+0000 7f851affd700 1 -- 172.21.15.177:0/3386981281 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8520018360 con 0x7f85240b64f0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.968+0000 7f851affd700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f850806b250 0x7f850806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.968+0000 7f851affd700 1 -- 172.21.15.177:0/3386981281 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8520089970 con 0x7f85240b64f0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.968+0000 7f852a131700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f850806b250 0x7f850806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:20.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.968+0000 7f852a131700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f850806b250 0x7f850806d710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8514000f60 tx=0x7f8514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:20.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:20.973+0000 7f851affd700 1 -- 172.21.15.177:0/3386981281 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f85200546b0 con 0x7f85240b64f0 2023-11-27T17:49:21.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.239+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8524069400 con 0x7f85240b64f0 2023-11-27T17:49:21.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.241+0000 7f851affd700 1 -- 172.21.15.177:0/3386981281 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f852001f0b0 con 0x7f85240b64f0 2023-11-27T17:49:21.246 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-11-27T17:49:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAo1mRl71yWKxAAe2FZ+w7xYRvPZ8mqVdPkZQ== 2023-11-27T17:49:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-11-27T17:49:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-11-27T17:49:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-27T17:49:21.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f850806b250 msgr2=0x7f850806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:21.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f850806b250 0x7f850806d710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8514000f60 tx=0x7f8514009040 comp rx=0 tx=0).stop 2023-11-27T17:49:21.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b64f0 msgr2=0x7f852413e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:21.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b64f0 0x7f852413e670 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f852000c7f0 tx=0x7f852000cbb0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 shutdown_connections 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f850806b250 0x7f850806d710 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8524147810 0x7f852415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8524070a30 0x7f8524142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 --2- 172.21.15.177:0/3386981281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b64f0 0x7f852413e670 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 >> 172.21.15.177:0/3386981281 conn(0x7f85240b2130 msgr2=0x7f8524144850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 shutdown_connections 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.243+0000 7f852c395700 1 -- 172.21.15.177:0/3386981281 wait complete. 2023-11-27T17:49:21.248 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-11-27T17:49:21.258 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:49:21.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.376+0000 7f2f895cb700 1 Processor -- start 2023-11-27T17:49:21.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.377+0000 7f2f895cb700 1 -- start start 2023-11-27T17:49:21.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.377+0000 7f2f895cb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f840cfdd0 0x7f2f841473f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.377+0000 7f2f895cb700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2f84147930 0x7f2f840d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.377+0000 7f2f895cb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f840d06f0 0x7f2f840b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.377+0000 7f2f895cb700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840d1a90 con 0x7f2f84147930 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.377+0000 7f2f895cb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840d0e80 con 0x7f2f840cfdd0 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.377+0000 7f2f895cb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840d1160 con 0x7f2f840d06f0 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2f84147930 0x7f2f840d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2f84147930 0x7f2f840d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53484/0 (socket says 172.21.15.177:53484) 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 -- 172.21.15.177:0/711283663 learned_addr learned my addr 172.21.15.177:0/711283663 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f837fe700 1 --2- 172.21.15.177:0/711283663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f840d06f0 0x7f2f840b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 -- 172.21.15.177:0/711283663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f840d06f0 msgr2=0x7f2f840b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:21.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 --2- 172.21.15.177:0/711283663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f840d06f0 0x7f2f840b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f82ffd700 1 --2- 172.21.15.177:0/711283663 >> v2:172.21.15.178:3300/0 conn(0x7f2f840cfdd0 0x7f2f841473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 -- 172.21.15.177:0/711283663 >> v2:172.21.15.178:3300/0 conn(0x7f2f840cfdd0 msgr2=0x7f2f841473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 --2- 172.21.15.177:0/711283663 >> v2:172.21.15.178:3300/0 conn(0x7f2f840cfdd0 0x7f2f841473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 -- 172.21.15.177:0/711283663 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f840d1440 con 0x7f2f84147930 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f827fc700 1 --2- 172.21.15.177:0/711283663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f84147930 0x7f2f840d01b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2f840b3110 tx=0x7f2f74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f13c5a299ece5b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f81ffb700 1 -- 172.21.15.177:0/711283663 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400b870 con 0x7f2f84147930 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f81ffb700 1 -- 172.21.15.177:0/711283663 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7400b9d0 con 0x7f2f84147930 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.378+0000 7f2f81ffb700 1 -- 172.21.15.177:0/711283663 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400bd60 con 0x7f2f84147930 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 -- 172.21.15.177:0/711283663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f84147930 msgr2=0x7f2f840d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 --2- 172.21.15.177:0/711283663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f84147930 0x7f2f840d01b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2f840b3110 tx=0x7f2f74009bd0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 -- 172.21.15.177:0/711283663 shutdown_connections 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 --2- 172.21.15.177:0/711283663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f840d06f0 0x7f2f840b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 --2- 172.21.15.177:0/711283663 >> v2:172.21.15.178:3300/0 conn(0x7f2f840cfdd0 0x7f2f841473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 --2- 172.21.15.177:0/711283663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f84147930 0x7f2f840d01b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 -- 172.21.15.177:0/711283663 >> 172.21.15.177:0/711283663 conn(0x7f2f840ce9d0 msgr2=0x7f2f840cede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:21.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 -- 172.21.15.177:0/711283663 shutdown_connections 2023-11-27T17:49:21.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.379+0000 7f2f895cb700 1 -- 172.21.15.177:0/711283663 wait complete. 2023-11-27T17:49:21.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.380+0000 7f2f895cb700 1 Processor -- start 2023-11-27T17:49:21.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.380+0000 7f2f895cb700 1 -- start start 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f895cb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f840cfdd0 0x7f2f8415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f895cb700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f840d06f0 0x7f2f8413d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f895cb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f84147930 0x7f2f84160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f895cb700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f841603a0 con 0x7f2f840d06f0 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f895cb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8413e5b0 con 0x7f2f840cfdd0 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f895cb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8413d9a0 con 0x7f2f84147930 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f827fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f840d06f0 0x7f2f8413d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f827fc700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f840d06f0 0x7f2f8413d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53492/0 (socket says 172.21.15.177:53492) 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f827fc700 1 -- 172.21.15.177:0/137312641 learned_addr learned my addr 172.21.15.177:0/137312641 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f82ffd700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f840cfdd0 0x7f2f8415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f837fe700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f84147930 0x7f2f84160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:21.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f827fc700 1 -- 172.21.15.177:0/137312641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f84147930 msgr2=0x7f2f84160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f827fc700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f84147930 0x7f2f84160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f827fc700 1 -- 172.21.15.177:0/137312641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f840cfdd0 msgr2=0x7f2f8415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f827fc700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f840cfdd0 0x7f2f8415fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.381+0000 7f2f827fc700 1 -- 172.21.15.177:0/137312641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74009550 con 0x7f2f840d06f0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.382+0000 7f2f827fc700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f840d06f0 0x7f2f8413d0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2f74014040 tx=0x7f2f74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.382+0000 7f2f6b7fe700 1 -- 172.21.15.177:0/137312641 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74004310 con 0x7f2f840d06f0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.382+0000 7f2f6b7fe700 1 -- 172.21.15.177:0/137312641 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7401f070 con 0x7f2f840d06f0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.382+0000 7f2f6b7fe700 1 -- 172.21.15.177:0/137312641 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740036a0 con 0x7f2f840d06f0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.382+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8413dc80 con 0x7f2f840d06f0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.382+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8413e240 con 0x7f2f840d06f0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.383+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8413e890 con 0x7f2f840d06f0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.383+0000 7f2f6b7fe700 1 -- 172.21.15.177:0/137312641 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2f74021030 con 0x7f2f840d06f0 2023-11-27T17:49:21.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.383+0000 7f2f6b7fe700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2f7006b250 0x7f2f7006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:21.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.383+0000 7f2f6b7fe700 1 -- 172.21.15.177:0/137312641 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f7408ac90 con 0x7f2f840d06f0 2023-11-27T17:49:21.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.384+0000 7f2f82ffd700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2f7006b250 0x7f2f7006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:21.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.384+0000 7f2f82ffd700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2f7006b250 0x7f2f7006d710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800a990 tx=0x7f2f78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:21.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.388+0000 7f2f6b7fe700 1 -- 172.21.15.177:0/137312641 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2f74055a50 con 0x7f2f840d06f0 2023-11-27T17:49:21.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.621+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f84074e90 con 0x7f2f840d06f0 2023-11-27T17:49:21.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.622+0000 7f2f6b7fe700 1 -- 172.21.15.177:0/137312641 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f2f74029090 con 0x7f2f840d06f0 2023-11-27T17:49:21.624 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:21.625 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/4007543868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":4007543868},{"type":"v1","addr":"172.21.15.178:6834","nonce":4007543868}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1923553033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1923553033},{"type":"v1","addr":"172.21.15.178:6835","nonce":1923553033}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5031,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1398217543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1398217543},{"type":"v1","addr":"172.21.15.177:6836","nonce":1398217543}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:49:11.168024+0000","modified":"2023-11-27T17:49:14.181916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5034":{"gid":5034,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.177:6837/1746694137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":1746694137},{"type":"v1","addr":"172.21.15.177:6837","nonce":1746694137}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-27T17:49:21.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2f7006b250 msgr2=0x7f2f7006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:21.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2f7006b250 0x7f2f7006d710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800a990 tx=0x7f2f78008040 comp rx=0 tx=0).stop 2023-11-27T17:49:21.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f840d06f0 msgr2=0x7f2f8413d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:21.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f840d06f0 0x7f2f8413d0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2f74014040 tx=0x7f2f74004750 comp rx=0 tx=0).stop 2023-11-27T17:49:21.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 shutdown_connections 2023-11-27T17:49:21.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f2f7006b250 0x7f2f7006d710 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f84147930 0x7f2f84160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f840cfdd0 0x7f2f8415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 --2- 172.21.15.177:0/137312641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f840d06f0 0x7f2f8413d0a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:21.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 >> 172.21.15.177:0/137312641 conn(0x7f2f840ce9d0 msgr2=0x7f2f84073070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:21.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 shutdown_connections 2023-11-27T17:49:21.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:21.624+0000 7f2f895cb700 1 -- 172.21.15.177:0/137312641 wait complete. 2023-11-27T17:49:21.628 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 16 2023-11-27T17:49:22.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T17:49:11.168024+0000', 'modified': '2023-11-27T17:49:14.181916+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5034}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5034': {'gid': 5034, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.177:6837/1746694137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6835', 'nonce': 1746694137}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 1746694137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T17:49:22.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T17:49:22.041 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-27T17:49:22.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.161+0000 7f79ca404700 1 Processor -- start 2023-11-27T17:49:22.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.161+0000 7f79ca404700 1 -- start start 2023-11-27T17:49:22.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79ca404700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79c40cf3c0 0x7f79c40b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79ca404700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40b2690 0x7f79c415fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79ca404700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c40b2af0 con 0x7f79c4160180 2023-11-27T17:49:22.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79ca404700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c41609e0 con 0x7f79c40cf3c0 2023-11-27T17:49:22.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79ca404700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40b7490 con 0x7f79c40b2690 2023-11-27T17:49:22.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c37fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40b2690 0x7f79c415fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c3fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79c40cf3c0 0x7f79c40b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c37fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40b2690 0x7f79c415fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.177:40966/0 (socket says 172.21.15.177:40966) 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c37fe700 1 -- 172.21.15.177:0/4180181484 learned_addr learned my addr 172.21.15.177:0/4180181484 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c89a1700 1 --1- 172.21.15.177:0/4180181484 >> v1:172.21.15.178:6789/0 conn(0x7f79c4160180 0x7f79c4144fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.177:46798/0 (socket says 172.21.15.177:46798) 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c3fff700 1 -- 172.21.15.177:0/4180181484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40b2690 msgr2=0x7f79c415fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c3fff700 1 --2- 172.21.15.177:0/4180181484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40b2690 0x7f79c415fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c3fff700 1 -- 172.21.15.177:0/4180181484 >> v1:172.21.15.178:6789/0 conn(0x7f79c4160180 legacy=0x7f79c4144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c3fff700 1 -- 172.21.15.177:0/4180181484 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40d0f40 con 0x7f79c40cf3c0 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.162+0000 7f79c37fe700 1 --2- 172.21.15.177:0/4180181484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40b2690 0x7f79c415fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79c3fff700 1 --2- 172.21.15.177:0/4180181484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c40cf3c0 0x7f79c40b2150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009840 tx=0x7f79b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a98acf0e0a16bf25 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79c2ffd700 1 -- 172.21.15.177:0/4180181484 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4011830 con 0x7f79c40cf3c0 2023-11-27T17:49:22.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79c2ffd700 1 -- 172.21.15.177:0/4180181484 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b4011990 con 0x7f79c40cf3c0 2023-11-27T17:49:22.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79c2ffd700 1 -- 172.21.15.177:0/4180181484 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4011d20 con 0x7f79c40cf3c0 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79ca404700 1 -- 172.21.15.177:0/4180181484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c40cf3c0 msgr2=0x7f79c40b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79ca404700 1 --2- 172.21.15.177:0/4180181484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c40cf3c0 0x7f79c40b2150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009840 tx=0x7f79b4009b50 comp rx=0 tx=0).stop 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79ca404700 1 -- 172.21.15.177:0/4180181484 shutdown_connections 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79ca404700 1 --2- 172.21.15.177:0/4180181484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c40cf3c0 0x7f79c40b2150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79ca404700 1 --2- 172.21.15.177:0/4180181484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40b2690 0x7f79c415fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79ca404700 1 -- 172.21.15.177:0/4180181484 >> 172.21.15.177:0/4180181484 conn(0x7f79c4072190 msgr2=0x7f79c40725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79ca404700 1 -- 172.21.15.177:0/4180181484 shutdown_connections 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.163+0000 7f79ca404700 1 -- 172.21.15.177:0/4180181484 wait complete. 2023-11-27T17:49:22.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.164+0000 7f79ca404700 1 Processor -- start 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79ca404700 1 -- start start 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79ca404700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c40b2690 0x7f79c4143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79ca404700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40cf3c0 0x7f79c415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79ca404700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c4160180 0x7f79c415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79ca404700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c41f5f60 con 0x7f79c40b2690 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79ca404700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4146d90 con 0x7f79c4160180 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79ca404700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c41f51a0 con 0x7f79c40cf3c0 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79c3fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c40b2690 0x7f79c4143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79c3fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c40b2690 0x7f79c4143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53504/0 (socket says 172.21.15.177:53504) 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.165+0000 7f79c3fff700 1 -- 172.21.15.177:0/62515075 learned_addr learned my addr 172.21.15.177:0/62515075 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c37fe700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40cf3c0 0x7f79c415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c89a1700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c4160180 0x7f79c415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c3fff700 1 -- 172.21.15.177:0/62515075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40cf3c0 msgr2=0x7f79c415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c3fff700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40cf3c0 0x7f79c415d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c3fff700 1 -- 172.21.15.177:0/62515075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c4160180 msgr2=0x7f79c415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c3fff700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c4160180 0x7f79c415dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c3fff700 1 -- 172.21.15.177:0/62515075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8009550 con 0x7f79c40b2690 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c3fff700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c40b2690 0x7f79c4143460 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009fd0 tx=0x7f79b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c0ff9700 1 -- 172.21.15.177:0/62515075 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4004550 con 0x7f79c40b2690 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c0ff9700 1 -- 172.21.15.177:0/62515075 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b401f070 con 0x7f79c40b2690 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79ca404700 1 -- 172.21.15.177:0/62515075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40094a0 con 0x7f79c40b2690 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79c0ff9700 1 -- 172.21.15.177:0/62515075 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40038e0 con 0x7f79c40b2690 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.166+0000 7f79ca404700 1 -- 172.21.15.177:0/62515075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c41f5760 con 0x7f79c40b2690 2023-11-27T17:49:22.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.168+0000 7f79c0ff9700 1 -- 172.21.15.177:0/62515075 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f79b4003a40 con 0x7f79c40b2690 2023-11-27T17:49:22.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.168+0000 7f79c0ff9700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f79b006b250 0x7f79b006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.168+0000 7f79c0ff9700 1 -- 172.21.15.177:0/62515075 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b4021070 con 0x7f79c40b2690 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.168+0000 7f79c37fe700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f79b006b250 0x7f79b006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.168+0000 7f79c37fe700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f79b006b250 0x7f79b006d710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f79c415c050 tx=0x7f79b80092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.170+0000 7f79d65fdb80 1 Processor -- start 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.170+0000 7f79d65fdb80 1 -- start start 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 0x562a3120a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31225580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a31222e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a31153770 con 0x562a31225ac0 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a3113a750 con 0x562a3120a060 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a31138070 con 0x562a31226ab0 2023-11-27T17:49:22.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a31222e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 0x562a3120a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a31222e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53516/0 (socket says 172.21.15.177:53516) 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 -- 172.21.15.177:0/2807503763 learned_addr learned my addr 172.21.15.177:0/2807503763 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c37fe700 1 --2- 172.21.15.177:0/2807503763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31225580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 -- 172.21.15.177:0/2807503763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 msgr2=0x562a31225580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 --2- 172.21.15.177:0/2807503763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31225580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 -- 172.21.15.177:0/2807503763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 msgr2=0x562a3120a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 --2- 172.21.15.177:0/2807503763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 0x562a3120a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 -- 172.21.15.177:0/2807503763 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a30fb05e0 con 0x562a31225ac0 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79c89a1700 1 --2- 172.21.15.177:0/2807503763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a31222e00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f79bc002190 tx=0x7f79bc007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cdd9b8820f1f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79a9ffb700 1 -- 172.21.15.177:0/2807503763 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc001e40 con 0x562a31225ac0 2023-11-27T17:49:22.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79a9ffb700 1 -- 172.21.15.177:0/2807503763 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc007a50 con 0x562a31225ac0 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.171+0000 7f79a9ffb700 1 -- 172.21.15.177:0/2807503763 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc0135f0 con 0x562a31225ac0 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2807503763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 msgr2=0x562a31222e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2807503763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a31222e00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f79bc002190 tx=0x7f79bc007340 comp rx=0 tx=0).stop 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2807503763 shutdown_connections 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2807503763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a31222e00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2807503763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 0x562a3120a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2807503763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31225580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2807503763 >> 172.21.15.177:0/2807503763 conn(0x562a3110e310 msgr2=0x562a31224e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:22.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2807503763 shutdown_connections 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.172+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2807503763 wait complete. 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.173+0000 7f79d65fdb80 1 -- start start 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.173+0000 7f79d65fdb80 1 Processor -- start 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a3120a060 0x562a3120dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 0x562a312068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31226ab0 0x562a31206e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a31133960 con 0x562a31226ab0 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a310ed510 con 0x562a31225ac0 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a310ed1b0 con 0x562a3120a060 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 10 client.0 _ll_register_callbacks cb 0x562a31018a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31226ab0 0x562a31206e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31226ab0 0x562a31206e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53522/0 (socket says 172.21.15.177:53522) 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 -- 172.21.15.177:0/2396905190 learned_addr learned my addr 172.21.15.177:0/2396905190 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c37fe700 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 0x562a312068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c3fff700 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a3120a060 0x562a3120dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 -- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a3120a060 msgr2=0x562a3120dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a3120a060 0x562a3120dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 -- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 msgr2=0x562a312068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 0x562a312068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 -- 172.21.15.177:0/2396905190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c40b2af0 con 0x562a31226ab0 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c3fff700 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a3120a060 0x562a3120dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79c89a1700 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31226ab0 0x562a31206e00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79bc007690 tx=0x7f79bc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcde4a8f987faab server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-27T17:49:22.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79a2ffd700 1 -- 172.21.15.177:0/2396905190 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc001740 con 0x562a31226ab0 2023-11-27T17:49:22.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79a2ffd700 1 -- 172.21.15.177:0/2396905190 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79bc01c650 con 0x562a31226ab0 2023-11-27T17:49:22.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2396905190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a311d2a40 con 0x562a31226ab0 2023-11-27T17:49:22.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79a2ffd700 1 -- 172.21.15.177:0/2396905190 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79bc01c810 con 0x562a31226ab0 2023-11-27T17:49:22.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 10 client.5232 fetch_fsmap learned FSMap version 16 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.174+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2396905190 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x562a30f5cd90 con 0x562a31226ab0 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79a2ffd700 1 -- 172.21.15.177:0/2396905190 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a311d2a40 con 0x562a31226ab0 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79a2ffd700 1 -- 172.21.15.177:0/2396905190 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f79bc012070 con 0x562a31226ab0 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79d65fdb80 10 client.5232 fetch_fsmap finished waiting for FSMap version 16 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79d65fdb80 10 client.5232 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79d65fdb80 20 client.5232 populate_metadata read hostname 'smithi177' 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] conn(0x562a311f5ab0 0x562a311f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79d65fdb80 4 client.5232 mds_command: new command op to 5034 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2396905190 --> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a311ae840 con 0x562a311f5ab0 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79c3fff700 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] conn(0x562a311f5ab0 0x562a311f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79a2ffd700 10 client.5232 ms_handle_connect on v2:172.21.15.177:6835/1746694137 2023-11-27T17:49:22.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.175+0000 7f79c3fff700 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] conn(0x562a311f5ab0 0x562a311f4cd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6899def279923d23 server_cookie=62481bf64f28a42a in_seq=0 out_seq=0 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79a2ffd700 1 -- 172.21.15.177:0/2396905190 <== mds.0 v2:172.21.15.177:6835/1746694137 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562a311ae840 con 0x562a311f5ab0 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79a2ffd700 10 client.5232 handle_command_reply: tid=0 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 client.5232 shutdown 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2396905190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31226ab0 msgr2=0x562a31206e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31226ab0 0x562a31206e00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79bc007690 tx=0x7f79bc012000 comp rx=0 tx=0).stop 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2396905190 shutdown_connections 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] conn(0x562a311f5ab0 0x562a311f4cd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31226ab0 0x562a31206e00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79a2ffd700 0 client.5232 ms_handle_reset on v2:172.21.15.177:6835/1746694137 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a3120a060 0x562a3120dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/2396905190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 0x562a312068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2396905190 >> 172.21.15.177:0/2396905190 conn(0x562a3110e310 msgr2=0x562a311dfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:22.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2396905190 shutdown_connections 2023-11-27T17:49:22.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 1 -- 172.21.15.177:0/2396905190 wait complete. 2023-11-27T17:49:22.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.176+0000 7f79d65fdb80 20 client.5232 trim_cache size 0 max 16384 2023-11-27T17:49:22.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.194+0000 7f79d65fdb80 1 Processor -- start 2023-11-27T17:49:22.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.194+0000 7f79d65fdb80 1 -- start start 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 0x562a3121c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a3120d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31224e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a30fb28d0 con 0x562a31225ac0 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a3120e180 con 0x562a3120a060 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a311dfb10 con 0x562a31226ab0 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a3120d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a3120d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53528/0 (socket says 172.21.15.177:53528) 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 -- 172.21.15.177:0/57590152 learned_addr learned my addr 172.21.15.177:0/57590152 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:22.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c3fff700 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 0x562a3121c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c89a1700 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31224e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 -- 172.21.15.177:0/57590152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 msgr2=0x562a31224e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31224e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 -- 172.21.15.177:0/57590152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 msgr2=0x562a3121c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 0x562a3121c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 -- 172.21.15.177:0/57590152 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a31226270 con 0x562a31225ac0 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79c37fe700 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a3120d010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f79b8014440 tx=0x7f79b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeffbaaff276c792 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79aa7fc700 1 -- 172.21.15.177:0/57590152 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b802c470 con 0x562a31225ac0 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79aa7fc700 1 -- 172.21.15.177:0/57590152 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b802c5d0 con 0x562a31225ac0 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.195+0000 7f79aa7fc700 1 -- 172.21.15.177:0/57590152 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b802c940 con 0x562a31225ac0 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 -- 172.21.15.177:0/57590152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 msgr2=0x562a3120d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a3120d010 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f79b8014440 tx=0x7f79b8014000 comp rx=0 tx=0).stop 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 -- 172.21.15.177:0/57590152 shutdown_connections 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31224e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a3120a060 0x562a3121c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/57590152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a31225ac0 0x562a3120d010 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 -- 172.21.15.177:0/57590152 >> 172.21.15.177:0/57590152 conn(0x562a3110e310 msgr2=0x562a31221950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 -- 172.21.15.177:0/57590152 shutdown_connections 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 -- 172.21.15.177:0/57590152 wait complete. 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.196+0000 7f79d65fdb80 1 -- start start 2023-11-27T17:49:22.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79d65fdb80 1 Processor -- start 2023-11-27T17:49:22.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a3120a060 0x562a31206d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 0x562a312283f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79d65fdb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31224e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a31223b20 con 0x562a3120a060 2023-11-27T17:49:22.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a31207290 con 0x562a31225ac0 2023-11-27T17:49:22.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79d65fdb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a31229070 con 0x562a31226ab0 2023-11-27T17:49:22.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79d65fdb80 10 client.0 _ll_register_callbacks cb 0x7f79b4055fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79c3fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a3120a060 0x562a31206d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.197+0000 7f79c3fff700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a3120a060 0x562a31206d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53532/0 (socket says 172.21.15.177:53532) 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c3fff700 1 -- 172.21.15.177:0/3916127569 learned_addr learned my addr 172.21.15.177:0/3916127569 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c89a1700 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31224e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c37fe700 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 0x562a312283f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c3fff700 1 -- 172.21.15.177:0/3916127569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 msgr2=0x562a31224e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c3fff700 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31224e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c3fff700 1 -- 172.21.15.177:0/3916127569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 msgr2=0x562a312283f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c3fff700 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 0x562a312283f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c3fff700 1 -- 172.21.15.177:0/3916127569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b8011ca0 con 0x562a3120a060 2023-11-27T17:49:22.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79c3fff700 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a3120a060 0x562a31206d50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f79b4059ba0 tx=0x7f79b408b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb8142aff893b22 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79a2ffd700 1 -- 172.21.15.177:0/3916127569 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4076070 con 0x562a3120a060 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79a2ffd700 1 -- 172.21.15.177:0/3916127569 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b4059c60 con 0x562a3120a060 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 1 -- 172.21.15.177:0/3916127569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79bc007a50 con 0x562a3120a060 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79a2ffd700 1 -- 172.21.15.177:0/3916127569 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79b405ddb0 con 0x562a3120a060 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 10 client.5238 fetch_fsmap learned FSMap version 16 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 1 -- 172.21.15.177:0/3916127569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x562a30f45c10 con 0x562a3120a060 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79a2ffd700 1 -- 172.21.15.177:0/3916127569 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc007a50 con 0x562a3120a060 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79a2ffd700 1 -- 172.21.15.177:0/3916127569 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f79b4059ec0 con 0x562a3120a060 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 10 client.5238 fetch_fsmap finished waiting for FSMap version 16 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 10 client.5238 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T17:49:22.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 20 client.5238 populate_metadata read hostname 'smithi177' 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] conn(0x562a312253b0 0x562a311d9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 4 client.5238 mds_command: new command op to 5034 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.198+0000 7f79d65fdb80 1 -- 172.21.15.177:0/3916127569 --> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562a310f9f80 con 0x562a312253b0 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79c37fe700 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] conn(0x562a312253b0 0x562a311d9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79a2ffd700 10 client.5238 ms_handle_connect on v2:172.21.15.177:6835/1746694137 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79c37fe700 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] conn(0x562a312253b0 0x562a311d9f20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631d1c860c047ea5 server_cookie=7ad1486b188fb7cd in_seq=0 out_seq=0 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79a2ffd700 1 -- 172.21.15.177:0/3916127569 <== mds.0 v2:172.21.15.177:6835/1746694137 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562a310f9f80 con 0x562a312253b0 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79a2ffd700 10 client.5238 handle_command_reply: tid=0 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 client.5238 shutdown 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 -- 172.21.15.177:0/3916127569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a3120a060 msgr2=0x562a31206d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a3120a060 0x562a31206d50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f79b4059ba0 tx=0x7f79b408b040 comp rx=0 tx=0).stop 2023-11-27T17:49:22.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 -- 172.21.15.177:0/3916127569 shutdown_connections 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.177:6835/1746694137,v1:172.21.15.177:6837/1746694137] conn(0x562a312253b0 0x562a311d9f20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562a31226ab0 0x562a31224e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562a3120a060 0x562a31206d50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 --2- 172.21.15.177:0/3916127569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562a31225ac0 0x562a312283f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79a2ffd700 0 client.5238 ms_handle_reset on v2:172.21.15.177:6835/1746694137 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 -- 172.21.15.177:0/3916127569 >> 172.21.15.177:0/3916127569 conn(0x562a3110e310 msgr2=0x562a3120d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 -- 172.21.15.177:0/3916127569 shutdown_connections 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 1 -- 172.21.15.177:0/3916127569 wait complete. 2023-11-27T17:49:22.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.199+0000 7f79d65fdb80 20 client.5238 trim_cache size 0 max 16384 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "9352b089-d7fa-4b22-a837-e414c87a0ebc", 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5034, 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 10.434788407999999, 2023-11-27T17:49:22.210 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 16, 2023-11-27T17:49:22.211 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 33, 2023-11-27T17:49:22.211 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 33, 2023-11-27T17:49:22.211 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 18.915525398 2023-11-27T17:49:22.211 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-11-27T17:49:22.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 -- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f79b006b250 msgr2=0x7f79b006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f79b006b250 0x7f79b006d710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f79c415c050 tx=0x7f79b80092c0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 -- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c40b2690 msgr2=0x7f79c4143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c40b2690 0x7f79c4143460 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009fd0 tx=0x7f79b4004750 comp rx=0 tx=0).stop 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 -- 172.21.15.177:0/62515075 shutdown_connections 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f79b006b250 0x7f79b006d710 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c4160180 0x7f79c415dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c40b2690 0x7f79c4143460 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 --2- 172.21.15.177:0/62515075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c40cf3c0 0x7f79c415d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 -- 172.21.15.177:0/62515075 >> 172.21.15.177:0/62515075 conn(0x7f79c4072190 msgr2=0x7f79c406ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 -- 172.21.15.177:0/62515075 shutdown_connections 2023-11-27T17:49:22.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.200+0000 7f79ca404700 1 -- 172.21.15.177:0/62515075 wait complete. 2023-11-27T17:49:22.214 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T17:49:22.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.332+0000 7f6defc3c700 1 Processor -- start 2023-11-27T17:49:22.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.332+0000 7f6defc3c700 1 -- start start 2023-11-27T17:49:22.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6defc3c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6de815e880 0x7f6de806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6defc3c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6de806dcf0 0x7f6de815b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6defc3c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de806e520 con 0x7f6de806d910 2023-11-27T17:49:22.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6defc3c700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de806efc0 con 0x7f6de815e880 2023-11-27T17:49:22.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6defc3c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de806f2a0 con 0x7f6de806dcf0 2023-11-27T17:49:22.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded1d7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6de815e880 0x7f6de806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded1d7700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6de815e880 0x7f6de806e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53544/0 (socket says 172.21.15.177:53544) 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded9d8700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6de806d910 0x7f6de80b05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47858/0 (socket says 172.21.15.177:47858) 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded1d7700 1 -- 172.21.15.177:0/2665966666 learned_addr learned my addr 172.21.15.177:0/2665966666 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6dee1d9700 1 --2- 172.21.15.177:0/2665966666 >> v2:172.21.15.178:3300/0 conn(0x7f6de806dcf0 0x7f6de815b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded1d7700 1 -- 172.21.15.177:0/2665966666 >> v2:172.21.15.178:3300/0 conn(0x7f6de806dcf0 msgr2=0x7f6de815b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded1d7700 1 --2- 172.21.15.177:0/2665966666 >> v2:172.21.15.178:3300/0 conn(0x7f6de806dcf0 0x7f6de815b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded1d7700 1 -- 172.21.15.177:0/2665966666 >> v1:172.21.15.177:6789/0 conn(0x7f6de806d910 legacy=0x7f6de80b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded1d7700 1 -- 172.21.15.177:0/2665966666 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de806f580 con 0x7f6de815e880 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6dec9d6700 1 -- 172.21.15.177:0/2665966666 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235750833 0 0) 0x7f6de806e520 con 0x7f6de806d910 2023-11-27T17:49:22.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6dee1d9700 1 --2- 172.21.15.177:0/2665966666 >> v2:172.21.15.178:3300/0 conn(0x7f6de806dcf0 0x7f6de815b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.333+0000 7f6ded1d7700 1 --2- 172.21.15.177:0/2665966666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de806e8c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6de806f990 tx=0x7f6dd800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb06bd0b22ea0b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6dec9d6700 1 -- 172.21.15.177:0/2665966666 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800dd30 con 0x7f6de815e880 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6dec9d6700 1 -- 172.21.15.177:0/2665966666 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd800de90 con 0x7f6de815e880 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6dec9d6700 1 -- 172.21.15.177:0/2665966666 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8010690 con 0x7f6de815e880 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6defc3c700 1 -- 172.21.15.177:0/2665966666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 msgr2=0x7f6de806e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6defc3c700 1 --2- 172.21.15.177:0/2665966666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de806e8c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6de806f990 tx=0x7f6dd800be70 comp rx=0 tx=0).stop 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6defc3c700 1 -- 172.21.15.177:0/2665966666 shutdown_connections 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6defc3c700 1 --2- 172.21.15.177:0/2665966666 >> v2:172.21.15.178:3300/0 conn(0x7f6de806dcf0 0x7f6de815b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6defc3c700 1 --2- 172.21.15.177:0/2665966666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de806e8c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6defc3c700 1 -- 172.21.15.177:0/2665966666 >> 172.21.15.177:0/2665966666 conn(0x7f6de80b2130 msgr2=0x7f6de80b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6defc3c700 1 -- 172.21.15.177:0/2665966666 shutdown_connections 2023-11-27T17:49:22.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.334+0000 7f6defc3c700 1 -- 172.21.15.177:0/2665966666 wait complete. 2023-11-27T17:49:22.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6defc3c700 1 Processor -- start 2023-11-27T17:49:22.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6defc3c700 1 -- start start 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6defc3c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6de806d910 0x7f6de80cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6defc3c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6de806dcf0 0x7f6de81eff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6defc3c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de80ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6defc3c700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80aa820 con 0x7f6de815e880 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6defc3c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80cd930 con 0x7f6de806d910 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6defc3c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81f0490 con 0x7f6de806dcf0 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6dee1d9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de80ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6dee1d9700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de80ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53550/0 (socket says 172.21.15.177:53550) 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.336+0000 7f6dee1d9700 1 -- 172.21.15.177:0/671067150 learned_addr learned my addr 172.21.15.177:0/671067150 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6ded9d8700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6de806d910 0x7f6de80cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6ded1d7700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6de806dcf0 0x7f6de81eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dee1d9700 1 -- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6de806dcf0 msgr2=0x7f6de81eff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dee1d9700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6de806dcf0 0x7f6de81eff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dee1d9700 1 -- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6de806d910 msgr2=0x7f6de80cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dee1d9700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6de806d910 0x7f6de80cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dee1d9700 1 -- 172.21.15.177:0/671067150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd800b7f0 con 0x7f6de815e880 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6ded9d8700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6de806d910 0x7f6de80cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dee1d9700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de80ab340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6de000cef0 tx=0x7f6de000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dde7fc700 1 -- 172.21.15.177:0/671067150 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000adb0 con 0x7f6de815e880 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dde7fc700 1 -- 172.21.15.177:0/671067150 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0015440 con 0x7f6de815e880 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de8156130 con 0x7f6de815e880 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6dde7fc700 1 -- 172.21.15.177:0/671067150 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00157f0 con 0x7f6de815e880 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.337+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de80a9a60 con 0x7f6de815e880 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.338+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de8073aa0 con 0x7f6de815e880 2023-11-27T17:49:22.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.338+0000 7f6dde7fc700 1 -- 172.21.15.177:0/671067150 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6de000d430 con 0x7f6de815e880 2023-11-27T17:49:22.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.339+0000 7f6dde7fc700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6dcc06b250 0x7f6dcc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:49:22.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.339+0000 7f6ded9d8700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6dcc06b250 0x7f6dcc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:49:22.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.339+0000 7f6dde7fc700 1 -- 172.21.15.177:0/671067150 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6de008a000 con 0x7f6de815e880 2023-11-27T17:49:22.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.339+0000 7f6ded9d8700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6dcc06b250 0x7f6dcc06d710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6de4000f60 tx=0x7f6de4007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:49:22.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.343+0000 7f6dde7fc700 1 -- 172.21.15.177:0/671067150 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6de0054cb0 con 0x7f6de815e880 2023-11-27T17:49:22.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.578+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6de804fae0 con 0x7f6de815e880 2023-11-27T17:49:22.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.579+0000 7f6dde7fc700 1 -- 172.21.15.177:0/671067150 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6de00582d0 con 0x7f6de815e880 2023-11-27T17:49:22.581 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T17:49:22.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6dcc06b250 msgr2=0x7f6dcc06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6dcc06b250 0x7f6dcc06d710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6de4000f60 tx=0x7f6de4007ca0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 msgr2=0x7f6de80ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de80ab340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6de000cef0 tx=0x7f6de000cf20 comp rx=0 tx=0).stop 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 shutdown_connections 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f6dcc06b250 0x7f6dcc06d710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6de815e880 0x7f6de80ab340 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6de806d910 0x7f6de80cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 --2- 172.21.15.177:0/671067150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6de806dcf0 0x7f6de81eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 >> 172.21.15.177:0/671067150 conn(0x7f6de80b2130 msgr2=0x7f6de81568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 shutdown_connections 2023-11-27T17:49:22.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:49:22.581+0000 7f6defc3c700 1 -- 172.21.15.177:0/671067150 wait complete. 2023-11-27T17:49:22.595 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T17:49:22.595 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T17:49:22.595 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-11-27T17:49:22.596 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T17:49:22.596 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T17:49:22.596 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T17:49:22.596 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T17:49:22.596 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T17:49:22.596 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:49:22.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:22.596 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-11-27T17:49:22.613 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:49:22.613 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:49:22.614 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 41517sec preferred_lft 41517sec 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c8c9:8ccb:1861:d7ec/64 scope link noprefixroute 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T17:49:22.615 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether ba:82:c5:a8:13:99 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e8eb:2eff:fee2:92e6/64 scope link 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether ba:82:c5:a8:13:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::b882:c5ff:fea8:1399/64 scope link 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:49:22.616 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T17:49:22.617 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:82:a8:f5:4a:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T17:49:22.617 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c482:a8ff:fef5:4a55/64 scope link 2023-11-27T17:49:22.617 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:49:22.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:22.617 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T17:49:22.679 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-11-27T17:49:22.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:22.681 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-11-27T17:49:22.740 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-11-27T17:49:22.740 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T17:49:22.740 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T17:49:22.740 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T17:49:22.740 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T17:49:22.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:22.740 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-11-27T17:49:22.740 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-11-27T17:49:22.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T17:49:22.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T17:49:22.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T17:49:22.741 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-11-27T17:49:22.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:22.844 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-11-27T17:49:22.861 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-27T17:49:22.861 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T17:49:22.861 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:49:22.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:22.861 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-11-27T17:49:22.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:49:22.929 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T17:49:22.985 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:49:22.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:49:22.985 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T17:49:23.042 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-27T17:49:23.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:23.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:49:23.127 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:49:23.127 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:49:23.150 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:49:23.150 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:49:23.150 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:49:23.150 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 0@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:49:23.150 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:49:23.150 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:49:23.150 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:49:23.150 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 0@9352b089-d7fa-4b22-a837-e414c87a0ebc.cephfs=/ 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.177:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: v2 mount support check returned 2 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: kernel does not support v2 syntax 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790" 2023-11-27T17:49:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.177:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2023-11-27T17:49:23.186 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=9352b089-d7fa-4b22-a837-e414c87a0ebc" will pass to kernel 2023-11-27T17:49:23.203 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T17:49:23.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:23.204 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T17:49:23.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:23.233 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:49:23.306 INFO:teuthology.orchestra.run.smithi177.stdout:client4811 2023-11-27T17:49:23.306 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:49:23.307 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:49:23.363 DEBUG:teuthology.orchestra.run.smithi177:> mktemp -d --suffix=xfstests-dev 2023-11-27T17:49:23.419 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.nfQXm1uy9xxfstests-dev 2023-11-27T17:49:23.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:23.419 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.nfQXm1uy9xxfstests-dev) 2023-11-27T17:49:23.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:23.486 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.nfQXm1uy9xxfstests-dev) 2023-11-27T17:49:23.543 INFO:teuthology.orchestra.run.smithi177.stderr:Cloning into '/tmp/tmp.nfQXm1uy9xxfstests-dev'... 2023-11-27T17:49:24.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:24.230 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-27T17:49:24.289 DEBUG:teuthology.orchestra.run.smithi177:> mktemp -d --suffix=test 2023-11-27T17:49:24.347 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.ANA1mbzVgttest 2023-11-27T17:49:24.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:49:24.347 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-27T17:49:24.405 DEBUG:teuthology.orchestra.run.smithi177:> mktemp -d --suffix=scratch 2023-11-27T17:49:24.462 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:49:24.463 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-11-27T17:49:24.463 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-11-27T17:49:24.861 INFO:teuthology.orchestra.run.smithi177.stdout:Updating Subscription Management repositories. 2023-11-27T17:49:26.401 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:05 ago on Mon 27 Nov 2023 05:44:21 PM UTC. 2023-11-27T17:49:27.687 INFO:teuthology.orchestra.run.smithi177.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-11-27T17:49:27.688 INFO:teuthology.orchestra.run.smithi177.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-11-27T17:49:27.689 INFO:teuthology.orchestra.run.smithi177.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-11-27T17:49:27.690 INFO:teuthology.orchestra.run.smithi177.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-11-27T17:49:27.691 INFO:teuthology.orchestra.run.smithi177.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-11-27T17:49:27.694 INFO:teuthology.orchestra.run.smithi177.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-11-27T17:49:27.696 INFO:teuthology.orchestra.run.smithi177.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-11-27T17:49:27.697 INFO:teuthology.orchestra.run.smithi177.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-11-27T17:49:27.699 INFO:teuthology.orchestra.run.smithi177.stdout:Package git-2.31.1-2.el8.x86_64 is already installed. 2023-11-27T17:49:27.702 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-27T17:49:27.703 INFO:teuthology.orchestra.run.smithi177.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-11-27T17:49:27.705 INFO:teuthology.orchestra.run.smithi177.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-11-27T17:49:27.706 INFO:teuthology.orchestra.run.smithi177.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-11-27T17:49:27.708 INFO:teuthology.orchestra.run.smithi177.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-11-27T17:49:27.709 INFO:teuthology.orchestra.run.smithi177.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-11-27T17:49:27.710 INFO:teuthology.orchestra.run.smithi177.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-11-27T17:49:27.714 INFO:teuthology.orchestra.run.smithi177.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-11-27T17:49:27.715 INFO:teuthology.orchestra.run.smithi177.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-11-27T17:49:27.716 INFO:teuthology.orchestra.run.smithi177.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-11-27T17:49:27.718 INFO:teuthology.orchestra.run.smithi177.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-11-27T17:49:27.720 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-27T17:49:27.838 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: gdbm-devel x86_64 1:1.18-1.el8 rhel-8-for-x86_64-baseos-rpms 66 k 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-devel x86_64 4.18.0-372.32.1.el8_6 2023-11-27T17:49:27.840 INFO:teuthology.orchestra.run.smithi177.stdout: rhel-8-for-x86_64-baseos-rpms 21 M 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: libcap-devel x86_64 2.48-2.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: udftools x86_64 2.3-2.el8 rhel-8-for-x86_64-appstream-rpms 160 k 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2023-11-27T17:49:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2023-11-27T17:49:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:Install 11 Packages 2023-11-27T17:49:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 2 Packages 2023-11-27T17:49:27.842 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 24 M 2023-11-27T17:49:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2023-11-27T17:49:28.509 INFO:teuthology.orchestra.run.smithi177.stdout:(1/13): gdbm-devel-1.18-1.el8.x86_64.rpm 198 kB/s | 66 kB 00:00 2023-11-27T17:49:28.585 INFO:teuthology.orchestra.run.smithi177.stdout:(2/13): dump-0.4-0.36.b46.el8.x86_64.rpm 403 kB/s | 164 kB 00:00 2023-11-27T17:49:28.768 INFO:teuthology.orchestra.run.smithi177.stdout:(3/13): rmt-1.5.3-13.el8.x86_64.rpm 199 kB/s | 51 kB 00:00 2023-11-27T17:49:28.802 INFO:teuthology.orchestra.run.smithi177.stdout:(4/13): indent-2.2.13-4.el8.x86_64.rpm 299 kB/s | 187 kB 00:00 2023-11-27T17:49:28.877 INFO:teuthology.orchestra.run.smithi177.stdout:(5/13): daxctl-libs-71.1-3.el8.x86_64.rpm 143 kB/s | 42 kB 00:00 2023-11-27T17:49:29.011 INFO:teuthology.orchestra.run.smithi177.stdout:(6/13): libcap-devel-2.48-2.el8.x86_64.rpm 172 kB/s | 42 kB 00:00 2023-11-27T17:49:29.036 INFO:teuthology.orchestra.run.smithi177.stdout:(7/13): ndctl-libs-71.1-3.el8.x86_64.rpm 337 kB/s | 79 kB 00:00 2023-11-27T17:49:29.278 INFO:teuthology.orchestra.run.smithi177.stdout:(8/13): fio-3.19-3.el8.x86_64.rpm 2.0 MB/s | 538 kB 00:00 2023-11-27T17:49:29.303 INFO:teuthology.orchestra.run.smithi177.stdout:(9/13): udftools-2.3-2.el8.x86_64.rpm 598 kB/s | 160 kB 00:00 2023-11-27T17:49:29.520 INFO:teuthology.orchestra.run.smithi177.stdout:(10/13): libpmemblk-1.6.1-1.el8.x86_64.rpm 380 kB/s | 92 kB 00:00 2023-11-27T17:49:29.713 INFO:teuthology.orchestra.run.smithi177.stdout:(11/13): kernel-devel-4.18.0-372.32.1.el8_6.x86 26 MB/s | 21 MB 00:00 2023-11-27T17:49:29.746 INFO:teuthology.orchestra.run.smithi177.stdout:(12/13): sqlite-3.26.0-16.el8_6.x86_64.rpm 1.5 MB/s | 668 kB 00:00 2023-11-27T17:49:29.771 INFO:teuthology.orchestra.run.smithi177.stdout:(13/13): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 2.3 MB/s | 581 kB 00:00 2023-11-27T17:49:29.772 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2023-11-27T17:49:29.772 INFO:teuthology.orchestra.run.smithi177.stdout:Total 12 MB/s | 24 MB 00:01 2023-11-27T17:49:30.056 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2023-11-27T17:49:30.127 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2023-11-27T17:49:30.128 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2023-11-27T17:49:30.544 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2023-11-27T17:49:30.548 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2023-11-27T17:49:31.327 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2023-11-27T17:49:31.509 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/15 2023-11-27T17:49:31.582 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/15 2023-11-27T17:49:31.801 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/15 2023-11-27T17:49:31.877 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/15 2023-11-27T17:49:32.042 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/15 2023-11-27T17:49:32.171 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/15 2023-11-27T17:49:32.349 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/15 2023-11-27T17:49:32.510 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/15 2023-11-27T17:49:32.757 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/15 2023-11-27T17:49:33.078 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/15 2023-11-27T17:49:33.349 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fio-3.19-3.el8.x86_64 8/15 2023-11-27T17:49:41.487 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : udftools-2.3-2.el8.x86_64 9/15 2023-11-27T17:49:41.982 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-devel-4.18.0-372.32.1.el8_6.x86_64 10/15 2023-11-27T17:49:50.261 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:49:50.264 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:49:50.668 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-devel-4.18.0-372.32.1.el8_6.x86_64 10/15 2023-11-27T17:49:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcap-devel-2.48-2.el8.x86_64 11/15 2023-11-27T17:49:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gdbm-devel-1:1.18-1.el8.x86_64 12/15 2023-11-27T17:49:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: gdbm-devel-1:1.18-1.el8.x86_64 12/15 2023-11-27T17:49:51.248 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : indent-2.2.13-4.el8.x86_64 13/15 2023-11-27T17:49:51.398 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 14/15 2023-11-27T17:49:51.554 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 15/15 2023-11-27T17:49:51.948 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 15/15 2023-11-27T17:49:51.948 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/15 2023-11-27T17:49:51.948 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gdbm-devel-1:1.18-1.el8.x86_64 2/15 2023-11-27T17:49:51.948 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 3/15 2023-11-27T17:49:51.948 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 4/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 5/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcap-devel-2.48-2.el8.x86_64 6/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 7/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-devel-4.18.0-372.32.1.el8_6.x86_64 8/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fio-3.19-3.el8.x86_64 9/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : udftools-2.3-2.el8.x86_64 10/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 11/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 12/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 13/15 2023-11-27T17:49:51.949 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 14/15 2023-11-27T17:49:53.337 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 15/15 2023-11-27T17:49:53.337 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:32 ago on Mon 27 Nov 2023 05:44:21 PM UTC. 2023-11-27T17:49:58.310 INFO:teuthology.orchestra.run.smithi177.stdout:Installed products updated. 2023-11-27T17:49:58.498 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:58.498 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2023-11-27T17:49:58.499 INFO:teuthology.orchestra.run.smithi177.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-11-27T17:49:58.499 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2023-11-27T17:49:58.499 INFO:teuthology.orchestra.run.smithi177.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-11-27T17:49:58.499 INFO:teuthology.orchestra.run.smithi177.stdout: fio-3.19-3.el8.x86_64 gdbm-devel-1:1.18-1.el8.x86_64 2023-11-27T17:49:58.499 INFO:teuthology.orchestra.run.smithi177.stdout: indent-2.2.13-4.el8.x86_64 kernel-devel-4.18.0-372.32.1.el8_6.x86_64 2023-11-27T17:49:58.499 INFO:teuthology.orchestra.run.smithi177.stdout: libcap-devel-2.48-2.el8.x86_64 libpmemblk-1.6.1-1.el8.x86_64 2023-11-27T17:49:58.500 INFO:teuthology.orchestra.run.smithi177.stdout: ndctl-libs-71.1-3.el8.x86_64 rmt-2:1.5.3-13.el8.x86_64 2023-11-27T17:49:58.500 INFO:teuthology.orchestra.run.smithi177.stdout: udftools-2.3-2.el8.x86_64 2023-11-27T17:49:58.500 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:49:58.500 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2023-11-27T17:49:58.682 DEBUG:teuthology.orchestra.run.smithi177:> sudo useradd -m fsgqa 2023-11-27T17:49:58.709 INFO:teuthology.orchestra.run.smithi177.stderr:useradd: user 'fsgqa' already exists 2023-11-27T17:49:58.711 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-27T17:49:58.711 DEBUG:teuthology.orchestra.run.smithi177:> sudo groupadd fsgqa 2023-11-27T17:49:58.777 INFO:teuthology.orchestra.run.smithi177.stderr:groupadd: group 'fsgqa' already exists 2023-11-27T17:49:58.779 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-27T17:49:58.779 DEBUG:teuthology.orchestra.run.smithi177:> sudo useradd fsgqa2 2023-11-27T17:49:59.722 DEBUG:teuthology.orchestra.run.smithi177:> sudo useradd 123456-fsgqa 2023-11-27T17:50:00.587 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-27T17:50:00.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.726+0000 7f20ec1ad700 1 Processor -- start 2023-11-27T17:50:00.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.726+0000 7f20ec1ad700 1 -- start start 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ec1ad700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 0x7f20e40cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ec1ad700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f20e40ccd70 0x7f20e40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ec1ad700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e415fb90 con 0x7f20e4071190 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ec1ad700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e40cd760 con 0x7f20e40ccd70 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ec1ad700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40716e0 con 0x7f20e40ae9b0 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ea74a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f20e40ccd70 0x7f20e40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ea74a700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f20e40ccd70 0x7f20e40cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53580/0 (socket says 172.21.15.177:53580) 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20e9748700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f20e4071190 0x7f20e40cb780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47896/0 (socket says 172.21.15.177:47896) 2023-11-27T17:50:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ea74a700 1 -- 172.21.15.177:0/3615401983 learned_addr learned my addr 172.21.15.177:0/3615401983 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20e9f49700 1 --2- 172.21.15.177:0/3615401983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 0x7f20e40cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ea74a700 1 -- 172.21.15.177:0/3615401983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 msgr2=0x7f20e40cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ea74a700 1 --2- 172.21.15.177:0/3615401983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 0x7f20e40cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ea74a700 1 -- 172.21.15.177:0/3615401983 >> v1:172.21.15.177:6789/0 conn(0x7f20e4071190 legacy=0x7f20e40cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20e8f47700 1 -- 172.21.15.177:0/3615401983 <== mon.0 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018217074 0 0) 0x7f20e415fb90 con 0x7f20e4071190 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ea74a700 1 -- 172.21.15.177:0/3615401983 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40719c0 con 0x7f20e40ccd70 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.727+0000 7f20ea74a700 1 --2- 172.21.15.177:0/3615401983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e40ccd70 0x7f20e40cd220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009e50 tx=0x7f20dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f83bd3f85ecd67b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20e8f47700 1 -- 172.21.15.177:0/3615401983 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00e070 con 0x7f20e40ccd70 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20e8f47700 1 -- 172.21.15.177:0/3615401983 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc00b910 con 0x7f20e40ccd70 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20e8f47700 1 -- 172.21.15.177:0/3615401983 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00bcc0 con 0x7f20e40ccd70 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20ec1ad700 1 -- 172.21.15.177:0/3615401983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e40ccd70 msgr2=0x7f20e40cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:00.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/3615401983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e40ccd70 0x7f20e40cd220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009e50 tx=0x7f20dc00b330 comp rx=0 tx=0).stop 2023-11-27T17:50:00.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20ec1ad700 1 -- 172.21.15.177:0/3615401983 shutdown_connections 2023-11-27T17:50:00.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/3615401983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e40ccd70 0x7f20e40cd220 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:00.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/3615401983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 0x7f20e40cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:00.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20ec1ad700 1 -- 172.21.15.177:0/3615401983 >> 172.21.15.177:0/3615401983 conn(0x7f20e40b15d0 msgr2=0x7f20e40b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:50:00.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20ec1ad700 1 -- 172.21.15.177:0/3615401983 shutdown_connections 2023-11-27T17:50:00.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.728+0000 7f20ec1ad700 1 -- 172.21.15.177:0/3615401983 wait complete. 2023-11-27T17:50:00.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20ec1ad700 1 Processor -- start 2023-11-27T17:50:00.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20ec1ad700 1 -- start start 2023-11-27T17:50:00.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20ec1ad700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e4071190 0x7f20e41f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:00.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20ec1ad700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 0x7f20e4152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:00.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20ec1ad700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20e40ccd70 0x7f20e40b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20ec1ad700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41f70b0 con 0x7f20e4071190 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20ec1ad700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40adaf0 con 0x7f20e40ccd70 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20ec1ad700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41f4070 con 0x7f20e40ae9b0 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20e9f49700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e4071190 0x7f20e41f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20e9f49700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e4071190 0x7f20e41f7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53582/0 (socket says 172.21.15.177:53582) 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.730+0000 7f20e9f49700 1 -- 172.21.15.177:0/2245533140 learned_addr learned my addr 172.21.15.177:0/2245533140 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20e9f49700 1 -- 172.21.15.177:0/2245533140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 msgr2=0x7f20e4152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20e9f49700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 0x7f20e4152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:00.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20e9f49700 1 -- 172.21.15.177:0/2245533140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20e40ccd70 msgr2=0x7f20e40b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20e9f49700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20e40ccd70 0x7f20e40b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20e9f49700 1 -- 172.21.15.177:0/2245533140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009b30 con 0x7f20e4071190 2023-11-27T17:50:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20e9f49700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e4071190 0x7f20e41f7ce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f20e000e9e0 tx=0x7f20e000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:50:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20da7fc700 1 -- 172.21.15.177:0/2245533140 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0009710 con 0x7f20e4071190 2023-11-27T17:50:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20da7fc700 1 -- 172.21.15.177:0/2245533140 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000c850 con 0x7f20e4071190 2023-11-27T17:50:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e41f4350 con 0x7f20e4071190 2023-11-27T17:50:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20da7fc700 1 -- 172.21.15.177:0/2245533140 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000cbc0 con 0x7f20e4071190 2023-11-27T17:50:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.731+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e41f4910 con 0x7f20e4071190 2023-11-27T17:50:00.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.732+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e4069400 con 0x7f20e4071190 2023-11-27T17:50:00.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.732+0000 7f20da7fc700 1 -- 172.21.15.177:0/2245533140 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f20e000cd20 con 0x7f20e4071190 2023-11-27T17:50:00.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.733+0000 7f20da7fc700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f20c806b250 0x7f20c806d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:00.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.733+0000 7f20da7fc700 1 -- 172.21.15.177:0/2245533140 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20e0089b40 con 0x7f20e4071190 2023-11-27T17:50:00.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.733+0000 7f20e9748700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f20c806b250 0x7f20c806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:00.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.733+0000 7f20e9748700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f20c806b250 0x7f20c806d710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f20d40011e0 tx=0x7f20d40079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:50:00.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:00.737+0000 7f20da7fc700 1 -- 172.21.15.177:0/2245533140 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f20e0054870 con 0x7f20e4071190 2023-11-27T17:50:01.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.012+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f20e41f4b30 con 0x7f20e4071190 2023-11-27T17:50:01.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.013+0000 7f20da7fc700 1 -- 172.21.15.177:0/2245533140 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1289 (secure 0 0 0) 0x7f20e0021090 con 0x7f20e4071190 2023-11-27T17:50:01.015 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:50:01.016 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":1,"fsid":"9352b089-d7fa-4b22-a837-e414c87a0ebc","modified":"2023-11-27T17:47:19.541473Z","created":"2023-11-27T17:47:19.541473Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-27T17:50:01.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f20c806b250 msgr2=0x7f20c806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f20c806b250 0x7f20c806d710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f20d40011e0 tx=0x7f20d40079b0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e4071190 msgr2=0x7f20e41f7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e4071190 0x7f20e41f7ce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f20e000e9e0 tx=0x7f20e000eda0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 shutdown_connections 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f20c806b250 0x7f20c806d710 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20e40ccd70 0x7f20e40b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20e4071190 0x7f20e41f7ce0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 --2- 172.21.15.177:0/2245533140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20e40ae9b0 0x7f20e4152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 >> 172.21.15.177:0/2245533140 conn(0x7f20e40b15d0 msgr2=0x7f20e40aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:50:01.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 shutdown_connections 2023-11-27T17:50:01.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.015+0000 7f20ec1ad700 1 -- 172.21.15.177:0/2245533140 wait complete. 2023-11-27T17:50:01.019 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 1 2023-11-27T17:50:01.030 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-11-27T17:50:01.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.170+0000 7f7fef6d0700 1 Processor -- start 2023-11-27T17:50:01.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.170+0000 7f7fef6d0700 1 -- start start 2023-11-27T17:50:01.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fef6d0700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7fe815def0 0x7f7fe80d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:01.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fef6d0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7fe81627f0 0x7f7fe8161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:01.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fef6d0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe815e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:01.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fef6d0700 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe8071c50 con 0x7f7fe815def0 2023-11-27T17:50:01.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fef6d0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe81625a0 con 0x7f7fe81627f0 2023-11-27T17:50:01.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fef6d0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8070fd0 con 0x7f7fe8162150 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fed46c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7fe815def0 0x7f7fe80d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fed46c700 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7fe815def0 0x7f7fe80d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53590/0 (socket says 172.21.15.177:53590) 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fed46c700 1 -- 172.21.15.177:0/249049876 learned_addr learned my addr 172.21.15.177:0/249049876 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fecc6b700 1 --2- 172.21.15.177:0/249049876 >> v2:172.21.15.178:3300/0 conn(0x7f7fe81627f0 0x7f7fe8161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fedc6d700 1 --2- 172.21.15.177:0/249049876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe815e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fed46c700 1 -- 172.21.15.177:0/249049876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 msgr2=0x7f7fe815e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fed46c700 1 --2- 172.21.15.177:0/249049876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe815e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fed46c700 1 -- 172.21.15.177:0/249049876 >> v2:172.21.15.178:3300/0 conn(0x7f7fe81627f0 msgr2=0x7f7fe8161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.171+0000 7f7fed46c700 1 --2- 172.21.15.177:0/249049876 >> v2:172.21.15.178:3300/0 conn(0x7f7fe81627f0 0x7f7fe8161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.172+0000 7f7fed46c700 1 -- 172.21.15.177:0/249049876 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80712b0 con 0x7f7fe815def0 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.172+0000 7f7fed46c700 1 --2- 172.21.15.177:0/249049876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe80d04f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80b4660 tx=0x7f7fe4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea30b3e69e4fbe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:50:01.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.172+0000 7f7fdffff700 1 -- 172.21.15.177:0/249049876 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400b870 con 0x7f7fe815def0 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.172+0000 7f7fdffff700 1 -- 172.21.15.177:0/249049876 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400b9d0 con 0x7f7fe815def0 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.172+0000 7f7fdffff700 1 -- 172.21.15.177:0/249049876 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400bd60 con 0x7f7fe815def0 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.172+0000 7f7fef6d0700 1 -- 172.21.15.177:0/249049876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 msgr2=0x7f7fe80d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.172+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/249049876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe80d04f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80b4660 tx=0x7f7fe4009bd0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.173+0000 7f7fef6d0700 1 -- 172.21.15.177:0/249049876 shutdown_connections 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.173+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/249049876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe815e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.173+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/249049876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe80d04f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.173+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/249049876 >> v2:172.21.15.178:3300/0 conn(0x7f7fe81627f0 0x7f7fe8161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.173+0000 7f7fef6d0700 1 -- 172.21.15.177:0/249049876 >> 172.21.15.177:0/249049876 conn(0x7f7fe8072720 msgr2=0x7f7fe8072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.173+0000 7f7fef6d0700 1 -- 172.21.15.177:0/249049876 shutdown_connections 2023-11-27T17:50:01.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.173+0000 7f7fef6d0700 1 -- 172.21.15.177:0/249049876 wait complete. 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.174+0000 7f7fef6d0700 1 Processor -- start 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.174+0000 7f7fef6d0700 1 -- start start 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fef6d0700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe8155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fef6d0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe806f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fef6d0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe81627f0 0x7f7fe8143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fef6d0700 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe806df60 con 0x7f7fe815def0 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fef6d0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe806e240 con 0x7f7fe81627f0 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fef6d0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe806e520 con 0x7f7fe8162150 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fed46c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe8155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fed46c700 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe8155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53596/0 (socket says 172.21.15.177:53596) 2023-11-27T17:50:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fed46c700 1 -- 172.21.15.177:0/518745835 learned_addr learned my addr 172.21.15.177:0/518745835 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fedc6d700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe81627f0 0x7f7fe8143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.175+0000 7f7fecc6b700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fed46c700 1 -- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 msgr2=0x7f7fe806f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fed46c700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe806f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fed46c700 1 -- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe81627f0 msgr2=0x7f7fe8143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fed46c700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe81627f0 0x7f7fe8143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fed46c700 1 -- 172.21.15.177:0/518745835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009550 con 0x7f7fe815def0 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fecc6b700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fed46c700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe8155540 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4000c00 tx=0x7f7fe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:50:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fddffb700 1 -- 172.21.15.177:0/518745835 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4004540 con 0x7f7fe815def0 2023-11-27T17:50:01.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fddffb700 1 -- 172.21.15.177:0/518745835 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe40036a0 con 0x7f7fe815def0 2023-11-27T17:50:01.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe806e800 con 0x7f7fe815def0 2023-11-27T17:50:01.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fddffb700 1 -- 172.21.15.177:0/518745835 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4003a50 con 0x7f7fe815def0 2023-11-27T17:50:01.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.176+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe8155a80 con 0x7f7fe815def0 2023-11-27T17:50:01.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.177+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe8073aa0 con 0x7f7fe815def0 2023-11-27T17:50:01.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.178+0000 7f7fddffb700 1 -- 172.21.15.177:0/518745835 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7fe4021070 con 0x7f7fe815def0 2023-11-27T17:50:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.178+0000 7f7fddffb700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fcc06b250 0x7f7fcc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:50:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.178+0000 7f7fddffb700 1 -- 172.21.15.177:0/518745835 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fe408b040 con 0x7f7fe815def0 2023-11-27T17:50:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.178+0000 7f7fecc6b700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fcc06b250 0x7f7fcc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:50:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.178+0000 7f7fecc6b700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fcc06b250 0x7f7fcc06d710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80b7850 tx=0x7f7fd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:50:01.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.182+0000 7f7fddffb700 1 -- 172.21.15.177:0/518745835 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7fe4055d80 con 0x7f7fe815def0 2023-11-27T17:50:01.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.459+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f7fe806ee50 con 0x7f7fe815def0 2023-11-27T17:50:01.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.459+0000 7f7fddffb700 1 -- 172.21.15.177:0/518745835 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f7fe40593a0 con 0x7f7fe815def0 2023-11-27T17:50:01.462 INFO:teuthology.orchestra.run.smithi177.stdout:[client.admin] 2023-11-27T17:50:01.462 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fcc06b250 msgr2=0x7f7fcc06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fcc06b250 0x7f7fcc06d710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80b7850 tx=0x7f7fd8008040 comp rx=0 tx=0).stop 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 msgr2=0x7f7fe8155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe8155540 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4000c00 tx=0x7f7fe4004750 comp rx=0 tx=0).stop 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 shutdown_connections 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:6832/2467053977,v1:172.21.15.177:6833/2467053977] conn(0x7f7fcc06b250 0x7f7fcc06d710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe81627f0 0x7f7fe8143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fe815def0 0x7f7fe8155540 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 --2- 172.21.15.177:0/518745835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe8162150 0x7f7fe806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:50:01.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 >> 172.21.15.177:0/518745835 conn(0x7f7fe8072720 msgr2=0x7f7fe80704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:50:01.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 shutdown_connections 2023-11-27T17:50:01.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-11-27T17:50:01.461+0000 7f7fef6d0700 1 -- 172.21.15.177:0/518745835 wait complete. 2023-11-27T17:50:01.476 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:50:01.476 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/tmp/tmp.nfQXm1uy9xxfstests-dev/local.config 2023-11-27T17:50:01.514 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.177:6789:/test export TEST_DIR=/tmp/tmp.ANA1mbzVgttest export SCRATCH_DEV=172.21.15.177:6789:/scratch export SCRATCH_MNT=/tmp/tmp.NJ4jZWycDSscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg==" 2023-11-27T17:50:01.514 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-11-27T17:50:01.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/tmp/tmp.nfQXm1uy9xxfstests-dev/ceph.exclude 2023-11-27T17:50:01.580 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo make) 2023-11-27T17:50:01.666 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize -cfi 2023-11-27T17:50:02.002 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-27T17:50:02.002 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './config.guess' 2023-11-27T17:50:02.005 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './config.sub' 2023-11-27T17:50:02.009 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './install-sh' 2023-11-27T17:50:02.012 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './ltmain.sh' 2023-11-27T17:50:02.040 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-27T17:50:02.040 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-27T17:50:02.044 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-27T17:50:02.048 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-27T17:50:02.053 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-27T17:50:02.057 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-27T17:50:02.062 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-27T17:50:02.064 INFO:teuthology.orchestra.run.smithi177.stdout:cp include/install-sh . 2023-11-27T17:50:02.075 INFO:teuthology.orchestra.run.smithi177.stdout:aclocal -I m4 2023-11-27T17:50:03.343 INFO:teuthology.orchestra.run.smithi177.stdout:autoheader 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi177.stdout:autoconf 2023-11-27T17:50:05.621 INFO:teuthology.orchestra.run.smithi177.stdout:./configure \ 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout: --libexecdir=/usr/lib \ 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout: --exec_prefix=/var/lib 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to print strings... printf 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc... gcc 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the C compiler works... yes 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking for C compiler default output file name... a.out 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking for suffix of executables... 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether we are cross compiling... no 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking for suffix of object files... o 2023-11-27T17:50:05.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether we are using the GNU C compiler... yes 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc accepts -g... yes 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to accept ISO C89... none needed 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking for a sed that does not truncate output... /bin/sed 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking for egrep... /bin/grep -E 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking for fgrep... /bin/grep -F 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ld used by gcc... /bin/ld 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether ln -s works... yes 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking the maximum length of command line arguments... 1572864 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-27T17:50:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for /bin/ld option to reload object files... -r 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for objdump... objdump 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to recognize dependent libraries... pass_all 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dlltool... no 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ar... ar 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for archiver @FILE support... @ 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for strip... strip 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ranlib... ranlib 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gawk... gawk 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sysroot... no 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking for a working dd... /bin/dd 2023-11-27T17:50:05.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for mt... no 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking if : is a manifest tool... no 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to run the C preprocessor... gcc -E 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ANSI C header files... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/types.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/stat.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for stdlib.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for string.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for memory.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for strings.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for inttypes.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for stdint.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for unistd.h... yes 2023-11-27T17:50:05.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dlfcn.h... yes 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking for objdir... .libs 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc static flag -static works... no 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -c -o file.o... yes 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether -lc should be explicitly linked in... no 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to hardcode library paths into programs... immediate 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether stripping libraries is possible... yes 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking if libtool supports shared libraries... yes 2023-11-27T17:50:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether to build shared libraries... yes 2023-11-27T17:50:05.627 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether to build static libraries... yes 2023-11-27T17:50:05.627 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc... (cached) gcc 2023-11-27T17:50:05.627 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-11-27T17:50:05.627 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-27T17:50:05.627 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-11-27T17:50:05.627 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gmake... /usr/bin/gmake 2023-11-27T17:50:05.627 INFO:teuthology.orchestra.run.smithi177.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking for tar... /bin/tar 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gzip... /bin/gzip 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc -MM is supported... yes 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sort... /bin/sort 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether ln -s works... yes 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking for rpm... /bin/rpm 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking for rpmbuild... no 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking assert.h usability... yes 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking assert.h presence... yes 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking for assert.h... yes 2023-11-27T17:50:05.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking bstring.h usability... no 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking bstring.h presence... no 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking for bstring.h... no 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking libgen.h usability... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking libgen.h presence... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking for libgen.h... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking dirent.h usability... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking dirent.h presence... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dirent.h... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking errno.h usability... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking errno.h presence... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking for errno.h... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking malloc.h usability... yes 2023-11-27T17:50:05.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking malloc.h presence... yes 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking for malloc.h... yes 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking uuid.h usability... no 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking uuid.h presence... no 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid.h... no 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking uuid/uuid.h usability... yes 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking uuid/uuid.h presence... yes 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid/uuid.h... yes 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/uuid.h usability... no 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/uuid.h presence... no 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/uuid.h... no 2023-11-27T17:50:05.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/file.h usability... yes 2023-11-27T17:50:05.637 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/file.h presence... yes 2023-11-27T17:50:05.637 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/file.h... yes 2023-11-27T17:50:05.664 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/fcntl.h usability... yes 2023-11-27T17:50:05.672 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/fcntl.h presence... yes 2023-11-27T17:50:05.672 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/fcntl.h... yes 2023-11-27T17:50:05.697 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/syssgi.h usability... no 2023-11-27T17:50:05.706 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/syssgi.h presence... no 2023-11-27T17:50:05.707 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/syssgi.h... no 2023-11-27T17:50:05.744 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/param.h usability... yes 2023-11-27T17:50:05.754 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/param.h presence... yes 2023-11-27T17:50:05.754 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/param.h... yes 2023-11-27T17:50:05.759 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/stat.h... (cached) yes 2023-11-27T17:50:05.787 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/statvfs.h usability... yes 2023-11-27T17:50:05.794 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/statvfs.h presence... yes 2023-11-27T17:50:05.794 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/statvfs.h... yes 2023-11-27T17:50:05.820 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/time.h usability... yes 2023-11-27T17:50:05.828 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/time.h presence... yes 2023-11-27T17:50:05.828 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/time.h... yes 2023-11-27T17:50:05.885 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/ioctl.h usability... yes 2023-11-27T17:50:05.892 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/ioctl.h presence... yes 2023-11-27T17:50:05.893 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/ioctl.h... yes 2023-11-27T17:50:05.920 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/wait.h usability... yes 2023-11-27T17:50:05.929 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/wait.h presence... yes 2023-11-27T17:50:05.929 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/wait.h... yes 2023-11-27T17:50:05.934 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/types.h... (cached) yes 2023-11-27T17:50:05.938 INFO:teuthology.orchestra.run.smithi177.stdout:checking for strings.h... (cached) yes 2023-11-27T17:50:05.972 INFO:teuthology.orchestra.run.smithi177.stdout:checking err.h usability... yes 2023-11-27T17:50:05.978 INFO:teuthology.orchestra.run.smithi177.stdout:checking err.h presence... yes 2023-11-27T17:50:05.979 INFO:teuthology.orchestra.run.smithi177.stdout:checking for err.h... yes 2023-11-27T17:50:06.005 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/falloc.h usability... yes 2023-11-27T17:50:06.011 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/falloc.h presence... yes 2023-11-27T17:50:06.011 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/falloc.h... yes 2023-11-27T17:50:06.036 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-11-27T17:50:06.045 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-11-27T17:50:06.045 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-27T17:50:06.068 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/fs/xfs_itable.h usability... no 2023-11-27T17:50:06.077 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/fs/xfs_itable.h presence... no 2023-11-27T17:50:06.077 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-27T17:50:06.100 INFO:teuthology.orchestra.run.smithi177.stdout:checking xfs/platform_defs.h usability... no 2023-11-27T17:50:06.109 INFO:teuthology.orchestra.run.smithi177.stdout:checking xfs/platform_defs.h presence... no 2023-11-27T17:50:06.109 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/platform_defs.h... no 2023-11-27T17:50:06.132 INFO:teuthology.orchestra.run.smithi177.stdout:checking btrfs/ioctl.h usability... no 2023-11-27T17:50:06.141 INFO:teuthology.orchestra.run.smithi177.stdout:checking btrfs/ioctl.h presence... no 2023-11-27T17:50:06.141 INFO:teuthology.orchestra.run.smithi177.stdout:checking for btrfs/ioctl.h... no 2023-11-27T17:50:06.163 INFO:teuthology.orchestra.run.smithi177.stdout:checking cifs/ioctl.h usability... no 2023-11-27T17:50:06.173 INFO:teuthology.orchestra.run.smithi177.stdout:checking cifs/ioctl.h presence... no 2023-11-27T17:50:06.173 INFO:teuthology.orchestra.run.smithi177.stdout:checking for cifs/ioctl.h... no 2023-11-27T17:50:06.197 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/mman.h usability... yes 2023-11-27T17:50:06.204 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/mman.h presence... yes 2023-11-27T17:50:06.204 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/mman.h... yes 2023-11-27T17:50:06.219 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/xfs_log_format.h... no 2023-11-27T17:50:06.253 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid_compare... no 2023-11-27T17:50:06.282 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid_compare in -luuid... yes 2023-11-27T17:50:06.331 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/xfs.h... yes 2023-11-27T17:50:06.344 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/libxfs.h... no 2023-11-27T17:50:06.359 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-27T17:50:06.387 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/xqm.h... yes 2023-11-27T17:50:06.430 INFO:teuthology.orchestra.run.smithi177.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-27T17:50:06.452 INFO:teuthology.orchestra.run.smithi177.stdout:checking xfs/handle.h usability... yes 2023-11-27T17:50:06.459 INFO:teuthology.orchestra.run.smithi177.stdout:checking xfs/handle.h presence... yes 2023-11-27T17:50:06.459 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/handle.h... yes 2023-11-27T17:50:06.497 INFO:teuthology.orchestra.run.smithi177.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-27T17:50:06.526 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/acl.h usability... yes 2023-11-27T17:50:06.533 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/acl.h presence... yes 2023-11-27T17:50:06.534 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/acl.h... yes 2023-11-27T17:50:06.563 INFO:teuthology.orchestra.run.smithi177.stdout:checking acl/libacl.h usability... yes 2023-11-27T17:50:06.572 INFO:teuthology.orchestra.run.smithi177.stdout:checking acl/libacl.h presence... yes 2023-11-27T17:50:06.572 INFO:teuthology.orchestra.run.smithi177.stdout:checking for acl/libacl.h... yes 2023-11-27T17:50:06.602 INFO:teuthology.orchestra.run.smithi177.stdout:checking for acl_init in -lacl... yes 2023-11-27T17:50:06.624 INFO:teuthology.orchestra.run.smithi177.stdout:checking gdbm-ndbm.h usability... no 2023-11-27T17:50:06.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking gdbm-ndbm.h presence... no 2023-11-27T17:50:06.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gdbm-ndbm.h... no 2023-11-27T17:50:06.655 INFO:teuthology.orchestra.run.smithi177.stdout:checking gdbm/ndbm.h usability... yes 2023-11-27T17:50:06.663 INFO:teuthology.orchestra.run.smithi177.stdout:checking gdbm/ndbm.h presence... yes 2023-11-27T17:50:06.664 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gdbm/ndbm.h... yes 2023-11-27T17:50:06.697 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dbm_open in -lgdbm... no 2023-11-27T17:50:06.731 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dbm_fetch in -lgdbm... no 2023-11-27T17:50:06.764 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dbm_store in -lgdbm... no 2023-11-27T17:50:06.798 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dbm_close in -lgdbm... no 2023-11-27T17:50:06.839 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-11-27T17:50:06.869 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-11-27T17:50:06.899 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-11-27T17:50:06.931 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-11-27T17:50:06.955 INFO:teuthology.orchestra.run.smithi177.stdout:checking libaio.h usability... yes 2023-11-27T17:50:06.965 INFO:teuthology.orchestra.run.smithi177.stdout:checking libaio.h presence... yes 2023-11-27T17:50:06.965 INFO:teuthology.orchestra.run.smithi177.stdout:checking for libaio.h... yes 2023-11-27T17:50:06.986 INFO:teuthology.orchestra.run.smithi177.stdout:checking liburing.h usability... no 2023-11-27T17:50:06.996 INFO:teuthology.orchestra.run.smithi177.stdout:checking liburing.h presence... no 2023-11-27T17:50:06.996 INFO:teuthology.orchestra.run.smithi177.stdout:checking for liburing.h... no 2023-11-27T17:50:07.026 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/capability.h usability... yes 2023-11-27T17:50:07.035 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/capability.h presence... yes 2023-11-27T17:50:07.035 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/capability.h... yes 2023-11-27T17:50:07.058 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/fiemap.h usability... yes 2023-11-27T17:50:07.065 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/fiemap.h presence... yes 2023-11-27T17:50:07.065 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/fiemap.h... yes 2023-11-27T17:50:07.097 INFO:teuthology.orchestra.run.smithi177.stdout:checking for fallocate... yes 2023-11-27T17:50:07.129 INFO:teuthology.orchestra.run.smithi177.stdout:checking for open_by_handle_at... yes 2023-11-27T17:50:07.152 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/prctl.h usability... yes 2023-11-27T17:50:07.160 INFO:teuthology.orchestra.run.smithi177.stdout:checking sys/prctl.h presence... yes 2023-11-27T17:50:07.160 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/prctl.h... yes 2023-11-27T17:50:07.182 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/fs.h usability... yes 2023-11-27T17:50:07.189 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/fs.h presence... yes 2023-11-27T17:50:07.189 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/fs.h... yes 2023-11-27T17:50:07.210 INFO:teuthology.orchestra.run.smithi177.stdout:checking btrfsutil.h usability... no 2023-11-27T17:50:07.219 INFO:teuthology.orchestra.run.smithi177.stdout:checking btrfsutil.h presence... no 2023-11-27T17:50:07.219 INFO:teuthology.orchestra.run.smithi177.stdout:checking for btrfsutil.h... no 2023-11-27T17:50:07.254 INFO:teuthology.orchestra.run.smithi177.stdout:checking for copy_file_range... yes 2023-11-27T17:50:07.288 INFO:teuthology.orchestra.run.smithi177.stdout:checking for SEEK_DATA... yes 2023-11-27T17:50:07.332 INFO:teuthology.orchestra.run.smithi177.stdout:checking for BMV_OF_SHARED... yes 2023-11-27T17:50:07.375 INFO:teuthology.orchestra.run.smithi177.stdout:checking for nftw... yes 2023-11-27T17:50:07.409 INFO:teuthology.orchestra.run.smithi177.stdout:checking for RLIMIT_NOFILE... yes 2023-11-27T17:50:07.425 INFO:teuthology.orchestra.run.smithi177.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-27T17:50:07.457 INFO:teuthology.orchestra.run.smithi177.stdout:checking for renameat2... yes 2023-11-27T17:50:07.489 INFO:teuthology.orchestra.run.smithi177.stdout:checking for reallocarray... yes 2023-11-27T17:50:07.502 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct mount_attr... no 2023-11-27T17:50:07.535 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-27T17:50:07.573 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-27T17:50:07.633 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-27T17:50:07.683 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-27T17:50:07.716 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-27T17:50:07.749 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-27T17:50:07.782 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-27T17:50:07.809 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/btrfs.h usability... yes 2023-11-27T17:50:07.816 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/btrfs.h presence... yes 2023-11-27T17:50:07.816 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/btrfs.h... yes 2023-11-27T17:50:07.845 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/btrfs_tree.h usability... yes 2023-11-27T17:50:07.852 INFO:teuthology.orchestra.run.smithi177.stdout:checking linux/btrfs_tree.h presence... yes 2023-11-27T17:50:07.852 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/btrfs_tree.h... yes 2023-11-27T17:50:07.882 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-11-27T17:50:07.898 INFO:teuthology.orchestra.run.smithi177.stdout:configure: creating ./config.status 2023-11-27T17:50:08.183 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: creating include/builddefs 2023-11-27T17:50:08.193 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: creating include/config.h 2023-11-27T17:50:08.201 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: executing libtool commands 2023-11-27T17:50:08.237 INFO:teuthology.orchestra.run.smithi177.stdout:Building include 2023-11-27T17:50:08.240 INFO:teuthology.orchestra.run.smithi177.stdout:Building lib 2023-11-27T17:50:08.243 INFO:teuthology.orchestra.run.smithi177.stdout: [LTDEP] 2023-11-27T17:50:08.342 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dataascii.lo 2023-11-27T17:50:08.453 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] databin.lo 2023-11-27T17:50:08.588 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] datapid.lo 2023-11-27T17:50:08.683 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] file_lock.lo 2023-11-27T17:50:08.819 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] forker.lo 2023-11-27T17:50:08.943 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] pattern.lo 2023-11-27T17:50:09.056 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] open_flags.lo 2023-11-27T17:50:09.186 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] random_range.lo 2023-11-27T17:50:09.392 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] string_to_tokens.lo 2023-11-27T17:50:09.489 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] str_to_bytes.lo 2023-11-27T17:50:09.610 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] tlibio.lo 2023-11-27T17:50:09.822 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] write_log.lo 2023-11-27T17:50:10.043 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] random.lo 2023-11-27T17:50:10.156 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] 2023-11-27T17:50:10.225 INFO:teuthology.orchestra.run.smithi177.stdout:Building ltp 2023-11-27T17:50:10.228 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2023-11-27T17:50:10.354 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] doio 2023-11-27T17:50:10.938 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsstress 2023-11-27T17:50:12.121 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsx 2023-11-27T17:50:12.903 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] growfiles 2023-11-27T17:50:13.357 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] iogen 2023-11-27T17:50:13.676 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-stress 2023-11-27T17:50:14.052 INFO:teuthology.orchestra.run.smithi177.stdout:Building src 2023-11-27T17:50:14.058 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2023-11-27T17:50:15.465 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2023-11-27T17:50:15.490 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2023-11-27T17:50:15.497 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2023-11-27T17:50:15.674 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2023-11-27T17:50:15.695 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dirstress 2023-11-27T17:50:15.913 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fill 2023-11-27T17:50:16.058 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fill2 2023-11-27T17:50:16.265 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] getpagesize 2023-11-27T17:50:16.398 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] holes 2023-11-27T17:50:16.576 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] lstat64 2023-11-27T17:50:16.746 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] nametest 2023-11-27T17:50:16.964 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] permname 2023-11-27T17:50:17.148 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] randholes 2023-11-27T17:50:17.372 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] runas 2023-11-27T17:50:17.537 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] truncfile 2023-11-27T17:50:17.703 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] usemem 2023-11-27T17:50:17.844 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mmapcat 2023-11-27T17:50:17.984 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] append_reader 2023-11-27T17:50:18.127 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] append_writer 2023-11-27T17:50:18.269 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dirperf 2023-11-27T17:50:18.471 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] metaperf 2023-11-27T17:50:18.702 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] devzero 2023-11-27T17:50:18.863 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] feature 2023-11-27T17:50:19.060 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] alloc 2023-11-27T17:50:19.252 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fault 2023-11-27T17:50:19.404 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fstest 2023-11-27T17:50:19.619 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_access_root 2023-11-27T17:50:19.763 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] godown 2023-11-27T17:50:19.921 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] resvtest 2023-11-27T17:50:20.092 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] writemod 2023-11-27T17:50:20.228 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] writev_on_pagefault 2023-11-27T17:50:20.327 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:50:20.330 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:50:20.382 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] makeextents 2023-11-27T17:50:20.548 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] itrash 2023-11-27T17:50:20.694 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] rename 2023-11-27T17:50:20.826 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] multi_open_unlink 2023-11-27T17:50:20.980 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] unwritten_sync 2023-11-27T17:50:21.146 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] genhashnames 2023-11-27T17:50:21.319 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_holes 2023-11-27T17:50:21.458 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_writev 2023-11-27T17:50:21.598 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_truncate_cmtime 2023-11-27T17:50:21.747 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dirhash_collide 2023-11-27T17:50:21.915 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_rename_overwrite 2023-11-27T17:50:22.048 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] holetest 2023-11-27T17:50:22.247 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_truncate_self 2023-11-27T17:50:22.381 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] af_unix 2023-11-27T17:50:22.523 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_stale_pmd 2023-11-27T17:50:22.665 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_cow_race 2023-11-27T17:50:22.820 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_fallocate 2023-11-27T17:50:22.963 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsync-err 2023-11-27T17:50:23.134 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_write_ro 2023-11-27T17:50:23.275 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-27T17:50:23.424 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-27T17:50:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_ofd_locks 2023-11-27T17:50:23.750 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_collision 2023-11-27T17:50:23.935 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mmap-write-concurrent 2023-11-27T17:50:24.095 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_get_file_time 2023-11-27T17:50:24.233 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_create_short_dirs 2023-11-27T17:50:24.388 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_create_long_dirs 2023-11-27T17:50:24.540 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_enospc 2023-11-27T17:50:24.712 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_writev_overlap 2023-11-27T17:50:24.871 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] checkpoint_journal 2023-11-27T17:50:25.016 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mmap-rw-fault 2023-11-27T17:50:25.188 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] allocstale 2023-11-27T17:50:25.345 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_cow_memory_failure 2023-11-27T17:50:25.503 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fake-dump-rootino 2023-11-27T17:50:25.645 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dio-buf-fault 2023-11-27T17:50:25.791 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] rewinddir-test 2023-11-27T17:50:25.950 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfsctl 2023-11-27T17:50:26.122 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bstat 2023-11-27T17:50:26.309 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mtab 2023-11-27T17:50:26.479 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] getdevicesize 2023-11-27T17:50:26.614 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] preallo_rw_pattern_reader 2023-11-27T17:50:26.762 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] preallo_rw_pattern_writer 2023-11-27T17:50:26.910 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] ftrunc 2023-11-27T17:50:27.050 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] trunc 2023-11-27T17:50:27.201 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fs_perms 2023-11-27T17:50:27.353 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] testx 2023-11-27T17:50:27.480 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] looptest 2023-11-27T17:50:27.661 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] locktest 2023-11-27T17:50:27.939 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] unwritten_mmap 2023-11-27T17:50:28.090 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkstat_unlink_test 2023-11-27T17:50:28.275 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] deduperace 2023-11-27T17:50:28.455 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkstat_unlink_test_modified 2023-11-27T17:50:28.636 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_dir_offset 2023-11-27T17:50:28.776 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_futimens 2023-11-27T17:50:28.909 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_immutable 2023-11-27T17:50:29.453 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] stale_handle 2023-11-27T17:50:29.610 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] pwrite_mmap_blocked 2023-11-27T17:50:29.753 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_dir_offset2 2023-11-27T17:50:29.933 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] seek_sanity_test 2023-11-27T17:50:30.309 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] seek_copy_test 2023-11-27T17:50:30.475 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_readdir_1 2023-11-27T17:50:30.614 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_readdir_2 2023-11-27T17:50:30.757 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsync-tester 2023-11-27T17:50:30.986 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] nsexec 2023-11-27T17:50:31.150 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] cloner 2023-11-27T17:50:31.316 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] renameat2 2023-11-27T17:50:31.469 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_getcwd 2023-11-27T17:50:31.618 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] e4compact 2023-11-27T17:50:31.805 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] test-nextquota 2023-11-27T17:50:31.964 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] punch-alternating 2023-11-27T17:50:32.123 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-27T17:50:32.278 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] listxattr 2023-11-27T17:50:32.416 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dio-interleaved 2023-11-27T17:50:32.567 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_dir_type 2023-11-27T17:50:32.714 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dio-invalidate-cache 2023-11-27T17:50:32.901 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] stat_test 2023-11-27T17:50:33.172 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_encrypted_d_revalidate 2023-11-27T17:50:33.327 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attr_replace_test 2023-11-27T17:50:33.479 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] swapon 2023-11-27T17:50:33.633 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mkswap 2023-11-27T17:50:33.855 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_attr_corruption 2023-11-27T17:50:34.054 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_open_tmpfiles 2023-11-27T17:50:34.219 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fscrypt-crypt-util 2023-11-27T17:50:34.793 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkstat_null_ocount 2023-11-27T17:50:34.940 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] splice-test 2023-11-27T17:50:35.108 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] chprojid_fail 2023-11-27T17:50:35.258 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] detached_mounts_propagation 2023-11-27T17:50:35.429 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] ext4_resize 2023-11-27T17:50:35.570 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_readdir_3 2023-11-27T17:50:35.750 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] splice2pipe 2023-11-27T17:50:35.904 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] uuid_ioctl 2023-11-27T17:50:36.049 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fiemap-tester 2023-11-27T17:50:36.294 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_stripealign 2023-11-27T17:50:36.438 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] open_by_handle 2023-11-27T17:50:36.672 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dbtest 2023-11-27T17:50:36.896 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_dio 2023-11-27T17:50:37.048 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfsfind 2023-11-27T17:50:37.227 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fssum 2023-11-27T17:50:37.620 INFO:teuthology.orchestra.run.smithi177.stdout:Building log-writes 2023-11-27T17:50:37.625 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] replay-log 2023-11-27T17:50:37.903 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2023-11-27T17:50:37.907 INFO:teuthology.orchestra.run.smithi177.stdout:Building aio-dio-regress 2023-11-27T17:50:37.913 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-27T17:50:38.071 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-fcntl-race 2023-11-27T17:50:38.221 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-subblock-eof-read 2023-11-27T17:50:38.356 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-append-write-read-race 2023-11-27T17:50:38.519 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-invalidate-readahead 2023-11-27T17:50:38.671 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-write-verify 2023-11-27T17:50:38.854 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-27T17:50:38.982 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-last-ref-held-by-io 2023-11-27T17:50:39.142 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-cycle-write 2023-11-27T17:50:39.313 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-extend-stat 2023-11-27T17:50:39.465 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-27T17:50:39.591 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-hole-filling-race 2023-11-27T17:50:39.731 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-invalidate-failure 2023-11-27T17:50:39.882 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aiodio_sparse2 2023-11-27T17:50:40.079 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aiocp 2023-11-27T17:50:40.283 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-cow-race 2023-11-27T17:50:40.425 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-eof-race 2023-11-27T17:50:40.594 INFO:teuthology.orchestra.run.smithi177.stdout:Building vfs 2023-11-27T17:50:40.599 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] vfstest 2023-11-27T17:50:43.672 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mount-idmapped 2023-11-27T17:50:44.015 INFO:teuthology.orchestra.run.smithi177.stdout:Building m4 2023-11-27T17:50:44.018 INFO:teuthology.orchestra.run.smithi177.stdout:Building common 2023-11-27T17:50:44.022 INFO:teuthology.orchestra.run.smithi177.stdout:Building tests 2023-11-27T17:50:44.027 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2023-11-27T17:50:44.031 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/perf/group.list 2023-11-27T17:50:44.041 INFO:teuthology.orchestra.run.smithi177.stdout:Building ext4 2023-11-27T17:50:44.047 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ext4/group.list 2023-11-27T17:50:44.080 INFO:teuthology.orchestra.run.smithi177.stdout:Building ocfs2 2023-11-27T17:50:44.085 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ocfs2/group.list 2023-11-27T17:50:44.096 INFO:teuthology.orchestra.run.smithi177.stdout:Building overlay 2023-11-27T17:50:44.101 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/overlay/group.list 2023-11-27T17:50:44.137 INFO:teuthology.orchestra.run.smithi177.stdout:Building cifs 2023-11-27T17:50:44.141 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/cifs/group.list 2023-11-27T17:50:44.153 INFO:teuthology.orchestra.run.smithi177.stdout:Building generic 2023-11-27T17:50:44.161 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/generic/group.list 2023-11-27T17:50:44.246 INFO:teuthology.orchestra.run.smithi177.stdout:Building shared 2023-11-27T17:50:44.251 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/shared/group.list 2023-11-27T17:50:44.266 INFO:teuthology.orchestra.run.smithi177.stdout:Building nfs 2023-11-27T17:50:44.271 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/nfs/group.list 2023-11-27T17:50:44.283 INFO:teuthology.orchestra.run.smithi177.stdout:Building f2fs 2023-11-27T17:50:44.288 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/f2fs/group.list 2023-11-27T17:50:44.303 INFO:teuthology.orchestra.run.smithi177.stdout:Building udf 2023-11-27T17:50:44.308 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/udf/group.list 2023-11-27T17:50:44.318 INFO:teuthology.orchestra.run.smithi177.stdout:Building ceph 2023-11-27T17:50:44.323 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ceph/group.list 2023-11-27T17:50:44.336 INFO:teuthology.orchestra.run.smithi177.stdout:Building xfs 2023-11-27T17:50:44.342 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/xfs/group.list 2023-11-27T17:50:44.430 INFO:teuthology.orchestra.run.smithi177.stdout:Building btrfs 2023-11-27T17:50:44.435 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/btrfs/group.list 2023-11-27T17:50:44.488 INFO:teuthology.orchestra.run.smithi177.stdout:Building tmpfs 2023-11-27T17:50:44.493 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/tmpfs/group.list 2023-11-27T17:50:44.505 INFO:teuthology.orchestra.run.smithi177.stdout:Building selftest 2023-11-27T17:50:44.510 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/selftest/group.list 2023-11-27T17:50:44.522 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo make install) 2023-11-27T17:50:44.558 INFO:teuthology.orchestra.run.smithi177.stdout:Building include 2023-11-27T17:50:44.561 INFO:teuthology.orchestra.run.smithi177.stdout:Building lib 2023-11-27T17:50:44.565 INFO:teuthology.orchestra.run.smithi177.stdout:Building ltp 2023-11-27T17:50:44.569 INFO:teuthology.orchestra.run.smithi177.stdout:Building src 2023-11-27T17:50:44.601 INFO:teuthology.orchestra.run.smithi177.stdout:Building log-writes 2023-11-27T17:50:44.604 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2023-11-27T17:50:44.608 INFO:teuthology.orchestra.run.smithi177.stdout:Building aio-dio-regress 2023-11-27T17:50:44.611 INFO:teuthology.orchestra.run.smithi177.stdout:Building vfs 2023-11-27T17:50:44.615 INFO:teuthology.orchestra.run.smithi177.stdout:Building m4 2023-11-27T17:50:44.618 INFO:teuthology.orchestra.run.smithi177.stdout:Building common 2023-11-27T17:50:44.622 INFO:teuthology.orchestra.run.smithi177.stdout:Building tests 2023-11-27T17:50:44.627 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2023-11-27T17:50:44.631 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/perf/group.list 2023-11-27T17:50:44.642 INFO:teuthology.orchestra.run.smithi177.stdout:Building ext4 2023-11-27T17:50:44.647 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ext4/group.list 2023-11-27T17:50:44.680 INFO:teuthology.orchestra.run.smithi177.stdout:Building ocfs2 2023-11-27T17:50:44.684 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ocfs2/group.list 2023-11-27T17:50:44.696 INFO:teuthology.orchestra.run.smithi177.stdout:Building overlay 2023-11-27T17:50:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/overlay/group.list 2023-11-27T17:50:44.737 INFO:teuthology.orchestra.run.smithi177.stdout:Building cifs 2023-11-27T17:50:44.741 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/cifs/group.list 2023-11-27T17:50:44.752 INFO:teuthology.orchestra.run.smithi177.stdout:Building generic 2023-11-27T17:50:44.759 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/generic/group.list 2023-11-27T17:50:44.846 INFO:teuthology.orchestra.run.smithi177.stdout:Building shared 2023-11-27T17:50:44.850 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/shared/group.list 2023-11-27T17:50:44.866 INFO:teuthology.orchestra.run.smithi177.stdout:Building nfs 2023-11-27T17:50:44.870 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/nfs/group.list 2023-11-27T17:50:44.883 INFO:teuthology.orchestra.run.smithi177.stdout:Building f2fs 2023-11-27T17:50:44.888 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/f2fs/group.list 2023-11-27T17:50:44.903 INFO:teuthology.orchestra.run.smithi177.stdout:Building udf 2023-11-27T17:50:44.907 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/udf/group.list 2023-11-27T17:50:44.918 INFO:teuthology.orchestra.run.smithi177.stdout:Building ceph 2023-11-27T17:50:44.923 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ceph/group.list 2023-11-27T17:50:44.937 INFO:teuthology.orchestra.run.smithi177.stdout:Building xfs 2023-11-27T17:50:44.941 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/xfs/group.list 2023-11-27T17:50:45.029 INFO:teuthology.orchestra.run.smithi177.stdout:Building btrfs 2023-11-27T17:50:45.034 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/btrfs/group.list 2023-11-27T17:50:45.087 INFO:teuthology.orchestra.run.smithi177.stdout:Building tmpfs 2023-11-27T17:50:45.092 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/tmpfs/group.list 2023-11-27T17:50:45.103 INFO:teuthology.orchestra.run.smithi177.stdout:Building selftest 2023-11-27T17:50:45.108 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/selftest/group.list 2023-11-27T17:50:45.119 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-27T17:50:45.121 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T17:50:45.121 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-27T17:50:45.123 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T17:50:45.123 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-27T17:50:45.125 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-27T17:50:45.133 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-27T17:50:45.209 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-27T17:50:45.218 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-27T17:50:45.234 INFO:teuthology.orchestra.run.smithi177.stdout:Building log-writes 2023-11-27T17:50:45.237 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2023-11-27T17:50:45.242 INFO:teuthology.orchestra.run.smithi177.stdout:Building aio-dio-regress 2023-11-27T17:50:45.244 INFO:teuthology.orchestra.run.smithi177.stdout:Building vfs 2023-11-27T17:50:45.247 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake -C log-writes install 2023-11-27T17:50:45.249 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-27T17:50:45.257 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-27T17:50:45.266 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake -C perf install 2023-11-27T17:50:45.268 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-27T17:50:45.276 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-27T17:50:45.299 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-27T17:50:45.300 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-27T17:50:45.309 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-11-27T17:50:45.360 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake -C vfs install 2023-11-27T17:50:45.362 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-27T17:50:45.370 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-27T17:50:45.382 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-27T17:50:45.390 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-11-27T17:50:46.593 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-27T17:50:46.694 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-27T17:50:46.725 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-27T17:50:46.726 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T17:50:46.727 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-27T17:50:46.728 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-27T17:50:46.736 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-27T17:50:46.868 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-27T17:50:46.869 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/btrfs/ install 2023-11-27T17:50:46.872 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-27T17:50:46.881 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-11-27T17:50:47.688 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-27T17:50:47.697 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 240.out 092.out 077.out 280.out 140.out 265.out 108.out 121.out 204.out 233.out 194.out 055.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 102.out 034.out 125.out 165.out 181.out 152.out 103.out 024.out 243.out 192.out 148.out 282.out 267.out 178.out 052.out 256.out 228.out 183.out 273.out 251.out 043.out 069.out 027.out 087.out 151.out 206.out 195.out 274.out 215.out 115.out 275.out 250.out 191.out 281.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 232.out 302.out 020.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 111.out 011.out 234.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 056.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 276.out 114.out 138.out 095.out 297.out 160.out 091.out 081.out 071.out 061.out 037.out 300.out 200.out 100.out 025.out 258.out 185.out 269.out 208.out 039.out 046.out 173.out 222.out 035.out 298.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 236.out 211.out 158.out 182.out 146.out 188.out 293.out 104.out 089.out 086.out 254.out 177.out 225.out 174.out 268.out 135.out 124.out 172.out 063.out 058.out 113.out 262.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 015.out 007.out 209.out 053.out 279.out 164.out 154.out 239.out 241.out 002.out 190.out 214.out 074.out 036.out 041.out 057.out 175.out 186.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 050.out 105.out 257.out 291.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 142.out 013.out 031.out 272.out 078.out 184.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 003.out 245.out 014.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 156.out 110.out 149.out 064.out 264.out 218.out 018.out 168.out 021.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 026.out 180.out 253.out 255.out 139.out 090.out 221.out 085.out 294.out 212.out 112.out 094.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out 196.out 242.out 004.out 189.out 220.out 301.out 120.out /var/lib/xfstests/tests/btrfs 2023-11-27T17:50:48.507 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ceph/ install 2023-11-27T17:50:48.508 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-27T17:50:48.517 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-27T17:50:48.536 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-27T17:50:48.544 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-11-27T17:50:48.564 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/cifs/ install 2023-11-27T17:50:48.566 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-27T17:50:48.574 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-27T17:50:48.583 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-27T17:50:48.591 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-27T17:50:48.600 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ext4/ install 2023-11-27T17:50:48.602 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-27T17:50:48.610 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-27T17:50:48.798 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-27T17:50:48.807 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-11-27T17:50:49.003 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/f2fs/ install 2023-11-27T17:50:49.005 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-27T17:50:49.013 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-27T17:50:49.024 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-27T17:50:49.033 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-27T17:50:49.044 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/generic/ install 2023-11-27T17:50:49.049 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-27T17:50:49.057 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-27T17:50:50.399 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:50:50.401 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:50:51.025 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-27T17:50:51.034 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 220.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 732.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 155.out 118.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 426.out 290.out 573.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 485.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 641.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 612.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 016.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 208.out 433.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 053.out 279.out 276.out 711.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 193.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 089.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 551.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 057.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 158.out 237.out 151.out 227.out 163.out 332.out 661.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 448.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 547.out 150.out 326.out 082.out 480.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 145.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 686.out 312.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 731.out 374.out 631.out 256.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 730.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 184.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 667.out 512.out 494.out 221.out 212.out 112.out 342.out 012.out 029.out 195.out 554.out 397.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 491.out 081.out 148.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 075.out 582.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 425.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out 476.out /var/lib/xfstests/tests/generic 2023-11-27T17:50:53.026 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/nfs/ install 2023-11-27T17:50:53.028 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-27T17:50:53.036 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-27T17:50:53.044 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-27T17:50:53.091 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-27T17:50:53.091 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/ocfs2/ install 2023-11-27T17:50:53.091 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-27T17:50:53.092 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-27T17:50:53.092 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-27T17:50:53.092 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-27T17:50:53.097 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/overlay/ install 2023-11-27T17:50:53.099 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-27T17:50:53.108 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-27T17:50:53.385 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-27T17:50:53.393 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 018.out 024.out 077.out 069.out 020.out 102.out 014.out 023.out 013.out 031.out 015.out 117.out 082.out 072.out 068.out 063.out 048.out 062.out 038.out 052.out 042.out 075.out 110.out 067.out 029.out 111.out 055.out 112.out 066.out 073.out 078.out 030.out 058.out 104.out 017.out 002.out 043.out 053.out 079.out 036.out 116.out 016.out 101.out 010.out 001.out 022.out 074.out 004.out 103.out 115.out 057.out 113.out 114.out 081.out 026.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 007.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 046.out 021.out 105.out 005.out 107.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 106.out 009.out 006.out 037.out 044.out 012.out 109.out 033.out 083.out 045.out 040.out 056.out 035.out 019.out 034.out 003.out /var/lib/xfstests/tests/overlay 2023-11-27T17:50:53.669 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/perf/ install 2023-11-27T17:50:53.670 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-27T17:50:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-27T17:50:53.687 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-27T17:50:53.696 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-27T17:50:53.705 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/selftest/ install 2023-11-27T17:50:53.706 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-27T17:50:53.715 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-27T17:50:53.736 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-27T17:50:53.745 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-11-27T17:50:53.767 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/shared/ install 2023-11-27T17:50:53.768 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-27T17:50:53.777 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-27T17:50:53.791 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-27T17:50:53.799 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-11-27T17:50:53.814 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/tmpfs/ install 2023-11-27T17:50:53.815 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-27T17:50:53.824 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-27T17:50:53.832 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-27T17:50:53.841 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-27T17:50:53.850 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/udf/ install 2023-11-27T17:50:53.851 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-27T17:50:53.859 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-27T17:50:53.869 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-27T17:50:53.877 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-27T17:50:53.885 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.nfQXm1uy9xxfstests-dev/tests/xfs/ install 2023-11-27T17:50:53.890 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-27T17:50:53.898 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-27T17:50:55.769 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-27T17:50:55.778 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 600.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 537.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 329.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 601.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out 544.out /var/lib/xfstests/tests/xfs 2023-11-27T17:50:57.665 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-27T17:50:57.673 INFO:teuthology.orchestra.run.smithi177.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-27T17:50:57.681 INFO:teuthology.orchestra.run.smithi177.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-27T17:50:57.690 INFO:teuthology.orchestra.run.smithi177.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-27T17:50:57.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:50:57.701 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec ls tests/generic) 2023-11-27T17:50:57.722 INFO:teuthology.orchestra.run.smithi177.stdout:001 2023-11-27T17:50:57.722 INFO:teuthology.orchestra.run.smithi177.stdout:001.out 2023-11-27T17:50:57.722 INFO:teuthology.orchestra.run.smithi177.stdout:002 2023-11-27T17:50:57.722 INFO:teuthology.orchestra.run.smithi177.stdout:002.out 2023-11-27T17:50:57.723 INFO:teuthology.orchestra.run.smithi177.stdout:003 2023-11-27T17:50:57.723 INFO:teuthology.orchestra.run.smithi177.stdout:003.out 2023-11-27T17:50:57.723 INFO:teuthology.orchestra.run.smithi177.stdout:004 2023-11-27T17:50:57.723 INFO:teuthology.orchestra.run.smithi177.stdout:004.out 2023-11-27T17:50:57.723 INFO:teuthology.orchestra.run.smithi177.stdout:005 2023-11-27T17:50:57.723 INFO:teuthology.orchestra.run.smithi177.stdout:005.out 2023-11-27T17:50:57.723 INFO:teuthology.orchestra.run.smithi177.stdout:006 2023-11-27T17:50:57.724 INFO:teuthology.orchestra.run.smithi177.stdout:006.out 2023-11-27T17:50:57.724 INFO:teuthology.orchestra.run.smithi177.stdout:007 2023-11-27T17:50:57.724 INFO:teuthology.orchestra.run.smithi177.stdout:007.out 2023-11-27T17:50:57.724 INFO:teuthology.orchestra.run.smithi177.stdout:008 2023-11-27T17:50:57.724 INFO:teuthology.orchestra.run.smithi177.stdout:008.out 2023-11-27T17:50:57.724 INFO:teuthology.orchestra.run.smithi177.stdout:009 2023-11-27T17:50:57.724 INFO:teuthology.orchestra.run.smithi177.stdout:009.out 2023-11-27T17:50:57.725 INFO:teuthology.orchestra.run.smithi177.stdout:010 2023-11-27T17:50:57.725 INFO:teuthology.orchestra.run.smithi177.stdout:010.out 2023-11-27T17:50:57.725 INFO:teuthology.orchestra.run.smithi177.stdout:011 2023-11-27T17:50:57.725 INFO:teuthology.orchestra.run.smithi177.stdout:011.out 2023-11-27T17:50:57.726 INFO:teuthology.orchestra.run.smithi177.stdout:012 2023-11-27T17:50:57.726 INFO:teuthology.orchestra.run.smithi177.stdout:012.out 2023-11-27T17:50:57.726 INFO:teuthology.orchestra.run.smithi177.stdout:013 2023-11-27T17:50:57.726 INFO:teuthology.orchestra.run.smithi177.stdout:013.out 2023-11-27T17:50:57.726 INFO:teuthology.orchestra.run.smithi177.stdout:014 2023-11-27T17:50:57.726 INFO:teuthology.orchestra.run.smithi177.stdout:014.out 2023-11-27T17:50:57.726 INFO:teuthology.orchestra.run.smithi177.stdout:015 2023-11-27T17:50:57.727 INFO:teuthology.orchestra.run.smithi177.stdout:015.out 2023-11-27T17:50:57.727 INFO:teuthology.orchestra.run.smithi177.stdout:016 2023-11-27T17:50:57.727 INFO:teuthology.orchestra.run.smithi177.stdout:016.out 2023-11-27T17:50:57.727 INFO:teuthology.orchestra.run.smithi177.stdout:017 2023-11-27T17:50:57.727 INFO:teuthology.orchestra.run.smithi177.stdout:017.out 2023-11-27T17:50:57.727 INFO:teuthology.orchestra.run.smithi177.stdout:018 2023-11-27T17:50:57.727 INFO:teuthology.orchestra.run.smithi177.stdout:018.out 2023-11-27T17:50:57.728 INFO:teuthology.orchestra.run.smithi177.stdout:019 2023-11-27T17:50:57.728 INFO:teuthology.orchestra.run.smithi177.stdout:019.out 2023-11-27T17:50:57.728 INFO:teuthology.orchestra.run.smithi177.stdout:020 2023-11-27T17:50:57.728 INFO:teuthology.orchestra.run.smithi177.stdout:020.out 2023-11-27T17:50:57.728 INFO:teuthology.orchestra.run.smithi177.stdout:021 2023-11-27T17:50:57.728 INFO:teuthology.orchestra.run.smithi177.stdout:021.out 2023-11-27T17:50:57.728 INFO:teuthology.orchestra.run.smithi177.stdout:022 2023-11-27T17:50:57.728 INFO:teuthology.orchestra.run.smithi177.stdout:022.out 2023-11-27T17:50:57.729 INFO:teuthology.orchestra.run.smithi177.stdout:023 2023-11-27T17:50:57.729 INFO:teuthology.orchestra.run.smithi177.stdout:023.out 2023-11-27T17:50:57.729 INFO:teuthology.orchestra.run.smithi177.stdout:024 2023-11-27T17:50:57.729 INFO:teuthology.orchestra.run.smithi177.stdout:024.out 2023-11-27T17:50:57.729 INFO:teuthology.orchestra.run.smithi177.stdout:025 2023-11-27T17:50:57.729 INFO:teuthology.orchestra.run.smithi177.stdout:025.out 2023-11-27T17:50:57.729 INFO:teuthology.orchestra.run.smithi177.stdout:026 2023-11-27T17:50:57.729 INFO:teuthology.orchestra.run.smithi177.stdout:026.out 2023-11-27T17:50:57.730 INFO:teuthology.orchestra.run.smithi177.stdout:027 2023-11-27T17:50:57.730 INFO:teuthology.orchestra.run.smithi177.stdout:027.out 2023-11-27T17:50:57.730 INFO:teuthology.orchestra.run.smithi177.stdout:028 2023-11-27T17:50:57.730 INFO:teuthology.orchestra.run.smithi177.stdout:028.out 2023-11-27T17:50:57.730 INFO:teuthology.orchestra.run.smithi177.stdout:029 2023-11-27T17:50:57.730 INFO:teuthology.orchestra.run.smithi177.stdout:029.out 2023-11-27T17:50:57.730 INFO:teuthology.orchestra.run.smithi177.stdout:030 2023-11-27T17:50:57.731 INFO:teuthology.orchestra.run.smithi177.stdout:030.out 2023-11-27T17:50:57.731 INFO:teuthology.orchestra.run.smithi177.stdout:031 2023-11-27T17:50:57.731 INFO:teuthology.orchestra.run.smithi177.stdout:031.out 2023-11-27T17:50:57.731 INFO:teuthology.orchestra.run.smithi177.stdout:032 2023-11-27T17:50:57.731 INFO:teuthology.orchestra.run.smithi177.stdout:032.out 2023-11-27T17:50:57.731 INFO:teuthology.orchestra.run.smithi177.stdout:033 2023-11-27T17:50:57.731 INFO:teuthology.orchestra.run.smithi177.stdout:033.out 2023-11-27T17:50:57.732 INFO:teuthology.orchestra.run.smithi177.stdout:034 2023-11-27T17:50:57.732 INFO:teuthology.orchestra.run.smithi177.stdout:034.out 2023-11-27T17:50:57.732 INFO:teuthology.orchestra.run.smithi177.stdout:035 2023-11-27T17:50:57.732 INFO:teuthology.orchestra.run.smithi177.stdout:035.cfg 2023-11-27T17:50:57.732 INFO:teuthology.orchestra.run.smithi177.stdout:035.out.default 2023-11-27T17:50:57.732 INFO:teuthology.orchestra.run.smithi177.stdout:035.out.nfs 2023-11-27T17:50:57.732 INFO:teuthology.orchestra.run.smithi177.stdout:036 2023-11-27T17:50:57.732 INFO:teuthology.orchestra.run.smithi177.stdout:036.out 2023-11-27T17:50:57.733 INFO:teuthology.orchestra.run.smithi177.stdout:037 2023-11-27T17:50:57.733 INFO:teuthology.orchestra.run.smithi177.stdout:037.out 2023-11-27T17:50:57.733 INFO:teuthology.orchestra.run.smithi177.stdout:038 2023-11-27T17:50:57.733 INFO:teuthology.orchestra.run.smithi177.stdout:038.out 2023-11-27T17:50:57.734 INFO:teuthology.orchestra.run.smithi177.stdout:039 2023-11-27T17:50:57.734 INFO:teuthology.orchestra.run.smithi177.stdout:039.out 2023-11-27T17:50:57.734 INFO:teuthology.orchestra.run.smithi177.stdout:040 2023-11-27T17:50:57.734 INFO:teuthology.orchestra.run.smithi177.stdout:040.out 2023-11-27T17:50:57.734 INFO:teuthology.orchestra.run.smithi177.stdout:041 2023-11-27T17:50:57.734 INFO:teuthology.orchestra.run.smithi177.stdout:041.out 2023-11-27T17:50:57.734 INFO:teuthology.orchestra.run.smithi177.stdout:042 2023-11-27T17:50:57.735 INFO:teuthology.orchestra.run.smithi177.stdout:042.out 2023-11-27T17:50:57.735 INFO:teuthology.orchestra.run.smithi177.stdout:043 2023-11-27T17:50:57.735 INFO:teuthology.orchestra.run.smithi177.stdout:043.out 2023-11-27T17:50:57.735 INFO:teuthology.orchestra.run.smithi177.stdout:044 2023-11-27T17:50:57.735 INFO:teuthology.orchestra.run.smithi177.stdout:044.out 2023-11-27T17:50:57.736 INFO:teuthology.orchestra.run.smithi177.stdout:045 2023-11-27T17:50:57.736 INFO:teuthology.orchestra.run.smithi177.stdout:045.out 2023-11-27T17:50:57.736 INFO:teuthology.orchestra.run.smithi177.stdout:046 2023-11-27T17:50:57.736 INFO:teuthology.orchestra.run.smithi177.stdout:046.out 2023-11-27T17:50:57.736 INFO:teuthology.orchestra.run.smithi177.stdout:047 2023-11-27T17:50:57.736 INFO:teuthology.orchestra.run.smithi177.stdout:047.out 2023-11-27T17:50:57.736 INFO:teuthology.orchestra.run.smithi177.stdout:048 2023-11-27T17:50:57.737 INFO:teuthology.orchestra.run.smithi177.stdout:048.out 2023-11-27T17:50:57.737 INFO:teuthology.orchestra.run.smithi177.stdout:049 2023-11-27T17:50:57.737 INFO:teuthology.orchestra.run.smithi177.stdout:049.out 2023-11-27T17:50:57.737 INFO:teuthology.orchestra.run.smithi177.stdout:050 2023-11-27T17:50:57.737 INFO:teuthology.orchestra.run.smithi177.stdout:050.cfg 2023-11-27T17:50:57.737 INFO:teuthology.orchestra.run.smithi177.stdout:050.out.default 2023-11-27T17:50:57.737 INFO:teuthology.orchestra.run.smithi177.stdout:050.out.nojournal 2023-11-27T17:50:57.738 INFO:teuthology.orchestra.run.smithi177.stdout:050.out.xfsquota 2023-11-27T17:50:57.738 INFO:teuthology.orchestra.run.smithi177.stdout:051 2023-11-27T17:50:57.738 INFO:teuthology.orchestra.run.smithi177.stdout:051.out 2023-11-27T17:50:57.738 INFO:teuthology.orchestra.run.smithi177.stdout:052 2023-11-27T17:50:57.738 INFO:teuthology.orchestra.run.smithi177.stdout:052.out 2023-11-27T17:50:57.738 INFO:teuthology.orchestra.run.smithi177.stdout:053 2023-11-27T17:50:57.738 INFO:teuthology.orchestra.run.smithi177.stdout:053.out 2023-11-27T17:50:57.739 INFO:teuthology.orchestra.run.smithi177.stdout:054 2023-11-27T17:50:57.739 INFO:teuthology.orchestra.run.smithi177.stdout:054.out 2023-11-27T17:50:57.739 INFO:teuthology.orchestra.run.smithi177.stdout:055 2023-11-27T17:50:57.739 INFO:teuthology.orchestra.run.smithi177.stdout:055.out 2023-11-27T17:50:57.739 INFO:teuthology.orchestra.run.smithi177.stdout:056 2023-11-27T17:50:57.739 INFO:teuthology.orchestra.run.smithi177.stdout:056.out 2023-11-27T17:50:57.739 INFO:teuthology.orchestra.run.smithi177.stdout:057 2023-11-27T17:50:57.740 INFO:teuthology.orchestra.run.smithi177.stdout:057.out 2023-11-27T17:50:57.740 INFO:teuthology.orchestra.run.smithi177.stdout:058 2023-11-27T17:50:57.740 INFO:teuthology.orchestra.run.smithi177.stdout:058.out 2023-11-27T17:50:57.740 INFO:teuthology.orchestra.run.smithi177.stdout:059 2023-11-27T17:50:57.740 INFO:teuthology.orchestra.run.smithi177.stdout:059.out 2023-11-27T17:50:57.740 INFO:teuthology.orchestra.run.smithi177.stdout:060 2023-11-27T17:50:57.740 INFO:teuthology.orchestra.run.smithi177.stdout:060.out 2023-11-27T17:50:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:061 2023-11-27T17:50:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:061.out 2023-11-27T17:50:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:062 2023-11-27T17:50:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:062.out 2023-11-27T17:50:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:063 2023-11-27T17:50:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:063.out 2023-11-27T17:50:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:064 2023-11-27T17:50:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:064.out 2023-11-27T17:50:57.742 INFO:teuthology.orchestra.run.smithi177.stdout:065 2023-11-27T17:50:57.742 INFO:teuthology.orchestra.run.smithi177.stdout:065.out 2023-11-27T17:50:57.742 INFO:teuthology.orchestra.run.smithi177.stdout:066 2023-11-27T17:50:57.742 INFO:teuthology.orchestra.run.smithi177.stdout:066.out 2023-11-27T17:50:57.742 INFO:teuthology.orchestra.run.smithi177.stdout:067 2023-11-27T17:50:57.743 INFO:teuthology.orchestra.run.smithi177.stdout:067.out 2023-11-27T17:50:57.743 INFO:teuthology.orchestra.run.smithi177.stdout:068 2023-11-27T17:50:57.743 INFO:teuthology.orchestra.run.smithi177.stdout:068.out 2023-11-27T17:50:57.743 INFO:teuthology.orchestra.run.smithi177.stdout:069 2023-11-27T17:50:57.743 INFO:teuthology.orchestra.run.smithi177.stdout:069.out 2023-11-27T17:50:57.743 INFO:teuthology.orchestra.run.smithi177.stdout:070 2023-11-27T17:50:57.743 INFO:teuthology.orchestra.run.smithi177.stdout:070.out 2023-11-27T17:50:57.743 INFO:teuthology.orchestra.run.smithi177.stdout:071 2023-11-27T17:50:57.744 INFO:teuthology.orchestra.run.smithi177.stdout:071.out 2023-11-27T17:50:57.744 INFO:teuthology.orchestra.run.smithi177.stdout:072 2023-11-27T17:50:57.744 INFO:teuthology.orchestra.run.smithi177.stdout:072.out 2023-11-27T17:50:57.744 INFO:teuthology.orchestra.run.smithi177.stdout:073 2023-11-27T17:50:57.744 INFO:teuthology.orchestra.run.smithi177.stdout:073.out 2023-11-27T17:50:57.744 INFO:teuthology.orchestra.run.smithi177.stdout:074 2023-11-27T17:50:57.744 INFO:teuthology.orchestra.run.smithi177.stdout:074.out 2023-11-27T17:50:57.744 INFO:teuthology.orchestra.run.smithi177.stdout:075 2023-11-27T17:50:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:075.out 2023-11-27T17:50:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:076 2023-11-27T17:50:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:076.out 2023-11-27T17:50:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:077 2023-11-27T17:50:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:077.out 2023-11-27T17:50:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:078 2023-11-27T17:50:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:078.out 2023-11-27T17:50:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:079 2023-11-27T17:50:57.746 INFO:teuthology.orchestra.run.smithi177.stdout:079.out 2023-11-27T17:50:57.746 INFO:teuthology.orchestra.run.smithi177.stdout:080 2023-11-27T17:50:57.746 INFO:teuthology.orchestra.run.smithi177.stdout:080.out 2023-11-27T17:50:57.746 INFO:teuthology.orchestra.run.smithi177.stdout:081 2023-11-27T17:50:57.746 INFO:teuthology.orchestra.run.smithi177.stdout:081.out 2023-11-27T17:50:57.746 INFO:teuthology.orchestra.run.smithi177.stdout:082 2023-11-27T17:50:57.746 INFO:teuthology.orchestra.run.smithi177.stdout:082.out 2023-11-27T17:50:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:083 2023-11-27T17:50:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:083.out 2023-11-27T17:50:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:084 2023-11-27T17:50:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:084.out 2023-11-27T17:50:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:085 2023-11-27T17:50:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:085.out 2023-11-27T17:50:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:086 2023-11-27T17:50:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:086.out 2023-11-27T17:50:57.748 INFO:teuthology.orchestra.run.smithi177.stdout:087 2023-11-27T17:50:57.748 INFO:teuthology.orchestra.run.smithi177.stdout:087.out 2023-11-27T17:50:57.748 INFO:teuthology.orchestra.run.smithi177.stdout:088 2023-11-27T17:50:57.748 INFO:teuthology.orchestra.run.smithi177.stdout:088.out 2023-11-27T17:50:57.748 INFO:teuthology.orchestra.run.smithi177.stdout:089 2023-11-27T17:50:57.748 INFO:teuthology.orchestra.run.smithi177.stdout:089.out 2023-11-27T17:50:57.748 INFO:teuthology.orchestra.run.smithi177.stdout:090 2023-11-27T17:50:57.748 INFO:teuthology.orchestra.run.smithi177.stdout:090.out 2023-11-27T17:50:57.749 INFO:teuthology.orchestra.run.smithi177.stdout:091 2023-11-27T17:50:57.749 INFO:teuthology.orchestra.run.smithi177.stdout:091.out 2023-11-27T17:50:57.749 INFO:teuthology.orchestra.run.smithi177.stdout:092 2023-11-27T17:50:57.749 INFO:teuthology.orchestra.run.smithi177.stdout:092.out 2023-11-27T17:50:57.749 INFO:teuthology.orchestra.run.smithi177.stdout:093 2023-11-27T17:50:57.749 INFO:teuthology.orchestra.run.smithi177.stdout:093.out 2023-11-27T17:50:57.749 INFO:teuthology.orchestra.run.smithi177.stdout:094 2023-11-27T17:50:57.749 INFO:teuthology.orchestra.run.smithi177.stdout:094.out 2023-11-27T17:50:57.750 INFO:teuthology.orchestra.run.smithi177.stdout:095 2023-11-27T17:50:57.750 INFO:teuthology.orchestra.run.smithi177.stdout:095.out 2023-11-27T17:50:57.750 INFO:teuthology.orchestra.run.smithi177.stdout:096 2023-11-27T17:50:57.750 INFO:teuthology.orchestra.run.smithi177.stdout:096.out 2023-11-27T17:50:57.750 INFO:teuthology.orchestra.run.smithi177.stdout:097 2023-11-27T17:50:57.750 INFO:teuthology.orchestra.run.smithi177.stdout:097.out 2023-11-27T17:50:57.750 INFO:teuthology.orchestra.run.smithi177.stdout:098 2023-11-27T17:50:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:098.out 2023-11-27T17:50:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:099 2023-11-27T17:50:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:099.out 2023-11-27T17:50:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:100 2023-11-27T17:50:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:100.out 2023-11-27T17:50:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:101 2023-11-27T17:50:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:101.out 2023-11-27T17:50:57.752 INFO:teuthology.orchestra.run.smithi177.stdout:102 2023-11-27T17:50:57.752 INFO:teuthology.orchestra.run.smithi177.stdout:102.out 2023-11-27T17:50:57.752 INFO:teuthology.orchestra.run.smithi177.stdout:103 2023-11-27T17:50:57.752 INFO:teuthology.orchestra.run.smithi177.stdout:103.out 2023-11-27T17:50:57.752 INFO:teuthology.orchestra.run.smithi177.stdout:104 2023-11-27T17:50:57.752 INFO:teuthology.orchestra.run.smithi177.stdout:104.out 2023-11-27T17:50:57.752 INFO:teuthology.orchestra.run.smithi177.stdout:105 2023-11-27T17:50:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:105.out 2023-11-27T17:50:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:106 2023-11-27T17:50:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:106.out 2023-11-27T17:50:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:107 2023-11-27T17:50:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:107.out 2023-11-27T17:50:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:108 2023-11-27T17:50:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:108.out 2023-11-27T17:50:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:109 2023-11-27T17:50:57.754 INFO:teuthology.orchestra.run.smithi177.stdout:109.out 2023-11-27T17:50:57.754 INFO:teuthology.orchestra.run.smithi177.stdout:110 2023-11-27T17:50:57.754 INFO:teuthology.orchestra.run.smithi177.stdout:110.out 2023-11-27T17:50:57.754 INFO:teuthology.orchestra.run.smithi177.stdout:111 2023-11-27T17:50:57.754 INFO:teuthology.orchestra.run.smithi177.stdout:111.out 2023-11-27T17:50:57.754 INFO:teuthology.orchestra.run.smithi177.stdout:112 2023-11-27T17:50:57.754 INFO:teuthology.orchestra.run.smithi177.stdout:112.out 2023-11-27T17:50:57.755 INFO:teuthology.orchestra.run.smithi177.stdout:113 2023-11-27T17:50:57.755 INFO:teuthology.orchestra.run.smithi177.stdout:113.out 2023-11-27T17:50:57.755 INFO:teuthology.orchestra.run.smithi177.stdout:114 2023-11-27T17:50:57.755 INFO:teuthology.orchestra.run.smithi177.stdout:114.out 2023-11-27T17:50:57.755 INFO:teuthology.orchestra.run.smithi177.stdout:115 2023-11-27T17:50:57.756 INFO:teuthology.orchestra.run.smithi177.stdout:115.out 2023-11-27T17:50:57.756 INFO:teuthology.orchestra.run.smithi177.stdout:116 2023-11-27T17:50:57.756 INFO:teuthology.orchestra.run.smithi177.stdout:116.out 2023-11-27T17:50:57.756 INFO:teuthology.orchestra.run.smithi177.stdout:117 2023-11-27T17:50:57.756 INFO:teuthology.orchestra.run.smithi177.stdout:117.out 2023-11-27T17:50:57.756 INFO:teuthology.orchestra.run.smithi177.stdout:118 2023-11-27T17:50:57.756 INFO:teuthology.orchestra.run.smithi177.stdout:118.out 2023-11-27T17:50:57.757 INFO:teuthology.orchestra.run.smithi177.stdout:119 2023-11-27T17:50:57.757 INFO:teuthology.orchestra.run.smithi177.stdout:119.out 2023-11-27T17:50:57.757 INFO:teuthology.orchestra.run.smithi177.stdout:120 2023-11-27T17:50:57.757 INFO:teuthology.orchestra.run.smithi177.stdout:120.out 2023-11-27T17:50:57.757 INFO:teuthology.orchestra.run.smithi177.stdout:121 2023-11-27T17:50:57.757 INFO:teuthology.orchestra.run.smithi177.stdout:121.out 2023-11-27T17:50:57.757 INFO:teuthology.orchestra.run.smithi177.stdout:122 2023-11-27T17:50:57.758 INFO:teuthology.orchestra.run.smithi177.stdout:122.out 2023-11-27T17:50:57.758 INFO:teuthology.orchestra.run.smithi177.stdout:123 2023-11-27T17:50:57.758 INFO:teuthology.orchestra.run.smithi177.stdout:123.out 2023-11-27T17:50:57.758 INFO:teuthology.orchestra.run.smithi177.stdout:124 2023-11-27T17:50:57.758 INFO:teuthology.orchestra.run.smithi177.stdout:124.out 2023-11-27T17:50:57.758 INFO:teuthology.orchestra.run.smithi177.stdout:125 2023-11-27T17:50:57.758 INFO:teuthology.orchestra.run.smithi177.stdout:125.out 2023-11-27T17:50:57.759 INFO:teuthology.orchestra.run.smithi177.stdout:126 2023-11-27T17:50:57.759 INFO:teuthology.orchestra.run.smithi177.stdout:126.out 2023-11-27T17:50:57.759 INFO:teuthology.orchestra.run.smithi177.stdout:127 2023-11-27T17:50:57.759 INFO:teuthology.orchestra.run.smithi177.stdout:127.out 2023-11-27T17:50:57.759 INFO:teuthology.orchestra.run.smithi177.stdout:128 2023-11-27T17:50:57.759 INFO:teuthology.orchestra.run.smithi177.stdout:128.out 2023-11-27T17:50:57.759 INFO:teuthology.orchestra.run.smithi177.stdout:129 2023-11-27T17:50:57.760 INFO:teuthology.orchestra.run.smithi177.stdout:129.out 2023-11-27T17:50:57.760 INFO:teuthology.orchestra.run.smithi177.stdout:130 2023-11-27T17:50:57.760 INFO:teuthology.orchestra.run.smithi177.stdout:130.out 2023-11-27T17:50:57.760 INFO:teuthology.orchestra.run.smithi177.stdout:131 2023-11-27T17:50:57.760 INFO:teuthology.orchestra.run.smithi177.stdout:131.out 2023-11-27T17:50:57.760 INFO:teuthology.orchestra.run.smithi177.stdout:132 2023-11-27T17:50:57.760 INFO:teuthology.orchestra.run.smithi177.stdout:132.out 2023-11-27T17:50:57.761 INFO:teuthology.orchestra.run.smithi177.stdout:133 2023-11-27T17:50:57.761 INFO:teuthology.orchestra.run.smithi177.stdout:133.out 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:134 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:134.out 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:135 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:135.out 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:136 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:136.out 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:137 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:137.out 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:138 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:138.out 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:139 2023-11-27T17:50:57.762 INFO:teuthology.orchestra.run.smithi177.stdout:139.out 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:140 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:140.out 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:141 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:141.out 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:142 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:142.out 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:143 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:143.out 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:144 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:144.out 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:145 2023-11-27T17:50:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:145.out 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:146 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:146.out 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:147 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:147.out 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:148 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:148.out 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:149 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:149.out 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:150 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:150.out 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:151 2023-11-27T17:50:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:151.out 2023-11-27T17:50:57.765 INFO:teuthology.orchestra.run.smithi177.stdout:152 2023-11-27T17:50:57.765 INFO:teuthology.orchestra.run.smithi177.stdout:152.out 2023-11-27T17:50:57.765 INFO:teuthology.orchestra.run.smithi177.stdout:153 2023-11-27T17:50:57.765 INFO:teuthology.orchestra.run.smithi177.stdout:153.out 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:154 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:154.out 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:155 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:155.out 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:156 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:156.out 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:157 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:157.out 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:158 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:158.out 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:159 2023-11-27T17:50:57.766 INFO:teuthology.orchestra.run.smithi177.stdout:159.out 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:160 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:160.out 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:161 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:161.out 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:162 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:162.out 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:163 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:163.out 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:164 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:164.out 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:165 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:165.out 2023-11-27T17:50:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:166 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:166.out 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:167 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:167.out 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:168 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:168.out 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:169 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:169.out 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:170 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:170.out 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:171 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:171.out 2023-11-27T17:50:57.768 INFO:teuthology.orchestra.run.smithi177.stdout:172 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:172.out 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:173 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:173.out 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:174 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:174.out 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:175 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:175.out 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:176 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:176.out 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:177 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:177.out 2023-11-27T17:50:57.769 INFO:teuthology.orchestra.run.smithi177.stdout:178 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:178.out 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:179 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:179.out 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:180 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:180.out 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:181 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:181.out 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:182 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:182.out 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:183 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:183.out 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:184 2023-11-27T17:50:57.770 INFO:teuthology.orchestra.run.smithi177.stdout:184.out 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:185 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:185.out 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:186 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:186.out 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:187 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:187.out 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:188 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:188.out 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:189 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:189.out 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:190 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:190.out 2023-11-27T17:50:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:191 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:191.out 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:192 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:192.out 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:193 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:193.out 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:194 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:194.out 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:195 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:195.out 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:196 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:196.out 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:197 2023-11-27T17:50:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:197.out 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:198 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:198.out 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:199 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:199.out 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:200 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:200.out 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:201 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:201.out 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:202 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:202.out 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:203 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:203.out 2023-11-27T17:50:57.773 INFO:teuthology.orchestra.run.smithi177.stdout:204 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:204.out 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:205 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:205.out 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:206 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:206.out 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:207 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:207.out 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:208 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:208.out 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:209 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:209.out 2023-11-27T17:50:57.774 INFO:teuthology.orchestra.run.smithi177.stdout:210 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:210.out 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:211 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:211.out 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:212 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:212.out 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:213 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:213.out 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:214 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:214.out 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:215 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:215.out 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:216 2023-11-27T17:50:57.775 INFO:teuthology.orchestra.run.smithi177.stdout:216.out 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:217 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:217.out 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:218 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:218.out 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:219 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:219.out 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:220 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:220.out 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:221 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:221.out 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:222 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:222.out 2023-11-27T17:50:57.776 INFO:teuthology.orchestra.run.smithi177.stdout:223 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:223.out 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:224 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:224.out 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:225 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:225.out 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:226 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:226.out 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:227 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:227.out 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:228 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:228.out 2023-11-27T17:50:57.777 INFO:teuthology.orchestra.run.smithi177.stdout:229 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:229.out 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:230 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:230.out 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:231 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:231.out 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:232 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:232.out 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:233 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:233.out 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:234 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:234.out 2023-11-27T17:50:57.778 INFO:teuthology.orchestra.run.smithi177.stdout:235 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:235.out 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:236 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:236.out 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:237 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:237.out 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:238 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:238.out 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:239 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:239.out 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:240 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:240.out 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:241 2023-11-27T17:50:57.779 INFO:teuthology.orchestra.run.smithi177.stdout:241.out 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:242 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:242.out 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:243 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:243.out 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:244 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:244.out 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:245 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:245.out 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:246 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:246.out 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:247 2023-11-27T17:50:57.780 INFO:teuthology.orchestra.run.smithi177.stdout:247.out 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:248 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:248.out 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:249 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:249.out 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:250 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:250.out 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:251 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:251.out 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:252 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:252.out 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:253 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:253.out 2023-11-27T17:50:57.781 INFO:teuthology.orchestra.run.smithi177.stdout:254 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:254.out 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:255 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:255.out 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:256 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:256.out 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:257 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:257.out 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:258 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:258.out 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:259 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:259.out 2023-11-27T17:50:57.782 INFO:teuthology.orchestra.run.smithi177.stdout:260 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:260.out 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:261 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:261.out 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:262 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:262.out 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:263 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:263.out 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:264 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:264.out 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:265 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:265.out 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:266 2023-11-27T17:50:57.783 INFO:teuthology.orchestra.run.smithi177.stdout:266.out 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:267 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:267.out 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:268 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:268.out 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:269 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:269.out 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:270 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:270.out 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:271 2023-11-27T17:50:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:271.out 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:272 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:272.out 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:273 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:273.out 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:274 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:274.out 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:275 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:275.out 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:276 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:276.out 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:277 2023-11-27T17:50:57.785 INFO:teuthology.orchestra.run.smithi177.stdout:277.out 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:278 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:278.out 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:279 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:279.out 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:280 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:280.out 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:281 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:281.out 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:282 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:282.out 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:283 2023-11-27T17:50:57.786 INFO:teuthology.orchestra.run.smithi177.stdout:283.out 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:284 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:284.out 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:285 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:285.out 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:286 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:286.out 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:287 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:287.out 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:288 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:288.out 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:289 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:289.out 2023-11-27T17:50:57.787 INFO:teuthology.orchestra.run.smithi177.stdout:290 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:290.out 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:291 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:291.out 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:292 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:292.out 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:293 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:293.out 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:294 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:294.out 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:295 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:295.out 2023-11-27T17:50:57.788 INFO:teuthology.orchestra.run.smithi177.stdout:296 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:296.out 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:297 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:297.out 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:298 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:298.out 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:299 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:299.out 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:300 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:300.out 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:301 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:301.out 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:302 2023-11-27T17:50:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:302.out 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:303 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:303.out 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:304 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:304.out 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:305 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:305.out 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:306 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:306.out 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:307 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:307.out 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:308 2023-11-27T17:50:57.790 INFO:teuthology.orchestra.run.smithi177.stdout:308.out 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:309 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:309.out 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:310 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:310.out 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:311 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:311.out 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:312 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:312.out 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:313 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:313.out 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:314 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:314.out 2023-11-27T17:50:57.791 INFO:teuthology.orchestra.run.smithi177.stdout:315 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:315.out 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:316 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:316.out 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:317 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:317.out 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:318 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:318.out 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:319 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:319.out 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:320 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:320.out 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:321 2023-11-27T17:50:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:321.out 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:322 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:322.out 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:323 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:323.out 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:324 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:324.out 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:325 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:325.out 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:326 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:326.out 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:327 2023-11-27T17:50:57.793 INFO:teuthology.orchestra.run.smithi177.stdout:327.out 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:328 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:328.out 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:329 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:329.out 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:330 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:330.out 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:331 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:331.out 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:332 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:332.out 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:333 2023-11-27T17:50:57.794 INFO:teuthology.orchestra.run.smithi177.stdout:333.out 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:334 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:334.out 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:335 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:335.out 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:336 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:336.out 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:337 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:337.out 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:338 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:338.out 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:339 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:339.out 2023-11-27T17:50:57.795 INFO:teuthology.orchestra.run.smithi177.stdout:340 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:340.out 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:341 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:341.out 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:342 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:342.out 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:343 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:343.out 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:344 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:344.out 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:345 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:345.out 2023-11-27T17:50:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:346 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:346.out 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:347 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:347.out 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:348 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:348.out 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:349 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:349.out 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:350 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:350.out 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:351 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:351.out 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:352 2023-11-27T17:50:57.797 INFO:teuthology.orchestra.run.smithi177.stdout:352.out 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:353 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:353.out 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:354 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:354.out 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:355 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:355.out 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:356 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:356.out 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:357 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:357.out 2023-11-27T17:50:57.798 INFO:teuthology.orchestra.run.smithi177.stdout:358 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:358.out 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:359 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:359.out 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:360 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:360.out 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:361 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:361.out 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:362 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:362.out 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:363 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:363.out 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:364 2023-11-27T17:50:57.799 INFO:teuthology.orchestra.run.smithi177.stdout:364.out 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:365 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:365.out 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:366 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:366.out 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:367 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:367.out 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:368 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:368.out 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:369 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:369.out 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:370 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:370.out 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi177.stdout:371 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:371.out 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:372 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:372.out 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:373 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:373.out 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:374 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:374.out 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:375 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:375.out 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:376 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:376.out 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:377 2023-11-27T17:50:57.801 INFO:teuthology.orchestra.run.smithi177.stdout:377.out 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:378 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:378.out 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:379 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:379.out 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:380 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:380.out 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:381 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:381.out 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:382 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:382.out 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:383 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:383.out 2023-11-27T17:50:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:384 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:384.out 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:385 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:385.out 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:386 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:386.out 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:387 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:387.out 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:388 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:388.out 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:389 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:389.out 2023-11-27T17:50:57.803 INFO:teuthology.orchestra.run.smithi177.stdout:390 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:390.out 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:391 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:391.out 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:392 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:392.out 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:393 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:393.out 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:394 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:394.out 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:395 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:395.out 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:396 2023-11-27T17:50:57.804 INFO:teuthology.orchestra.run.smithi177.stdout:396.out 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:397 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:397.out 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:398 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:398.out 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:399 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:399.out 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:400 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:400.out 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:401 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:401.out 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:402 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:402.out 2023-11-27T17:50:57.805 INFO:teuthology.orchestra.run.smithi177.stdout:403 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:403.out 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:404 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:404.out 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:405 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:405.out 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:406 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:406.out 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:407 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:407.out 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:408 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:408.out 2023-11-27T17:50:57.806 INFO:teuthology.orchestra.run.smithi177.stdout:409 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:409.out 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:410 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:410.out 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:411 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:411.out 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:412 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:412.out 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:413 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:413.out 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:414 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:414.out 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:415 2023-11-27T17:50:57.807 INFO:teuthology.orchestra.run.smithi177.stdout:415.out 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:416 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:416.out 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:417 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:417.out 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:418 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:418.out 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:419 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:419.out 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:420 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:420.out 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:421 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:421.out 2023-11-27T17:50:57.808 INFO:teuthology.orchestra.run.smithi177.stdout:422 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:422.out 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:423 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:423.out 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:424 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:424.out 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:425 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:425.out 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:426 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:426.out 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:427 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:427.out 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:428 2023-11-27T17:50:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:428.out 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:429 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:429.out 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:430 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:430.out 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:431 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:431.out 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:432 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:432.out 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:433 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:433.out 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:434 2023-11-27T17:50:57.810 INFO:teuthology.orchestra.run.smithi177.stdout:434.out 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:435 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:435.out 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:436 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:436.out 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:437 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:437.out 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:438 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:438.out 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:439 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:439.out 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:440 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:440.out 2023-11-27T17:50:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:441 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:441.out 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:442 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:442.out 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:443 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:443.out 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:444 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:444.out 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:445 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:445.out 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:446 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:446.out 2023-11-27T17:50:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:447 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:447.out 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:448 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:448.out 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:449 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:449.out 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:450 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:450.out 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:451 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:451.out 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:452 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:452.out 2023-11-27T17:50:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:453 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:453.out 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:454 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:454.out 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:455 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:455.out 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:456 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:456.out 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:457 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:457.out 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:458 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:458.out 2023-11-27T17:50:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:459 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:459.out 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:460 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:460.out 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:461 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:461.out 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:462 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:462.out 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:463 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:463.out 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:464 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:464.out 2023-11-27T17:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:465 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:465.out 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:466 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:466.out 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:467 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:467.out 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:468 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:468.out 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:469 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:469.out 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:470 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:470.out 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:471 2023-11-27T17:50:57.816 INFO:teuthology.orchestra.run.smithi177.stdout:471.out 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:472 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:472.out 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:473 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:473.out 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:474 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:474.out 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:475 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:475.out 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:476 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:476.out 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:477 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:477.out 2023-11-27T17:50:57.817 INFO:teuthology.orchestra.run.smithi177.stdout:478 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:478.out 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:479 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:479.out 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:480 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:480.out 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:481 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:481.out 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:482 2023-11-27T17:50:57.818 INFO:teuthology.orchestra.run.smithi177.stdout:482.out 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:483 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:483.out 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:484 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:484.out 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:485 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:485.out 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:486 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:486.out 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:487 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:487.out 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:488 2023-11-27T17:50:57.819 INFO:teuthology.orchestra.run.smithi177.stdout:488.out 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:489 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:489.out 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:490 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:490.out 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:491 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:491.out 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:492 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:492.out 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:493 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:493.out 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:494 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:494.out 2023-11-27T17:50:57.820 INFO:teuthology.orchestra.run.smithi177.stdout:495 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:495.out 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:496 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:496.out 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:497 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:497.out 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:498 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:498.out 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:499 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:499.out 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:500 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:500.out 2023-11-27T17:50:57.821 INFO:teuthology.orchestra.run.smithi177.stdout:501 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:501.out 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:502 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:502.out 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:503 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:503.out 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:504 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:504.out 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:505 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:505.out 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:506 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:506.out 2023-11-27T17:50:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:507 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:507.out 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:508 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:508.out 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:509 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:509.out 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:510 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:510.out 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:511 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:511.out 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:512 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:512.out 2023-11-27T17:50:57.823 INFO:teuthology.orchestra.run.smithi177.stdout:513 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:513.out 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:514 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:514.out 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:515 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:515.out 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:516 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:516.out 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:517 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:517.out 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:518 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:518.out 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:519 2023-11-27T17:50:57.824 INFO:teuthology.orchestra.run.smithi177.stdout:519.out 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:520 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:520.out 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:521 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:521.out 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:522 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:522.out 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:523 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:523.out 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:524 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:524.out 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:525 2023-11-27T17:50:57.825 INFO:teuthology.orchestra.run.smithi177.stdout:525.out 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:526 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:526.out 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:527 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:527.out 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:528 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:528.out 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:529 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:529.out 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:530 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:530.out 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:531 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:531.out 2023-11-27T17:50:57.826 INFO:teuthology.orchestra.run.smithi177.stdout:532 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:532.out 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:533 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:533.out 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:534 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:534.out 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:535 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:535.out 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:536 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:536.out 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:537 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:537.out 2023-11-27T17:50:57.827 INFO:teuthology.orchestra.run.smithi177.stdout:538 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:538.out 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:539 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:539.out 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:540 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:540.out 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:541 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:541.out 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:542 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:542.out 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:543 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:543.out 2023-11-27T17:50:57.828 INFO:teuthology.orchestra.run.smithi177.stdout:544 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:544.out 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:545 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:545.out 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:546 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:546.out 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:547 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:547.out 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:548 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:548.out 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:549 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:549.out 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:550 2023-11-27T17:50:57.829 INFO:teuthology.orchestra.run.smithi177.stdout:550.out 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:551 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:551.out 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:552 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:552.out 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:553 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:553.out 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:554 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:554.out 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:555 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:555.out 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:556 2023-11-27T17:50:57.830 INFO:teuthology.orchestra.run.smithi177.stdout:556.out 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:557 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:557.out 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:558 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:558.out 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:559 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:559.out 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:560 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:560.out 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:561 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:561.out 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:562 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:562.out 2023-11-27T17:50:57.831 INFO:teuthology.orchestra.run.smithi177.stdout:563 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:563.out 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:564 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:564.out 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:565 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:565.out 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:566 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:566.out 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:567 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:567.out 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:568 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:568.out 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:569 2023-11-27T17:50:57.832 INFO:teuthology.orchestra.run.smithi177.stdout:569.out 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:570 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:570.out 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:571 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:571.out 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:572 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:572.out 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:573 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:573.out 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:574 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:574.out 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:575 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:575.out 2023-11-27T17:50:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:576 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:576.out 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:577 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:577.out 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:578 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:578.out 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:579 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:579.out 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:580 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:580.out 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:581 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:581.out 2023-11-27T17:50:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:582 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:582.out 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:583 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:583.out 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:584 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:584.out 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:585 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:585.out 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:586 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:586.out 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:587 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:587.out 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:588 2023-11-27T17:50:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:588.out 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:589 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:589.out 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:590 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:590.out 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:591 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:591.out 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:592 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:592.out 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:593 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:593.out 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:594 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:594.out 2023-11-27T17:50:57.836 INFO:teuthology.orchestra.run.smithi177.stdout:595 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:595.out 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:596 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:596.out 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:597 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:597.out 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:598 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:598.out 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:599 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:599.out 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:600 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:600.out 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:601 2023-11-27T17:50:57.837 INFO:teuthology.orchestra.run.smithi177.stdout:601.out 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:602 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:602.out 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:603 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:603.out 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:604 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:604.out 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:605 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:605.out 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:606 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:606.out 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:607 2023-11-27T17:50:57.838 INFO:teuthology.orchestra.run.smithi177.stdout:607.out 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:608 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:608.out 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:609 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:609.out 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:610 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:610.out 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:611 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:611.out 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:612 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:612.out 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:613 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:613.out 2023-11-27T17:50:57.839 INFO:teuthology.orchestra.run.smithi177.stdout:614 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:614.out 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:615 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:615.out 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:616 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:616.out 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:617 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:617.out 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:618 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:618.out 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:619 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:619.out 2023-11-27T17:50:57.840 INFO:teuthology.orchestra.run.smithi177.stdout:620 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:620.out 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:621 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:621.out 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:622 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:622.out 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:623 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:623.out 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:624 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:624.out 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:625 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:625.out 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:626 2023-11-27T17:50:57.841 INFO:teuthology.orchestra.run.smithi177.stdout:626.out 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:627 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:627.out 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:628 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:628.out 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:629 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:629.out 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:630 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:630.out 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:631 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:631.out 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:632 2023-11-27T17:50:57.842 INFO:teuthology.orchestra.run.smithi177.stdout:632.out 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:633 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:633.out 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:634 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:634.out 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:635 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:635.out 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:636 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:636.out 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:637 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:637.out 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:638 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:638.out 2023-11-27T17:50:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:639 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:639.out 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:640 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:640.out 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:641 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:641.out 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:642 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:642.out 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:643 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:643.out 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:644 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:644.out 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:645 2023-11-27T17:50:57.844 INFO:teuthology.orchestra.run.smithi177.stdout:645.out 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:646 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:646.out 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:647 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:647.out 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:648 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:648.out 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:649 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:649.out 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:650 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:650.out 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:651 2023-11-27T17:50:57.845 INFO:teuthology.orchestra.run.smithi177.stdout:651.out 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:652 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:652.out 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:653 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:653.out 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:654 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:654.out 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:655 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:655.out 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:656 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:656.out 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:657 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:657.out 2023-11-27T17:50:57.846 INFO:teuthology.orchestra.run.smithi177.stdout:658 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:658.out 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:659 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:659.out 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:660 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:660.out 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:661 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:661.out 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:662 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:662.out 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:663 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:663.out 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:664 2023-11-27T17:50:57.847 INFO:teuthology.orchestra.run.smithi177.stdout:664.out 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:665 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:665.out 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:666 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:666.out 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:667 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:667.out 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:668 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:668.out 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:669 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:669.out 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:670 2023-11-27T17:50:57.848 INFO:teuthology.orchestra.run.smithi177.stdout:670.out 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:671 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:671.out 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:672 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:672.out 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:673 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:673.out 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:674 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:674.out 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:675 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:675.out 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:676 2023-11-27T17:50:57.849 INFO:teuthology.orchestra.run.smithi177.stdout:676.out 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:677 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:677.out 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:678 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:678.out 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:679 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:679.out 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:680 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:680.out 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:681 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:681.out 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:682 2023-11-27T17:50:57.850 INFO:teuthology.orchestra.run.smithi177.stdout:682.out 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:683 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:683.out 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:684 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:684.out 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:685 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:685.out 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:686 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:686.out 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:687 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:687.out 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:688 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:688.out 2023-11-27T17:50:57.851 INFO:teuthology.orchestra.run.smithi177.stdout:689 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:689.out 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:690 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:690.out 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:691 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:691.out 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:692 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:692.out 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:693 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:693.out 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:694 2023-11-27T17:50:57.852 INFO:teuthology.orchestra.run.smithi177.stdout:694.out 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:695 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:695.out 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:696 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:696.out 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:697 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:697.out 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:698 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:698.out 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:699 2023-11-27T17:50:57.853 INFO:teuthology.orchestra.run.smithi177.stdout:699.out 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:700 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:700.out 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:701 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:701.out 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:702 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:702.out 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:703 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:703.out 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:704 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:704.out 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:705 2023-11-27T17:50:57.854 INFO:teuthology.orchestra.run.smithi177.stdout:705.out 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:706 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:706.out 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:707 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:707.out 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:708 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:708.out 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:709 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:709.out 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:710 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:710.out 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:711 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:711.out 2023-11-27T17:50:57.855 INFO:teuthology.orchestra.run.smithi177.stdout:712 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:712.out 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:713 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:713.out 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:714 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:714.out 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:715 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:715.out 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:716 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:716.out 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:717 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:717.out 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:718 2023-11-27T17:50:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:718.out 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:719 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:719.out 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:720 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:720.out 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:721 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:721.out 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:722 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:722.out 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:723 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:723.out 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:724 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:724.out 2023-11-27T17:50:57.857 INFO:teuthology.orchestra.run.smithi177.stdout:725 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:725.out 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:726 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:726.out 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:727 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:727.out 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:728 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:728.out 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:729 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:729.out 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:730 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:730.out 2023-11-27T17:50:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:731 2023-11-27T17:50:57.859 INFO:teuthology.orchestra.run.smithi177.stdout:731.out 2023-11-27T17:50:57.859 INFO:teuthology.orchestra.run.smithi177.stdout:732 2023-11-27T17:50:57.859 INFO:teuthology.orchestra.run.smithi177.stdout:732.out 2023-11-27T17:50:57.859 INFO:teuthology.orchestra.run.smithi177.stdout:group.list 2023-11-27T17:50:57.859 INFO:teuthology.orchestra.run.smithi177.stdout:Makefile 2023-11-27T17:50:57.859 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-11-27T17:50:58.065 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:50:58.069 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:50:58.069 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:50:58.070 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:50:58.070 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:02.680 INFO:teuthology.orchestra.run.smithi177.stdout:generic/001 4s 2023-11-27T17:51:02.684 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/001 2023-11-27T17:51:02.684 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:51:02.686 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:03.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:51:03.361 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-11-27T17:51:03.562 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:51:03.566 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:51:03.566 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:51:03.567 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:51:03.567 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:04.174 INFO:teuthology.orchestra.run.smithi177.stdout:generic/002 1s 2023-11-27T17:51:04.179 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/002 2023-11-27T17:51:04.179 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:51:04.181 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:04.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:51:04.284 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-11-27T17:51:04.484 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:51:04.488 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:51:04.488 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:51:04.489 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:51:04.489 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:04.787 INFO:teuthology.orchestra.run.smithi177.stdout:generic/003 [not run] atime not maintained by ceph 2023-11-27T17:51:04.790 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/003 2023-11-27T17:51:04.790 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/003 2023-11-27T17:51:04.791 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:51:04.792 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:04.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:51:04.822 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-11-27T17:51:05.025 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:51:05.029 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:51:05.030 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:51:05.031 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:51:05.031 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:05.318 INFO:teuthology.orchestra.run.smithi177.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-27T17:51:05.322 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/004 2023-11-27T17:51:05.322 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/004 2023-11-27T17:51:05.322 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:51:05.324 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:05.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:51:05.350 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-11-27T17:51:05.551 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:51:05.555 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:51:05.555 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:51:05.556 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:51:05.556 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:05.995 INFO:teuthology.orchestra.run.smithi177.stdout:generic/005 0s 2023-11-27T17:51:06.000 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/005 2023-11-27T17:51:06.000 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:51:06.002 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:06.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:51:06.077 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-11-27T17:51:06.305 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:51:06.309 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:51:06.309 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:51:06.310 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:51:06.310 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:20.484 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:51:20.486 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:51:29.772 INFO:teuthology.orchestra.run.smithi177.stdout:generic/006 23s 2023-11-27T17:51:29.776 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/006 2023-11-27T17:51:29.777 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:51:29.778 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:29.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:51:29.839 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-11-27T17:51:30.040 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:51:30.043 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:51:30.043 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:51:30.044 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:51:30.044 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:51:50.554 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:51:50.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:18.086 INFO:teuthology.orchestra.run.smithi177.stdout:generic/007 48s 2023-11-27T17:52:18.090 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/007 2023-11-27T17:52:18.090 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:52:18.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:18.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:52:18.198 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-11-27T17:52:18.393 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:52:18.397 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:52:18.397 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:52:18.398 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:52:18.399 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:18.753 INFO:teuthology.orchestra.run.smithi177.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T17:52:18.759 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/008 2023-11-27T17:52:18.759 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/008 2023-11-27T17:52:18.759 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:52:18.763 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:18.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:52:18.809 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-11-27T17:52:19.026 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:52:19.030 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:52:19.031 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:52:19.032 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:52:19.032 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:19.409 INFO:teuthology.orchestra.run.smithi177.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T17:52:19.415 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/009 2023-11-27T17:52:19.415 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/009 2023-11-27T17:52:19.416 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:52:19.416 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:19.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:52:19.443 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-11-27T17:52:19.644 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:52:19.648 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:52:19.648 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:52:19.649 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:52:19.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:20.253 INFO:teuthology.orchestra.run.smithi177.stdout:generic/010 1s 2023-11-27T17:52:20.258 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/010 2023-11-27T17:52:20.258 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:52:20.260 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:20.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:52:20.318 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-11-27T17:52:20.526 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:52:20.824 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:52:20.825 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:52:20.825 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:52:20.825 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:21.017 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:21.019 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:50.209 INFO:teuthology.orchestra.run.smithi177.stdout:generic/011 30s 2023-11-27T17:52:50.267 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/011 2023-11-27T17:52:50.267 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:52:50.269 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:50.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:52:50.463 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-11-27T17:52:50.689 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:52:50.693 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:52:50.694 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:52:50.695 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:52:50.695 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:51.062 INFO:teuthology.orchestra.run.smithi177.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:52:51.066 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/012 2023-11-27T17:52:51.066 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/012 2023-11-27T17:52:51.066 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:52:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:52:51.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:51.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:51.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:52:51.155 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-11-27T17:52:51.435 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:52:51.440 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:52:51.440 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:52:51.441 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:52:51.441 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:53:21.524 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:21.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:47.498 INFO:teuthology.orchestra.run.smithi177.stdout:generic/013 56s 2023-11-27T17:53:47.506 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/013 2023-11-27T17:53:47.506 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:53:47.510 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:53:47.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:53:47.540 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-11-27T17:53:47.877 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:53:47.886 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:53:47.886 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:53:47.887 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:53:47.887 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:53:51.855 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:51.862 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:22.233 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:22.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:52.305 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:52.315 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:55:22.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:55:22.427 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:55:52.551 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:56:56.992 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:27.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:27.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:57.205 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:57.211 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:18.622 INFO:teuthology.orchestra.run.smithi177.stdout:generic/014 270s 2023-11-27T17:58:18.627 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/014 2023-11-27T17:58:18.627 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:18.629 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:18.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:18.670 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-11-27T17:58:19.009 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:19.013 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:19.014 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:19.015 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:19.015 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:19.451 INFO:teuthology.orchestra.run.smithi177.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T17:58:19.456 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/015 2023-11-27T17:58:19.456 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/015 2023-11-27T17:58:19.456 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:19.463 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:19.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:19.487 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-11-27T17:58:19.872 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:19.885 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:19.885 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:19.886 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:19.886 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:20.523 INFO:teuthology.orchestra.run.smithi177.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:58:20.531 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/016 2023-11-27T17:58:20.531 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/016 2023-11-27T17:58:20.531 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:20.533 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:20.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:20.789 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-11-27T17:58:21.161 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:21.168 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:21.168 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:21.170 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:21.170 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:21.647 INFO:teuthology.orchestra.run.smithi177.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T17:58:21.652 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/017 2023-11-27T17:58:21.652 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/017 2023-11-27T17:58:21.652 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:21.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:21.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:21.697 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-11-27T17:58:22.091 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:22.095 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:22.095 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:22.097 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:22.097 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:22.741 INFO:teuthology.orchestra.run.smithi177.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-11-27T17:58:22.762 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/018 2023-11-27T17:58:22.762 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/018 2023-11-27T17:58:22.762 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:22.769 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:22.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:22.795 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-11-27T17:58:23.113 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:23.118 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:23.118 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:23.119 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:23.119 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:23.574 INFO:teuthology.orchestra.run.smithi177.stdout:generic/019 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:58:23.578 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/019 2023-11-27T17:58:23.578 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/019 2023-11-27T17:58:23.579 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:23.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:23.606 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-11-27T17:58:23.956 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:23.958 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:23.959 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:23.961 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:23.961 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:27.322 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:27.327 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:27.467 INFO:teuthology.orchestra.run.smithi177.stdout:generic/020 3s 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/020 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:27.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:27.745 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-11-27T17:58:28.109 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:28.114 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:28.114 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:28.116 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:28.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:28.728 INFO:teuthology.orchestra.run.smithi177.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:58:28.734 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/021 2023-11-27T17:58:28.734 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/021 2023-11-27T17:58:28.734 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:28.742 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:28.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:28.985 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-11-27T17:58:29.368 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:29.371 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:29.372 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:29.373 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:29.373 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:30.028 INFO:teuthology.orchestra.run.smithi177.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:58:30.035 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/022 2023-11-27T17:58:30.035 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/022 2023-11-27T17:58:30.035 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:30.037 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:30.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:30.329 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-11-27T17:58:30.656 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:30.661 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:30.665 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:30.666 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:30.666 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:32.339 INFO:teuthology.orchestra.run.smithi177.stdout:generic/023 2s 2023-11-27T17:58:32.349 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/023 2023-11-27T17:58:32.349 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:32.354 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:32.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:32.560 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-11-27T17:58:33.007 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:33.011 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:33.012 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:33.012 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:33.012 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:33.505 INFO:teuthology.orchestra.run.smithi177.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-27T17:58:33.515 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/024 2023-11-27T17:58:33.515 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/024 2023-11-27T17:58:33.515 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:33.517 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:33.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:33.795 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-11-27T17:58:34.148 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:34.153 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:34.154 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:34.155 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:34.155 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:34.606 INFO:teuthology.orchestra.run.smithi177.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-27T17:58:34.615 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/025 2023-11-27T17:58:34.615 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/025 2023-11-27T17:58:34.615 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:34.618 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:34.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:34.896 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-11-27T17:58:35.232 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:35.241 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:35.241 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:35.243 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:35.243 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:35.717 INFO:teuthology.orchestra.run.smithi177.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-11-27T17:58:35.722 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/026 2023-11-27T17:58:35.722 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/026 2023-11-27T17:58:35.722 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:35.725 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:35.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:35.755 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-11-27T17:58:36.103 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:36.110 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:36.110 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:36.114 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:36.114 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:36.536 INFO:teuthology.orchestra.run.smithi177.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T17:58:36.548 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/027 2023-11-27T17:58:36.548 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/027 2023-11-27T17:58:36.548 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:36.551 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:36.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:36.576 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-11-27T17:58:36.927 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:36.940 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:36.940 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:36.941 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:36.941 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:42.422 INFO:teuthology.orchestra.run.smithi177.stdout:generic/028 5s 2023-11-27T17:58:42.427 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/028 2023-11-27T17:58:42.427 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:42.430 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:42.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:42.467 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-11-27T17:58:42.797 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:42.801 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:42.801 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:42.802 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:42.802 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:49.000 INFO:teuthology.orchestra.run.smithi177.stdout:generic/029 5s 2023-11-27T17:58:49.012 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/029 2023-11-27T17:58:49.012 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:49.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:49.024 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-11-27T17:58:49.379 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:49.384 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:49.384 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:49.386 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:49.386 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:54.098 INFO:teuthology.orchestra.run.smithi177.stdout:generic/030 5s 2023-11-27T17:58:54.104 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/030 2023-11-27T17:58:54.105 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:54.108 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:54.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:54.119 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-11-27T17:58:54.440 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:54.446 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:54.446 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:54.447 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:54.447 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:55.064 INFO:teuthology.orchestra.run.smithi177.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-27T17:58:55.069 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/031 2023-11-27T17:58:55.069 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/031 2023-11-27T17:58:55.069 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:55.071 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:55.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:55.108 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-11-27T17:58:55.413 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:55.422 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:55.423 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:55.424 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:55.424 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:55.910 INFO:teuthology.orchestra.run.smithi177.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:58:55.918 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/032 2023-11-27T17:58:55.918 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/032 2023-11-27T17:58:55.918 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:55.920 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:55.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:55.951 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-11-27T17:58:56.279 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:56.286 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:56.286 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:56.288 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:56.288 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:56.853 INFO:teuthology.orchestra.run.smithi177.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T17:58:56.857 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/033 2023-11-27T17:58:56.857 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/033 2023-11-27T17:58:56.857 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:56.860 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:56.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:56.898 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-11-27T17:58:57.235 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:59.423 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:59.425 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi177.stdout:generic/034 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/034 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/034 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:58:59.426 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:58:59.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:58:59.427 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-11-27T17:58:59.468 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:59.852 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:58:59.861 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:58:59.862 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:58:59.863 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:58:59.863 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:00.433 INFO:teuthology.orchestra.run.smithi177.stdout:generic/035 0s 2023-11-27T17:59:00.443 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/035 2023-11-27T17:59:00.444 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:00.451 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:00.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:00.614 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-11-27T17:59:01.045 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:01.049 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:01.049 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:01.050 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:01.050 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:11.665 INFO:teuthology.orchestra.run.smithi177.stdout:generic/036 10s 2023-11-27T17:59:11.677 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/036 2023-11-27T17:59:11.678 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:11.680 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:11.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:11.958 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-11-27T17:59:12.289 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:12.293 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:12.293 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:12.295 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:12.295 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:18.753 INFO:teuthology.orchestra.run.smithi177.stdout:generic/037 6s 2023-11-27T17:59:18.802 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/037 2023-11-27T17:59:18.802 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:18.805 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:18.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:18.816 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-11-27T17:59:19.087 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:19.091 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:19.091 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:19.092 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:19.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:19.566 INFO:teuthology.orchestra.run.smithi177.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:59:19.575 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/038 2023-11-27T17:59:19.575 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/038 2023-11-27T17:59:19.575 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:19.577 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:19.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:19.603 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-11-27T17:59:19.909 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:19.914 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:19.915 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:19.916 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:19.916 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:20.437 INFO:teuthology.orchestra.run.smithi177.stdout:generic/039 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:20.442 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/039 2023-11-27T17:59:20.442 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/039 2023-11-27T17:59:20.443 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:20.453 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:20.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:20.489 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-11-27T17:59:20.862 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:20.873 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:20.874 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:20.875 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:20.875 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:21.392 INFO:teuthology.orchestra.run.smithi177.stdout:generic/040 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:21.400 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/040 2023-11-27T17:59:21.400 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/040 2023-11-27T17:59:21.400 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:21.403 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:21.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:21.433 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-11-27T17:59:21.790 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:21.795 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:21.795 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:21.796 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:21.796 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:22.276 INFO:teuthology.orchestra.run.smithi177.stdout:generic/041 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:22.281 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/041 2023-11-27T17:59:22.281 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/041 2023-11-27T17:59:22.281 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:22.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:22.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:22.318 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-11-27T17:59:22.642 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:22.647 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:22.648 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:22.649 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:22.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:23.291 INFO:teuthology.orchestra.run.smithi177.stdout:generic/042 [not run] ceph does not support shutdown 2023-11-27T17:59:23.314 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/042 2023-11-27T17:59:23.315 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/042 2023-11-27T17:59:23.315 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:23.317 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:23.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:23.345 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-11-27T17:59:23.669 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:23.673 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:23.673 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:23.674 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:23.674 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:24.310 INFO:teuthology.orchestra.run.smithi177.stdout:generic/043 [not run] ceph does not support shutdown 2023-11-27T17:59:24.338 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/043 2023-11-27T17:59:24.339 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/043 2023-11-27T17:59:24.339 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:24.343 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:24.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:24.364 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-11-27T17:59:24.673 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:24.677 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:24.678 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:24.680 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:25.322 INFO:teuthology.orchestra.run.smithi177.stdout:generic/044 [not run] ceph does not support shutdown 2023-11-27T17:59:25.341 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/044 2023-11-27T17:59:25.341 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/044 2023-11-27T17:59:25.341 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:25.343 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:25.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:25.377 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-11-27T17:59:25.718 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:25.732 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:25.733 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:25.734 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:25.734 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:26.421 INFO:teuthology.orchestra.run.smithi177.stdout:generic/045 [not run] ceph does not support shutdown 2023-11-27T17:59:26.440 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/045 2023-11-27T17:59:26.440 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/045 2023-11-27T17:59:26.440 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:26.442 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:26.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:26.478 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-11-27T17:59:26.818 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:26.823 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:26.824 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:26.825 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:26.825 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:27.470 INFO:teuthology.orchestra.run.smithi177.stdout:generic/046 [not run] ceph does not support shutdown 2023-11-27T17:59:27.487 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/046 2023-11-27T17:59:27.488 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/046 2023-11-27T17:59:27.488 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:27.490 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:27.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:27.517 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-11-27T17:59:27.849 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:27.853 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:27.854 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:27.855 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:27.855 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:28.529 INFO:teuthology.orchestra.run.smithi177.stdout:generic/047 [not run] ceph does not support shutdown 2023-11-27T17:59:28.551 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/047 2023-11-27T17:59:28.551 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/047 2023-11-27T17:59:28.551 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:28.553 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:28.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:28.579 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-11-27T17:59:28.910 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:28.916 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:28.916 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:28.918 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:28.918 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:29.537 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:59:29.538 INFO:teuthology.orchestra.run.smithi177.stdout:generic/048 [not run] ceph does not support shutdown 2023-11-27T17:59:29.540 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:59:29.561 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/048 2023-11-27T17:59:29.561 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/048 2023-11-27T17:59:29.561 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:29.564 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:29.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:29.600 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-11-27T17:59:29.963 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:29.969 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:29.969 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:29.971 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:29.971 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:30.644 INFO:teuthology.orchestra.run.smithi177.stdout:generic/049 [not run] ceph does not support shutdown 2023-11-27T17:59:30.669 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/049 2023-11-27T17:59:30.752 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/049 2023-11-27T17:59:30.752 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:30.753 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:30.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:30.753 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-11-27T17:59:31.094 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:31.102 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:31.102 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:31.104 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:31.104 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:31.739 INFO:teuthology.orchestra.run.smithi177.stdout:generic/050 [not run] ceph does not support shutdown 2023-11-27T17:59:34.628 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/050 2023-11-27T17:59:34.628 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/050 2023-11-27T17:59:34.628 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:34.628 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:34.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:34.629 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-11-27T17:59:34.982 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:34.990 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:34.991 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:34.992 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:34.992 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:35.610 INFO:teuthology.orchestra.run.smithi177.stdout:generic/051 [not run] ceph does not support shutdown 2023-11-27T17:59:35.615 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/051 2023-11-27T17:59:35.615 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/051 2023-11-27T17:59:35.615 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:35.618 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:35.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:35.642 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-11-27T17:59:36.002 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:36.007 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:36.007 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:36.008 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:36.008 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:36.672 INFO:teuthology.orchestra.run.smithi177.stdout:generic/052 [not run] ceph does not support shutdown 2023-11-27T17:59:36.696 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/052 2023-11-27T17:59:36.696 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/052 2023-11-27T17:59:36.696 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:36.698 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:36.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:36.730 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-11-27T17:59:37.087 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:37.093 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:37.093 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:37.095 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:37.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:38.268 INFO:teuthology.orchestra.run.smithi177.stdout:generic/053 1s 2023-11-27T17:59:38.282 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/053 2023-11-27T17:59:38.282 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:38.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:38.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:38.298 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-11-27T17:59:38.606 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:38.614 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:38.615 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:38.616 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:38.616 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:39.329 INFO:teuthology.orchestra.run.smithi177.stdout:generic/054 [not run] ceph does not support shutdown 2023-11-27T17:59:39.349 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/054 2023-11-27T17:59:39.349 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/054 2023-11-27T17:59:39.349 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:39.351 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:39.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:39.379 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-11-27T17:59:39.679 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:39.689 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:39.689 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:39.691 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:39.691 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:40.374 INFO:teuthology.orchestra.run.smithi177.stdout:generic/055 [not run] ceph does not support shutdown 2023-11-27T17:59:40.397 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/055 2023-11-27T17:59:40.397 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/055 2023-11-27T17:59:40.397 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:40.401 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:40.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:40.430 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-11-27T17:59:40.782 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:40.787 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:40.793 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:40.796 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:40.797 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:41.289 INFO:teuthology.orchestra.run.smithi177.stdout:generic/056 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:41.298 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/056 2023-11-27T17:59:41.298 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/056 2023-11-27T17:59:41.298 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:41.305 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:41.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:41.338 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-11-27T17:59:41.687 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:41.697 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:41.697 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:41.701 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:41.701 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:42.178 INFO:teuthology.orchestra.run.smithi177.stdout:generic/057 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:42.184 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/057 2023-11-27T17:59:42.184 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/057 2023-11-27T17:59:42.184 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:42.190 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:42.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:42.228 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-11-27T17:59:42.566 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:42.570 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:42.571 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:42.572 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:42.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:43.141 INFO:teuthology.orchestra.run.smithi177.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:59:43.147 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/058 2023-11-27T17:59:43.147 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/058 2023-11-27T17:59:43.147 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:43.150 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:43.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:43.347 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-11-27T17:59:43.747 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:43.753 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:43.754 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:43.755 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:43.755 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:44.241 INFO:teuthology.orchestra.run.smithi177.stdout:generic/059 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:44.245 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/059 2023-11-27T17:59:44.245 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/059 2023-11-27T17:59:44.245 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:44.247 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:44.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:44.282 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-11-27T17:59:44.597 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:44.602 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:44.603 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:44.604 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:44.604 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:45.190 INFO:teuthology.orchestra.run.smithi177.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:59:45.196 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/060 2023-11-27T17:59:45.196 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/060 2023-11-27T17:59:45.196 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:45.199 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:45.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:45.520 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-11-27T17:59:45.880 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:45.884 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:45.884 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:45.885 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:45.886 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:46.478 INFO:teuthology.orchestra.run.smithi177.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:59:46.482 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/061 2023-11-27T17:59:46.482 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/061 2023-11-27T17:59:46.482 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:46.484 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:46.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:46.794 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-11-27T17:59:47.159 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:47.164 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:47.164 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:47.168 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:47.168 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:49.977 INFO:teuthology.orchestra.run.smithi177.stdout:generic/062 2s 2023-11-27T17:59:49.990 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/062 2023-11-27T17:59:49.991 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:50.000 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:50.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:50.014 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-11-27T17:59:50.394 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:50.397 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:50.398 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:50.402 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:50.402 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:51.066 INFO:teuthology.orchestra.run.smithi177.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T17:59:51.070 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/063 2023-11-27T17:59:51.070 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/063 2023-11-27T17:59:51.070 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:51.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:51.312 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-11-27T17:59:51.719 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:51.725 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:51.725 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:51.726 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:51.726 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:52.206 INFO:teuthology.orchestra.run.smithi177.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T17:59:52.211 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/064 2023-11-27T17:59:52.211 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/064 2023-11-27T17:59:52.211 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:52.214 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:52.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:52.250 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-11-27T17:59:52.633 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:52.643 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:52.644 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:52.645 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:52.645 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:53.131 INFO:teuthology.orchestra.run.smithi177.stdout:generic/065 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:53.141 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/065 2023-11-27T17:59:53.141 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/065 2023-11-27T17:59:53.141 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:53.143 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:53.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:53.176 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-11-27T17:59:53.454 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:53.458 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:53.459 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:53.459 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:53.460 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:53.797 INFO:teuthology.orchestra.run.smithi177.stdout:generic/066 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:53.798 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/066 2023-11-27T17:59:53.798 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/066 2023-11-27T17:59:53.798 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:53.800 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:53.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:53.818 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-11-27T17:59:54.099 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:54.104 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:54.109 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:54.110 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:54.110 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:54.659 INFO:teuthology.orchestra.run.smithi177.stdout:generic/067 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T17:59:54.668 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/067 2023-11-27T17:59:54.668 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/067 2023-11-27T17:59:54.668 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:54.671 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:54.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:54.698 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-11-27T17:59:55.005 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:55.009 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:55.009 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:55.010 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:55.010 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:55.477 INFO:teuthology.orchestra.run.smithi177.stdout:generic/068 [not run] ceph does not support freezing 2023-11-27T17:59:55.481 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/068 2023-11-27T17:59:55.482 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/068 2023-11-27T17:59:55.482 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T17:59:55.484 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:55.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T17:59:55.505 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-11-27T17:59:55.856 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T17:59:55.860 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T17:59:55.861 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T17:59:55.862 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T17:59:55.862 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T17:59:59.612 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:59:59.615 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:00:02.435 INFO:teuthology.orchestra.run.smithi177.stdout:generic/069 6s 2023-11-27T18:00:02.450 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/069 2023-11-27T18:00:02.450 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:00:02.450 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:02.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:00:02.460 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-11-27T18:00:02.693 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:00:02.697 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:00:02.697 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:00:02.698 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:00:02.698 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:24.110 INFO:teuthology.orchestra.run.smithi177.stdout:generic/070 22s 2023-11-27T18:00:24.118 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/070 2023-11-27T18:00:24.118 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:00:24.121 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:24.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:00:24.462 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-11-27T18:00:24.877 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:00:24.890 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:00:24.893 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:00:24.895 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:00:24.895 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:25.361 INFO:teuthology.orchestra.run.smithi177.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T18:00:25.367 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/071 2023-11-27T18:00:25.367 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/071 2023-11-27T18:00:25.367 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:00:25.369 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:25.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:00:25.408 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-11-27T18:00:25.743 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:00:25.748 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:00:25.748 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:00:25.749 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:00:25.749 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:26.339 INFO:teuthology.orchestra.run.smithi177.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-27T18:00:26.344 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/072 2023-11-27T18:00:26.344 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/072 2023-11-27T18:00:26.344 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:00:26.351 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:26.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:00:26.396 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-11-27T18:00:26.755 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:00:26.765 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:00:26.766 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:00:26.767 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:00:26.767 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:27.255 INFO:teuthology.orchestra.run.smithi177.stdout:generic/073 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:00:27.260 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/073 2023-11-27T18:00:27.260 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/073 2023-11-27T18:00:27.260 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:00:27.264 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:27.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:00:27.295 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-11-27T18:00:27.667 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:00:27.672 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:00:27.673 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:00:27.678 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:00:27.678 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:29.671 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:00:29.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:00:46.573 INFO:teuthology.orchestra.run.smithi177.stdout:generic/074 19s 2023-11-27T18:00:46.580 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/074 2023-11-27T18:00:46.580 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:00:46.582 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:47.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:00:47.003 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-11-27T18:00:47.420 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:00:47.425 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:00:47.426 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:00:47.427 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:00:47.427 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:00:59.775 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:00:59.777 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:00:59.846 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T18:00:59.842+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 256261) UID: 0 2023-11-27T18:00:59.848 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T18:00:59.846+0000 7ff5bf82d700 -1 Fail to open '/proc/256261/cmdline' error = (2) No such file or directory 2023-11-27T18:00:59.849 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T18:00:59.846+0000 7ff5bf82d700 -1 received signal: Hangup from (PID: 256261) UID: 0 2023-11-27T18:01:20.492 INFO:teuthology.orchestra.run.smithi177.stdout:generic/075 33s 2023-11-27T18:01:20.498 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/075 2023-11-27T18:01:20.498 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:20.502 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:20.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:20.842 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-11-27T18:01:21.296 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:21.309 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:21.309 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:21.321 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:21.321 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:21.836 INFO:teuthology.orchestra.run.smithi177.stdout:generic/076 [not run] require 172.21.15.177:6789:/scratch to be local device 2023-11-27T18:01:21.845 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/076 2023-11-27T18:01:21.845 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/076 2023-11-27T18:01:21.845 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:21.851 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:21.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:21.898 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-11-27T18:01:22.284 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:22.302 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:22.304 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:22.306 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:22.306 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:25.680 INFO:teuthology.orchestra.run.smithi177.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:01:25.685 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/077 2023-11-27T18:01:25.685 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/077 2023-11-27T18:01:25.685 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:25.690 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:25.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:25.963 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-11-27T18:01:26.512 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:26.516 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:26.517 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:26.518 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:26.518 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:27.116 INFO:teuthology.orchestra.run.smithi177.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-27T18:01:27.129 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/078 2023-11-27T18:01:27.129 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/078 2023-11-27T18:01:27.129 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:27.132 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:27.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:27.365 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-11-27T18:01:27.922 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:27.933 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:27.933 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:27.937 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:27.937 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:28.458 INFO:teuthology.orchestra.run.smithi177.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-27T18:01:28.463 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/079 2023-11-27T18:01:28.463 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/079 2023-11-27T18:01:28.463 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:28.470 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:28.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:28.510 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-11-27T18:01:28.942 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:28.950 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:28.951 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:28.953 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:28.953 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:31.540 INFO:teuthology.orchestra.run.smithi177.stdout:generic/080 2s 2023-11-27T18:01:31.545 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/080 2023-11-27T18:01:31.545 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:31.547 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:31.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:31.609 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-11-27T18:01:32.100 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:32.119 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:32.119 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:32.120 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:32.120 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:generic/081 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:01:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/081 2023-11-27T18:01:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/081 2023-11-27T18:01:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:32.709 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:32.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:32.731 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-11-27T18:01:33.123 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:33.129 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:33.129 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:33.131 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:33.131 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:33.700 INFO:teuthology.orchestra.run.smithi177.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:01:33.707 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/082 2023-11-27T18:01:33.707 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/082 2023-11-27T18:01:33.707 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:33.713 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:33.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:33.735 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-11-27T18:01:34.193 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:34.198 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:34.198 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:34.199 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:34.199 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:34.768 INFO:teuthology.orchestra.run.smithi177.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:01:34.775 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/083 2023-11-27T18:01:34.775 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/083 2023-11-27T18:01:34.775 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:34.779 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:34.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:34.815 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-11-27T18:01:35.235 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:35.244 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:35.244 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:35.245 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:35.245 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:41.548 INFO:teuthology.orchestra.run.smithi177.stdout:generic/084 6s 2023-11-27T18:01:41.559 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/084 2023-11-27T18:01:41.559 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:41.561 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:41.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:41.573 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-11-27T18:01:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:41.986 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:42.560 INFO:teuthology.orchestra.run.smithi177.stdout:generic/085 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:01:42.565 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/085 2023-11-27T18:01:42.565 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/085 2023-11-27T18:01:42.565 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:42.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:42.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:42.612 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-11-27T18:01:43.053 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:43.057 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:43.059 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:43.060 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:43.060 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:43.635 INFO:teuthology.orchestra.run.smithi177.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:01:43.642 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/086 2023-11-27T18:01:43.642 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/086 2023-11-27T18:01:43.642 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:43.644 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:43.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:43.692 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-11-27T18:01:44.113 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:44.121 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:44.121 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:44.126 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:44.127 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:44.777 INFO:teuthology.orchestra.run.smithi177.stdout:generic/087 0s 2023-11-27T18:01:44.785 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/087 2023-11-27T18:01:44.785 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:44.793 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:45.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:45.144 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-11-27T18:01:45.625 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:45.629 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:45.629 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:45.631 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:45.631 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:46.207 INFO:teuthology.orchestra.run.smithi177.stdout:generic/088 1s 2023-11-27T18:01:46.223 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/088 2023-11-27T18:01:46.223 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:01:46.225 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:01:46.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:01:46.513 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-11-27T18:01:47.015 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:01:47.033 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:01:47.038 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:01:47.041 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:01:47.041 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:03:32.839 INFO:teuthology.orchestra.run.smithi177.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2023-11-27T18:03:32.839 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: stdin: file size changed while zipping 2023-11-27T18:04:04.122 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:04.126 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:34.984 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:34.987 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:05.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:05.044 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:35.120 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:35.122 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:05.587 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:05.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:05.625 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T18:06:05.622+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 265236) UID: 0 2023-11-27T18:06:05.626 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T18:06:05.622+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 265236) UID: 0 2023-11-27T18:09:03.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:09:03.900 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:09:34.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:09:35.477 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:10:02.319 INFO:teuthology.orchestra.run.smithi177.stdout:generic/089 495s 2023-11-27T18:10:02.333 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/089 2023-11-27T18:10:02.333 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:10:02.335 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:10:03.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:10:03.690 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-11-27T18:10:05.260 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:10:05.304 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:10:05.305 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:10:05.311 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:10:05.311 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:10:05.551 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:10:05.554 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:10:05.593 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T18:10:05.590+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 267691) UID: 0 2023-11-27T18:10:05.593 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T18:10:05.590+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 267691) UID: 0 2023-11-27T18:10:05.711 INFO:teuthology.orchestra.run.smithi177.stdout:generic/090 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:10:05.715 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/090 2023-11-27T18:10:05.715 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/090 2023-11-27T18:10:05.715 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:10:05.719 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:10:05.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:10:05.741 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-11-27T18:10:05.986 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:10:05.989 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:10:05.990 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:10:05.991 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:10:05.991 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:11:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:generic/091 105s 2023-11-27T18:11:51.404 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/091 2023-11-27T18:11:51.405 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:11:51.407 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:11:51.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:11:51.729 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-11-27T18:11:52.025 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:11:52.030 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:11:52.031 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:11:52.031 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:11:52.031 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:11:52.390 INFO:teuthology.orchestra.run.smithi177.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:11:52.393 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/092 2023-11-27T18:11:52.393 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/092 2023-11-27T18:11:52.393 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:11:52.395 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:11:52.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:11:52.427 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-11-27T18:11:52.651 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:11:52.656 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:11:52.657 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:11:52.657 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:11:52.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:11:53.251 INFO:teuthology.orchestra.run.smithi177.stdout:generic/093 1s 2023-11-27T18:11:53.257 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/093 2023-11-27T18:11:53.257 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:11:53.258 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:11:53.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:11:53.641 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-11-27T18:11:53.878 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:11:53.882 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:11:53.883 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:11:53.884 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:11:53.884 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:11:54.266 INFO:teuthology.orchestra.run.smithi177.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T18:11:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/094 2023-11-27T18:11:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/094 2023-11-27T18:11:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:11:54.272 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:11:54.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:11:54.595 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-11-27T18:11:54.870 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:11:54.880 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:11:54.880 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:11:54.881 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:11:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:08.422 INFO:teuthology.orchestra.run.smithi177.stdout:generic/095 13s 2023-11-27T18:12:08.431 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/095 2023-11-27T18:12:08.431 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:08.433 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:08.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:08.447 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-11-27T18:12:08.656 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:08.659 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:08.660 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:08.661 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:08.661 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:09.073 INFO:teuthology.orchestra.run.smithi177.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T18:12:09.077 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/096 2023-11-27T18:12:09.077 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/096 2023-11-27T18:12:09.077 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:09.079 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:09.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:09.107 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-11-27T18:12:09.315 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:09.317 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:09.317 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:09.318 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:09.318 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:10.186 INFO:teuthology.orchestra.run.smithi177.stdout:generic/097 1s 2023-11-27T18:12:10.193 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/097 2023-11-27T18:12:10.193 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:10.194 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:10.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:10.219 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-11-27T18:12:10.440 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:10.445 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:10.445 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:10.446 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:10.446 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:12.887 INFO:teuthology.orchestra.run.smithi177.stdout:generic/098 2s 2023-11-27T18:12:12.892 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/098 2023-11-27T18:12:12.893 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:12.895 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:12.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:12.903 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-11-27T18:12:13.110 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:13.114 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:13.115 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:13.115 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:13.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:14.077 INFO:teuthology.orchestra.run.smithi177.stdout:generic/099 1s 2023-11-27T18:12:14.082 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/099 2023-11-27T18:12:14.082 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:14.083 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:14.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:14.395 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-11-27T18:12:14.719 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:14.723 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:14.723 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:14.724 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:14.724 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:26.262 INFO:teuthology.orchestra.run.smithi177.stdout:generic/100 12s 2023-11-27T18:12:26.267 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/100 2023-11-27T18:12:26.267 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:26.269 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:30.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:30.151 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-11-27T18:12:30.498 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:30.505 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:30.505 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:30.506 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:30.506 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:30.822 INFO:teuthology.orchestra.run.smithi177.stdout:generic/101 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:12:30.831 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/101 2023-11-27T18:12:30.831 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/101 2023-11-27T18:12:30.831 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:30.831 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:30.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:30.852 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-11-27T18:12:31.054 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:31.059 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:31.059 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:31.059 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:31.059 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:31.366 INFO:teuthology.orchestra.run.smithi177.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:12:31.369 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/102 2023-11-27T18:12:31.370 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/102 2023-11-27T18:12:31.370 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:31.370 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:31.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:31.389 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-11-27T18:12:31.604 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:31.608 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:31.609 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:31.609 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:31.610 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:31.938 INFO:teuthology.orchestra.run.smithi177.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:12:31.940 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/103 2023-11-27T18:12:31.940 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/103 2023-11-27T18:12:31.940 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:31.943 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:32.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:32.270 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-11-27T18:12:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:32.513 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:32.842 INFO:teuthology.orchestra.run.smithi177.stdout:generic/104 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:12:32.846 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/104 2023-11-27T18:12:32.847 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/104 2023-11-27T18:12:32.847 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:32.848 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:32.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:32.880 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-11-27T18:12:33.123 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:33.127 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:33.128 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:33.129 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:33.129 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:33.865 INFO:teuthology.orchestra.run.smithi177.stdout:generic/105 0s 2023-11-27T18:12:34.091 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/105 2023-11-27T18:12:34.091 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:34.094 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:34.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:34.119 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-11-27T18:12:34.332 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:34.337 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:34.337 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:34.338 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:34.338 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:34.689 INFO:teuthology.orchestra.run.smithi177.stdout:generic/106 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:12:34.689 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/106 2023-11-27T18:12:34.689 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/106 2023-11-27T18:12:34.689 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:34.689 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:34.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:34.721 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-11-27T18:12:34.942 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:34.946 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:34.946 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:34.947 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:34.947 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:35.272 INFO:teuthology.orchestra.run.smithi177.stdout:generic/107 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:12:35.276 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/107 2023-11-27T18:12:35.276 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/107 2023-11-27T18:12:35.277 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:35.278 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:35.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:35.312 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-11-27T18:12:35.519 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:35.523 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:35.523 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:35.526 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:35.527 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:35.991 INFO:teuthology.orchestra.run.smithi177.stdout:generic/108 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:12:35.993 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/108 2023-11-27T18:12:35.994 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/108 2023-11-27T18:12:35.994 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:36.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:36.025 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-11-27T18:12:36.230 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:36.232 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:36.232 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:36.233 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:36.233 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:46.137 INFO:teuthology.orchestra.run.smithi177.stdout:generic/109 10s 2023-11-27T18:12:46.143 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/109 2023-11-27T18:12:46.143 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:12:46.151 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:46.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:12:46.177 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-11-27T18:12:47.101 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:12:47.105 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:12:47.105 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:12:47.106 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:12:47.106 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:12:47.634 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:47.636 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:06.370 INFO:teuthology.orchestra.run.smithi177.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:13:06.374 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/110 2023-11-27T18:13:06.374 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/110 2023-11-27T18:13:06.375 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:06.376 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:06.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:06.533 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-11-27T18:13:07.411 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:07.425 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:07.426 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:07.428 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:07.428 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:07.861 INFO:teuthology.orchestra.run.smithi177.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:13:07.865 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/111 2023-11-27T18:13:07.865 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/111 2023-11-27T18:13:07.866 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:07.867 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:08.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:08.204 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-11-27T18:13:08.414 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:08.419 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:08.419 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:08.419 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:08.419 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:17.706 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:17.708 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:23.950 INFO:teuthology.orchestra.run.smithi177.stdout:generic/112 15s 2023-11-27T18:13:23.955 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/112 2023-11-27T18:13:23.955 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:23.957 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:24.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:24.258 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-11-27T18:13:24.530 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:24.534 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:24.535 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:24.536 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:24.536 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:39.257 INFO:teuthology.orchestra.run.smithi177.stdout:generic/113 15s 2023-11-27T18:13:39.297 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/113 2023-11-27T18:13:39.297 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:39.299 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:39.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:39.631 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-11-27T18:13:40.011 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:40.015 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:40.015 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:40.017 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:40.017 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:40.411 INFO:teuthology.orchestra.run.smithi177.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-27T18:13:40.415 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/114 2023-11-27T18:13:40.415 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/114 2023-11-27T18:13:40.416 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:40.417 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:40.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:40.444 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-11-27T18:13:40.650 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:40.654 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:40.654 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:40.655 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:40.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:41.002 INFO:teuthology.orchestra.run.smithi177.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:13:41.006 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/115 2023-11-27T18:13:41.006 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/115 2023-11-27T18:13:41.006 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:41.008 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:41.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:41.327 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-11-27T18:13:41.575 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:41.579 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:41.579 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:41.581 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:41.581 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:13:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/116 2023-11-27T18:13:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/116 2023-11-27T18:13:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:41.988 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:42.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:42.315 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-11-27T18:13:42.578 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:42.582 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:42.583 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:42.584 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:42.584 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:48.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:48.030 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:54.850 INFO:teuthology.orchestra.run.smithi177.stdout:generic/117 12s 2023-11-27T18:13:54.855 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/117 2023-11-27T18:13:54.855 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:54.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:54.866 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-11-27T18:13:55.071 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:55.075 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:55.075 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:55.076 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:55.076 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:55.923 INFO:teuthology.orchestra.run.smithi177.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:13:55.927 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/118 2023-11-27T18:13:55.927 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/118 2023-11-27T18:13:55.927 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:55.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:56.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:56.259 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-11-27T18:13:56.501 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:56.505 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:56.505 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:56.506 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:56.506 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:56.842 INFO:teuthology.orchestra.run.smithi177.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:13:56.846 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/119 2023-11-27T18:13:56.846 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/119 2023-11-27T18:13:56.846 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:56.848 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:57.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:57.112 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-11-27T18:13:57.419 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:57.423 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:57.423 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:57.424 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:57.424 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:57.747 INFO:teuthology.orchestra.run.smithi177.stdout:generic/120 [not run] atime not maintained by ceph 2023-11-27T18:13:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/120 2023-11-27T18:13:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/120 2023-11-27T18:13:57.751 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:57.752 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:57.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:57.773 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-11-27T18:13:57.983 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:57.987 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:57.987 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:57.988 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:57.988 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:58.346 INFO:teuthology.orchestra.run.smithi177.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:13:58.350 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/121 2023-11-27T18:13:58.351 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/121 2023-11-27T18:13:58.351 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:58.352 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:58.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:58.642 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-11-27T18:13:58.914 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:58.918 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:58.918 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:58.919 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:58.919 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:59.265 INFO:teuthology.orchestra.run.smithi177.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:13:59.269 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/122 2023-11-27T18:13:59.269 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/122 2023-11-27T18:13:59.269 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:13:59.271 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:13:59.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:13:59.523 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-11-27T18:13:59.835 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:13:59.839 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:13:59.839 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:13:59.840 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:13:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:14:00.339 INFO:teuthology.orchestra.run.smithi177.stdout:generic/123 0s 2023-11-27T18:14:00.344 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/123 2023-11-27T18:14:00.344 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:14:00.346 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:14:00.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:14:00.679 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-11-27T18:14:00.966 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:14:00.970 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:14:00.970 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:14:00.971 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:14:00.972 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:14:03.229 INFO:teuthology.orchestra.run.smithi177.stdout:generic/124 2s 2023-11-27T18:14:03.235 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/124 2023-11-27T18:14:03.236 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:14:03.249 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:14:03.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:14:03.695 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-11-27T18:14:04.160 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:14:04.164 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:14:04.164 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:14:04.165 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:14:18.163 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:20.873 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:50.946 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:50.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:05.653 INFO:teuthology.orchestra.run.smithi177.stdout:generic/125 61s 2023-11-27T18:15:05.658 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/125 2023-11-27T18:15:05.658 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:15:05.661 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:15:05.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:15:05.912 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-11-27T18:15:06.210 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:15:06.214 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:15:06.215 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:15:06.216 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:15:06.216 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:15:06.721 INFO:teuthology.orchestra.run.smithi177.stdout:generic/126 0s 2023-11-27T18:15:06.726 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/126 2023-11-27T18:15:06.726 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:15:06.732 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:15:06.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:15:06.996 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-11-27T18:15:07.300 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:15:07.304 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:15:07.304 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:15:07.306 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:15:07.306 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:15:21.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:21.036 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:51.097 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:51.099 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:21.154 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:26.055 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:56.107 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:56.110 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:26.180 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:26.182 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:56.285 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:56.288 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:26.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:26.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:56.403 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:56.406 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:26.520 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:26.522 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:56.579 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:56.582 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:27.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:27.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:57.164 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:57.167 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:27.702 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:27.705 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:57.910 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:57.913 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:28.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:28.214 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:58.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:58.272 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:28.348 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:28.351 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:58.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:58.455 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:12.941 INFO:teuthology.orchestra.run.smithi177.stdout:generic/127 545s 2023-11-27T18:24:12.946 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/127 2023-11-27T18:24:12.946 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:24:12.948 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:24:13.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:24:13.227 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-11-27T18:24:13.517 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:24:13.521 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:24:13.521 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:24:13.522 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:24:13.523 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:24:14.558 INFO:teuthology.orchestra.run.smithi177.stdout:generic/128 1s 2023-11-27T18:24:14.563 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/128 2023-11-27T18:24:14.563 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:24:14.565 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:24:14.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:24:14.574 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-11-27T18:24:14.780 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:24:14.783 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:24:14.784 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:24:14.785 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:24:14.785 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:24:28.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:28.518 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:58.929 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:58.931 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:29.047 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:29.050 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:59.145 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:59.154 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:29.277 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:29.290 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:59.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:59.618 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:29.910 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:29.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:00.093 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:00.123 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:30.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:30.316 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:00.748 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:00.770 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:30.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:30.934 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:01.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:01.391 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:31.542 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:31.548 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:01.702 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:01.704 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:31.837 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:31.840 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:01.982 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:01.984 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:32.230 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:32.233 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:02.339 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:02.342 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:32.481 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:32.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:33.231 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T18:33:33.228+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 306576) UID: 0 2023-11-27T18:33:33.231 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T18:33:33.228+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 306576) UID: 0 2023-11-27T18:33:33.233 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T18:33:33.228+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 306576) UID: 0 2023-11-27T18:33:33.235 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T18:33:33.228+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 306576) UID: 0 2023-11-27T18:37:23.888 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:23.891 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:54.508 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:54.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:24.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:24.700 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:54.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:54.825 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:25.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:25.147 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:55.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:55.636 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:55.695 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T18:39:55.692+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143323) UID: 0 2023-11-27T18:39:55.696 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T18:39:55.692+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143323) UID: 0 2023-11-27T18:39:55.696 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T18:39:55.692+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143323) UID: 0 2023-11-27T18:39:55.696 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T18:39:55.692+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143323) UID: 0 2023-11-27T18:43:43.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:43:43.991 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:43:44.170 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T18:43:44.164+0000 7f61c2af4700 -1 received signal: Hangup from (PID: 143387) UID: 0 2023-11-27T18:43:44.173 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T18:43:44.164+0000 7efc559e2700 -1 received signal: Hangup from (PID: 143387) UID: 0 2023-11-27T18:43:44.175 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T18:43:44.172+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 143387) UID: 0 2023-11-27T18:43:44.178 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T18:43:44.171+0000 7f164d737700 -1 received signal: Hangup from (PID: 143387) UID: 0 2023-11-27T18:44:22.864 INFO:teuthology.orchestra.run.smithi177.stdout:generic/129 1208s 2023-11-27T18:44:22.883 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/129 2023-11-27T18:44:22.883 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:44:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:44:22.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:44:22.900 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-11-27T18:44:23.303 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:44:23.308 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:44:23.308 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:44:23.308 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:44:23.309 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:44:36.889 INFO:teuthology.orchestra.run.smithi177.stdout:generic/130 13s 2023-11-27T18:44:36.945 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/130 2023-11-27T18:44:36.945 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:44:36.958 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:44:36.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:44:36.981 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-11-27T18:44:37.188 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:44:37.192 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:44:37.193 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:44:37.194 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:44:37.194 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:44:38.698 INFO:teuthology.orchestra.run.smithi177.stdout:generic/131 1s 2023-11-27T18:44:38.704 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/131 2023-11-27T18:44:38.704 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:44:38.710 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:44:38.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:44:38.979 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-11-27T18:44:39.413 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:44:39.418 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:44:39.418 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:44:39.419 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:44:39.419 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:44:53.216 INFO:teuthology.orchestra.run.smithi177.stdout:generic/132 14s 2023-11-27T18:44:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/132 2023-11-27T18:44:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:44:53.222 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:44:53.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:44:53.231 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-11-27T18:44:53.447 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:44:53.451 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:44:53.451 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:44:53.452 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:44:53.453 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:48:25.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:48:25.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:48:25.125 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T18:48:25.122+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 309776) UID: 0 2023-11-27T18:48:25.125 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T18:48:25.122+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 309776) UID: 0 2023-11-27T18:48:25.126 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T18:48:25.122+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 309776) UID: 0 2023-11-27T18:48:25.126 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T18:48:25.122+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 309776) UID: 0 2023-11-27T18:48:58.479 INFO:teuthology.orchestra.run.smithi177.stdout:generic/133 245s 2023-11-27T18:48:58.508 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/133 2023-11-27T18:48:58.508 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:48:58.510 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:48:58.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:48:58.883 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-11-27T18:48:59.372 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:48:59.375 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:48:59.376 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:48:59.377 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:48:59.377 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:48:59.744 INFO:teuthology.orchestra.run.smithi177.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:48:59.748 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/134 2023-11-27T18:48:59.748 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/134 2023-11-27T18:48:59.748 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:48:59.750 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:00.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:00.010 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-11-27T18:49:00.446 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:00.449 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:00.450 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:00.451 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:00.451 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:01.642 INFO:teuthology.orchestra.run.smithi177.stdout:generic/135 1s 2023-11-27T18:49:01.647 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/135 2023-11-27T18:49:01.647 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:01.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:01.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:01.659 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-11-27T18:49:01.866 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:01.869 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:01.870 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:01.871 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:01.871 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:02.246 INFO:teuthology.orchestra.run.smithi177.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:49:02.250 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/136 2023-11-27T18:49:02.250 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/136 2023-11-27T18:49:02.250 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:02.252 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:02.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:02.476 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-11-27T18:49:02.910 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:02.913 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:02.914 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:02.915 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:02.915 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:03.283 INFO:teuthology.orchestra.run.smithi177.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:03.287 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/137 2023-11-27T18:49:03.287 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/137 2023-11-27T18:49:03.287 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:03.289 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:03.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:03.603 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-11-27T18:49:03.928 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:03.932 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:03.932 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:03.933 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:03.933 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:04.280 INFO:teuthology.orchestra.run.smithi177.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:04.284 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/138 2023-11-27T18:49:04.284 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/138 2023-11-27T18:49:04.284 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:04.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:04.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:04.560 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-11-27T18:49:04.920 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:04.923 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:04.924 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:04.925 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:04.925 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:05.254 INFO:teuthology.orchestra.run.smithi177.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:05.259 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/139 2023-11-27T18:49:05.259 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/139 2023-11-27T18:49:05.259 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:05.261 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:05.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:05.592 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-11-27T18:49:05.878 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:05.882 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:05.882 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:05.883 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:05.884 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:06.255 INFO:teuthology.orchestra.run.smithi177.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:06.258 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/140 2023-11-27T18:49:06.258 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/140 2023-11-27T18:49:06.259 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:06.261 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:06.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:06.597 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-11-27T18:49:06.887 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:06.891 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:06.892 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:06.892 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:06.893 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:07.439 INFO:teuthology.orchestra.run.smithi177.stdout:generic/141 0s 2023-11-27T18:49:07.444 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/141 2023-11-27T18:49:07.444 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:07.446 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:07.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:07.455 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-11-27T18:49:07.664 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:07.667 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:07.667 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:07.668 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:07.668 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:08.026 INFO:teuthology.orchestra.run.smithi177.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:08.030 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/142 2023-11-27T18:49:08.030 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/142 2023-11-27T18:49:08.030 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:08.032 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:08.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:08.374 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-11-27T18:49:08.666 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:08.670 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:08.670 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:08.672 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:08.672 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:09.022 INFO:teuthology.orchestra.run.smithi177.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:09.026 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/143 2023-11-27T18:49:09.026 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/143 2023-11-27T18:49:09.026 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:09.028 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:09.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:09.219 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-11-27T18:49:09.665 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:09.669 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:09.670 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:09.671 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:09.671 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:10.027 INFO:teuthology.orchestra.run.smithi177.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:10.031 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/144 2023-11-27T18:49:10.031 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/144 2023-11-27T18:49:10.031 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:10.033 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:10.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:10.196 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-11-27T18:49:10.649 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:10.652 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:10.653 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:10.654 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:10.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:10.976 INFO:teuthology.orchestra.run.smithi177.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:10.980 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/145 2023-11-27T18:49:10.981 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/145 2023-11-27T18:49:10.981 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:10.983 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:11.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:11.349 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-11-27T18:49:11.593 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:11.598 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:11.944 INFO:teuthology.orchestra.run.smithi177.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:11.948 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/146 2023-11-27T18:49:11.948 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/146 2023-11-27T18:49:11.948 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:11.950 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:12.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:12.092 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-11-27T18:49:12.592 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:12.596 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:12.596 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:12.597 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:12.598 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:12.947 INFO:teuthology.orchestra.run.smithi177.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:12.952 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/147 2023-11-27T18:49:12.952 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/147 2023-11-27T18:49:12.952 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:12.954 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:13.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:13.270 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-11-27T18:49:13.574 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:13.578 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:13.578 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:13.580 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:13.580 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:13.923 INFO:teuthology.orchestra.run.smithi177.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/148 2023-11-27T18:49:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/148 2023-11-27T18:49:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:13.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:14.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:14.292 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-11-27T18:49:14.553 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:14.556 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:14.557 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:14.558 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:14.558 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:14.912 INFO:teuthology.orchestra.run.smithi177.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:14.916 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/149 2023-11-27T18:49:14.916 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/149 2023-11-27T18:49:14.916 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:14.918 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:15.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:15.193 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-11-27T18:49:15.546 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:15.549 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:15.550 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:15.551 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:15.551 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:15.912 INFO:teuthology.orchestra.run.smithi177.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:15.917 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/150 2023-11-27T18:49:15.917 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/150 2023-11-27T18:49:15.917 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:15.919 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:16.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:16.301 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-11-27T18:49:16.570 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:16.574 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:16.574 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:16.575 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:16.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:16.928 INFO:teuthology.orchestra.run.smithi177.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:16.932 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/151 2023-11-27T18:49:16.932 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/151 2023-11-27T18:49:16.932 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:16.934 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:17.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:17.281 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-11-27T18:49:17.562 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:17.566 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:17.566 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:17.567 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:17.567 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:17.918 INFO:teuthology.orchestra.run.smithi177.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:17.922 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/152 2023-11-27T18:49:17.922 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/152 2023-11-27T18:49:17.922 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:17.924 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:18.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:18.130 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-11-27T18:49:18.568 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:18.572 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:18.573 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:18.574 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:18.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:18.911 INFO:teuthology.orchestra.run.smithi177.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:18.915 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/153 2023-11-27T18:49:18.915 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/153 2023-11-27T18:49:18.915 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:18.917 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:19.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:19.280 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-11-27T18:49:19.529 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:19.533 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:19.534 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:19.535 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:19.535 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:19.892 INFO:teuthology.orchestra.run.smithi177.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:19.896 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/154 2023-11-27T18:49:19.896 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/154 2023-11-27T18:49:19.896 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:19.898 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:20.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:20.297 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-11-27T18:49:20.529 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:20.532 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:20.533 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:20.534 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:20.534 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:20.888 INFO:teuthology.orchestra.run.smithi177.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:20.892 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/155 2023-11-27T18:49:20.892 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/155 2023-11-27T18:49:20.892 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:20.894 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:21.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:21.044 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-11-27T18:49:21.557 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:21.561 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:21.561 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:21.562 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:21.562 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:21.921 INFO:teuthology.orchestra.run.smithi177.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:21.925 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/156 2023-11-27T18:49:21.925 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/156 2023-11-27T18:49:21.925 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:21.927 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:22.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:22.246 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-11-27T18:49:22.562 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:22.566 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:22.566 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:22.567 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:22.567 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:22.930 INFO:teuthology.orchestra.run.smithi177.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:22.934 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/157 2023-11-27T18:49:22.934 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/157 2023-11-27T18:49:22.934 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:22.936 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:23.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:23.117 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-11-27T18:49:23.566 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:23.570 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:23.571 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:23.571 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:23.927 INFO:teuthology.orchestra.run.smithi177.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:49:23.931 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/158 2023-11-27T18:49:23.931 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/158 2023-11-27T18:49:23.931 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:23.933 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:24.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:24.135 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-11-27T18:49:24.555 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:24.559 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:24.559 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:24.560 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:24.560 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:24.940 INFO:teuthology.orchestra.run.smithi177.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-27T18:49:24.944 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/159 2023-11-27T18:49:24.944 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/159 2023-11-27T18:49:24.944 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:24.946 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:24.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:24.975 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-11-27T18:49:25.192 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:25.196 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:25.197 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:25.198 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:25.198 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:25.545 INFO:teuthology.orchestra.run.smithi177.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-27T18:49:25.549 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/160 2023-11-27T18:49:25.549 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/160 2023-11-27T18:49:25.549 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:25.551 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:25.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:25.580 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-11-27T18:49:25.800 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:25.805 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:25.805 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:25.806 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:25.806 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:26.553 INFO:teuthology.orchestra.run.smithi177.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:26.559 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/161 2023-11-27T18:49:26.559 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/161 2023-11-27T18:49:26.560 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:26.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:26.718 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-11-27T18:49:26.954 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:26.958 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:26.958 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:26.959 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:26.959 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:27.485 INFO:teuthology.orchestra.run.smithi177.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T18:49:27.714 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/162 2023-11-27T18:49:27.714 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/162 2023-11-27T18:49:27.714 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:27.717 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:27.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:27.876 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-11-27T18:49:28.115 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:28.119 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:28.119 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:28.120 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:28.120 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:28.630 INFO:teuthology.orchestra.run.smithi177.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T18:49:28.824 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/163 2023-11-27T18:49:28.824 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/163 2023-11-27T18:49:28.825 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:28.952 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:29.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:29.043 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-11-27T18:49:29.273 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:29.277 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:29.277 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:29.278 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:29.278 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:30.113 INFO:teuthology.orchestra.run.smithi177.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:30.202 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/164 2023-11-27T18:49:30.202 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/164 2023-11-27T18:49:30.202 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:30.205 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:30.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:30.235 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-11-27T18:49:30.442 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:30.446 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:30.447 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:30.448 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:30.448 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:31.280 INFO:teuthology.orchestra.run.smithi177.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:40.210 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/165 2023-11-27T18:49:40.210 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/165 2023-11-27T18:49:40.210 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:40.210 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:40.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:40.210 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-11-27T18:49:40.450 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:40.454 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:40.454 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:40.455 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:40.455 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:41.318 INFO:teuthology.orchestra.run.smithi177.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:41.342 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/166 2023-11-27T18:49:41.342 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/166 2023-11-27T18:49:41.342 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:41.345 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:41.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:41.396 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-11-27T18:49:41.617 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:41.621 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:41.622 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:41.623 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:41.623 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:42.424 INFO:teuthology.orchestra.run.smithi177.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:42.508 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/167 2023-11-27T18:49:42.508 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/167 2023-11-27T18:49:42.508 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:42.517 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:42.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:42.577 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-11-27T18:49:42.785 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:42.789 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:42.789 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:42.790 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:42.790 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:43.511 INFO:teuthology.orchestra.run.smithi177.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:43.535 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/168 2023-11-27T18:49:43.535 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/168 2023-11-27T18:49:43.535 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:43.540 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:43.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:43.729 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-11-27T18:49:43.939 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:43.943 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:43.943 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:43.945 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:43.945 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:44.718 INFO:teuthology.orchestra.run.smithi177.stdout:generic/169 0s 2023-11-27T18:49:44.722 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/169 2023-11-27T18:49:44.722 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:44.724 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:44.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:44.733 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-11-27T18:49:44.955 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:44.959 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:44.959 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:44.960 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:44.960 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:45.784 INFO:teuthology.orchestra.run.smithi177.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:45.792 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/170 2023-11-27T18:49:45.793 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/170 2023-11-27T18:49:45.793 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:45.795 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:45.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:45.895 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-11-27T18:49:46.103 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:46.106 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:46.107 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:46.108 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:46.108 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:46.960 INFO:teuthology.orchestra.run.smithi177.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:46.967 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/171 2023-11-27T18:49:46.967 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/171 2023-11-27T18:49:46.967 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:46.977 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:47.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:47.082 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-11-27T18:49:47.275 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:47.279 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:47.279 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:47.280 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:47.280 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:48.059 INFO:teuthology.orchestra.run.smithi177.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:48.157 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/172 2023-11-27T18:49:48.157 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/172 2023-11-27T18:49:48.157 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:48.186 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:48.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:48.225 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-11-27T18:49:48.436 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:48.440 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:48.440 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:48.441 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:48.441 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:49.177 INFO:teuthology.orchestra.run.smithi177.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:49.191 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/173 2023-11-27T18:49:49.191 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/173 2023-11-27T18:49:49.191 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:49.262 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:49.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:49.355 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-11-27T18:49:49.586 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:49.590 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:49.590 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:49.591 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:49.592 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:50.399 INFO:teuthology.orchestra.run.smithi177.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:50.431 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/174 2023-11-27T18:49:50.431 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/174 2023-11-27T18:49:50.432 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:50.459 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:50.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:50.519 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-11-27T18:49:50.746 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:50.750 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:50.750 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:50.751 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:50.751 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:51.527 INFO:teuthology.orchestra.run.smithi177.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:51.536 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/175 2023-11-27T18:49:51.536 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/175 2023-11-27T18:49:51.536 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:51.553 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:51.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:51.664 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-11-27T18:49:51.920 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:51.925 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:51.925 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:51.926 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:51.926 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:52.618 INFO:teuthology.orchestra.run.smithi177.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:52.748 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/176 2023-11-27T18:49:52.748 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/176 2023-11-27T18:49:52.748 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:52.754 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:52.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:52.856 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-11-27T18:49:53.077 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:53.081 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:53.081 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:53.083 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:53.083 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:53.582 INFO:teuthology.orchestra.run.smithi177.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T18:49:53.586 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/177 2023-11-27T18:49:53.586 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/177 2023-11-27T18:49:53.586 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:53.589 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:53.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:53.986 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-11-27T18:49:54.223 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:54.227 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:54.228 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:54.574 INFO:teuthology.orchestra.run.smithi177.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:54.578 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/178 2023-11-27T18:49:54.578 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/178 2023-11-27T18:49:54.578 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:54.580 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:54.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:54.978 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-11-27T18:49:55.218 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:55.222 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:55.222 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:55.223 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:55.223 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:55.562 INFO:teuthology.orchestra.run.smithi177.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:55.566 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/179 2023-11-27T18:49:55.566 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/179 2023-11-27T18:49:55.566 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:55.568 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:55.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:55.710 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-11-27T18:49:56.171 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:56.175 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:56.176 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:56.177 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:56.177 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:56.542 INFO:teuthology.orchestra.run.smithi177.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:56.545 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/180 2023-11-27T18:49:56.546 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/180 2023-11-27T18:49:56.546 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:56.548 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:56.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:56.604 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-11-27T18:49:57.150 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:57.154 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:57.155 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:57.156 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:57.156 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:57.505 INFO:teuthology.orchestra.run.smithi177.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:49:57.509 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/181 2023-11-27T18:49:57.509 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/181 2023-11-27T18:49:57.509 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:57.510 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:57.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:57.830 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-11-27T18:49:58.115 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:58.119 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:58.119 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:58.120 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:58.120 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:58.458 INFO:teuthology.orchestra.run.smithi177.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:49:58.462 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/182 2023-11-27T18:49:58.462 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/182 2023-11-27T18:49:58.462 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:49:58.464 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:58.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:49:58.813 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-11-27T18:49:59.100 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:49:59.104 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:49:59.104 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:49:59.105 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:49:59.105 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:49:59.944 INFO:teuthology.orchestra.run.smithi177.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:00.001 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/183 2023-11-27T18:50:00.002 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/183 2023-11-27T18:50:00.002 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:00.004 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:00.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:00.036 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-11-27T18:50:00.257 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:00.260 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:00.261 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:00.262 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:00.262 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:00.714 INFO:teuthology.orchestra.run.smithi177.stdout:generic/184 0s 2023-11-27T18:50:00.718 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/184 2023-11-27T18:50:00.718 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:00.720 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:00.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:00.746 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-11-27T18:50:00.951 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:00.955 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:00.956 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:00.957 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:00.957 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:01.812 INFO:teuthology.orchestra.run.smithi177.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:01.818 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/185 2023-11-27T18:50:01.818 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/185 2023-11-27T18:50:01.818 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:01.825 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:01.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:01.882 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-11-27T18:50:02.104 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:02.107 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:02.108 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:02.109 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:02.109 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:02.927 INFO:teuthology.orchestra.run.smithi177.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:02.936 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/186 2023-11-27T18:50:02.936 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/186 2023-11-27T18:50:02.936 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:02.940 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:03.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:03.031 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-11-27T18:50:03.261 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:03.265 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:03.265 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:03.266 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:03.266 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:04.201 INFO:teuthology.orchestra.run.smithi177.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:04.210 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/187 2023-11-27T18:50:04.211 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/187 2023-11-27T18:50:04.211 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:04.217 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:04.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:04.242 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-11-27T18:50:04.451 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:04.455 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:04.456 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:04.457 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:04.457 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:05.289 INFO:teuthology.orchestra.run.smithi177.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:05.296 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/188 2023-11-27T18:50:05.296 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/188 2023-11-27T18:50:05.296 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:05.330 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:05.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:05.391 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-11-27T18:50:05.611 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:05.614 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:05.615 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:05.616 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:05.616 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:06.390 INFO:teuthology.orchestra.run.smithi177.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:06.398 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/189 2023-11-27T18:50:06.398 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/189 2023-11-27T18:50:06.398 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:06.402 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:06.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:06.538 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-11-27T18:50:06.751 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:06.755 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:06.755 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:06.756 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:06.756 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:07.665 INFO:teuthology.orchestra.run.smithi177.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:07.671 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/190 2023-11-27T18:50:07.672 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/190 2023-11-27T18:50:07.672 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:07.675 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:07.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:07.730 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-11-27T18:50:07.950 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:07.954 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:07.955 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:07.956 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:07.956 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:08.736 INFO:teuthology.orchestra.run.smithi177.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:08.748 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/191 2023-11-27T18:50:08.748 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/191 2023-11-27T18:50:08.748 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:08.751 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:08.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:08.833 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-11-27T18:50:09.078 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:09.082 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:09.083 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:09.084 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:09.084 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:09.417 INFO:teuthology.orchestra.run.smithi177.stdout:generic/192 [not run] atime not maintained by ceph 2023-11-27T18:50:09.421 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/192 2023-11-27T18:50:09.421 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/192 2023-11-27T18:50:09.422 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:09.423 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:09.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:09.441 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-11-27T18:50:09.644 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:09.647 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:09.648 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:09.649 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:09.649 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:10.550 INFO:teuthology.orchestra.run.smithi177.stdout:generic/193 1s 2023-11-27T18:50:10.581 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/193 2023-11-27T18:50:10.581 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:10.583 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:10.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:10.963 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-11-27T18:50:11.194 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:11.198 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:11.198 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:11.199 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:11.199 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:11.942 INFO:teuthology.orchestra.run.smithi177.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:11.948 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/194 2023-11-27T18:50:11.948 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/194 2023-11-27T18:50:11.949 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:11.952 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:12.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:12.093 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-11-27T18:50:12.332 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:12.336 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:12.336 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:12.337 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:12.337 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:13.162 INFO:teuthology.orchestra.run.smithi177.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/195 2023-11-27T18:50:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/195 2023-11-27T18:50:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:13.238 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:13.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:13.272 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-11-27T18:50:13.488 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:13.492 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:13.492 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:13.493 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:13.493 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:14.377 INFO:teuthology.orchestra.run.smithi177.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/196 2023-11-27T18:50:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/196 2023-11-27T18:50:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:14.409 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:14.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:14.447 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-11-27T18:50:14.655 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:14.659 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:14.659 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:14.660 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:15.453 INFO:teuthology.orchestra.run.smithi177.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:15.483 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/197 2023-11-27T18:50:15.483 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/197 2023-11-27T18:50:15.483 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:15.522 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:15.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:15.587 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-11-27T18:50:15.789 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:15.792 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:15.793 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:15.794 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:15.794 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:16.649 INFO:teuthology.orchestra.run.smithi177.stdout:generic/198 1s 2023-11-27T18:50:16.654 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/198 2023-11-27T18:50:16.654 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:16.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:16.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:16.868 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-11-27T18:50:17.381 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:17.385 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:17.386 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:17.387 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:17.387 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:18.195 INFO:teuthology.orchestra.run.smithi177.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:18.201 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/199 2023-11-27T18:50:18.201 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/199 2023-11-27T18:50:18.201 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:18.217 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:18.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:18.314 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-11-27T18:50:18.516 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:18.520 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:18.520 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:18.521 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:18.521 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:19.277 INFO:teuthology.orchestra.run.smithi177.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:19.338 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/200 2023-11-27T18:50:19.338 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/200 2023-11-27T18:50:19.339 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:19.354 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:19.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:19.491 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-11-27T18:50:19.718 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:19.722 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:19.722 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:19.723 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:19.724 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:20.553 INFO:teuthology.orchestra.run.smithi177.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:20.566 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/201 2023-11-27T18:50:20.566 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/201 2023-11-27T18:50:20.566 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:20.570 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:20.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:20.642 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-11-27T18:50:20.867 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:20.871 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:20.871 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:20.872 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:20.873 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:21.542 INFO:teuthology.orchestra.run.smithi177.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:21.705 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/202 2023-11-27T18:50:21.706 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/202 2023-11-27T18:50:21.706 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:21.715 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:21.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:21.794 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-11-27T18:50:22.021 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:22.025 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:22.025 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:22.026 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:22.026 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:22.828 INFO:teuthology.orchestra.run.smithi177.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:22.872 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/203 2023-11-27T18:50:22.873 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/203 2023-11-27T18:50:22.874 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:22.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:22.967 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-11-27T18:50:23.184 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:23.188 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:23.188 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:23.189 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:23.189 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:24.273 INFO:teuthology.orchestra.run.smithi177.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:50:24.277 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/204 2023-11-27T18:50:24.277 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/204 2023-11-27T18:50:24.277 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:24.279 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:24.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:24.307 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-11-27T18:50:24.507 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:24.511 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:24.512 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:24.512 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:24.513 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:25.369 INFO:teuthology.orchestra.run.smithi177.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:25.375 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/205 2023-11-27T18:50:25.375 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/205 2023-11-27T18:50:25.375 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:25.390 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:25.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:25.452 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-11-27T18:50:25.673 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:25.677 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:25.677 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:25.678 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:25.678 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:26.452 INFO:teuthology.orchestra.run.smithi177.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:26.547 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/206 2023-11-27T18:50:26.547 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/206 2023-11-27T18:50:26.547 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:26.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:26.588 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-11-27T18:50:26.793 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:26.797 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:26.798 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:26.798 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:26.798 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:34.018 INFO:teuthology.orchestra.run.smithi177.stdout:generic/207 7s 2023-11-27T18:50:34.023 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/207 2023-11-27T18:50:34.023 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:50:34.025 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:50:34.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:50:34.310 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-11-27T18:50:34.637 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:50:34.640 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:50:34.641 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:50:34.642 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:50:34.642 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:51:06.333 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:06.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:36.422 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:36.425 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:06.569 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:06.575 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:36.648 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:36.652 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:06.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:06.754 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:36.890 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:36.892 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:55.181 INFO:teuthology.orchestra.run.smithi177.stdout:generic/208 201s 2023-11-27T18:53:55.185 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/208 2023-11-27T18:53:55.186 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:53:55.187 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:53:55.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:53:55.490 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-11-27T18:53:55.784 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:53:55.788 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:53:55.788 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:53:55.789 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:53:55.790 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:07.002 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:07.005 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:31.554 INFO:teuthology.orchestra.run.smithi177.stdout:generic/209 36s 2023-11-27T18:54:31.557 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/209 2023-11-27T18:54:31.558 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:31.560 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:31.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:31.847 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-11-27T18:54:32.144 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:32.148 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:32.149 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:32.149 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:32.150 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:32.580 INFO:teuthology.orchestra.run.smithi177.stdout:generic/210 0s 2023-11-27T18:54:32.585 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/210 2023-11-27T18:54:32.585 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:32.587 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:32.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:32.835 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-11-27T18:54:33.173 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:33.177 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:33.178 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:33.179 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:33.179 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:33.662 INFO:teuthology.orchestra.run.smithi177.stdout:generic/211 0s 2023-11-27T18:54:33.666 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/211 2023-11-27T18:54:33.666 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:33.668 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:33.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:33.701 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-11-27T18:54:33.916 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:33.921 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:33.921 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:33.922 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:33.922 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:34.355 INFO:teuthology.orchestra.run.smithi177.stdout:generic/212 0s 2023-11-27T18:54:34.360 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/212 2023-11-27T18:54:34.360 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:34.362 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:34.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:34.392 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-11-27T18:54:34.595 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:34.599 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:34.599 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:34.600 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:34.601 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:34.937 INFO:teuthology.orchestra.run.smithi177.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:54:34.941 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/213 2023-11-27T18:54:34.941 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/213 2023-11-27T18:54:34.941 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:34.943 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:34.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:34.969 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-11-27T18:54:35.186 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:35.190 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:35.190 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:35.191 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:35.191 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:35.532 INFO:teuthology.orchestra.run.smithi177.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:54:35.536 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/214 2023-11-27T18:54:35.536 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/214 2023-11-27T18:54:35.536 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:35.538 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:35.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:35.561 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-11-27T18:54:35.762 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:35.766 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:35.766 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:35.767 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:35.767 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:37.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:37.141 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:38.182 INFO:teuthology.orchestra.run.smithi177.stdout:generic/215 3s 2023-11-27T18:54:38.187 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/215 2023-11-27T18:54:38.187 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:38.189 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:38.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:38.240 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-11-27T18:54:38.450 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:40.198 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:54:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/216 2023-11-27T18:54:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/216 2023-11-27T18:54:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:40.199 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:40.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:40.199 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-11-27T18:54:40.408 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:40.412 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:40.412 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:40.413 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:40.413 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:41.230 INFO:teuthology.orchestra.run.smithi177.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:54:41.292 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/217 2023-11-27T18:54:41.293 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/217 2023-11-27T18:54:41.293 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:41.359 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:41.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:41.387 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-11-27T18:54:41.588 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:41.592 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:41.592 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:41.593 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:41.593 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:42.333 INFO:teuthology.orchestra.run.smithi177.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:54:42.339 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/218 2023-11-27T18:54:42.339 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/218 2023-11-27T18:54:42.339 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:42.342 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:42.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:42.529 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-11-27T18:54:42.735 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:42.739 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:42.739 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:42.740 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:42.740 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:43.060 INFO:teuthology.orchestra.run.smithi177.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:54:43.064 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/219 2023-11-27T18:54:43.064 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/219 2023-11-27T18:54:43.065 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:43.066 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:43.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:43.092 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-11-27T18:54:43.299 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:43.303 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:43.303 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:43.304 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:43.305 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:44.128 INFO:teuthology.orchestra.run.smithi177.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:54:44.153 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/220 2023-11-27T18:54:44.154 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/220 2023-11-27T18:54:44.154 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:44.158 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:44.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:44.211 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-11-27T18:54:44.432 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:44.436 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:44.437 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:44.438 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:44.438 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:45.784 INFO:teuthology.orchestra.run.smithi177.stdout:generic/221 1s 2023-11-27T18:54:45.790 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/221 2023-11-27T18:54:45.790 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:45.792 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:45.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:45.836 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-11-27T18:54:46.062 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:46.066 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:46.066 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:46.067 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:46.067 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:46.888 INFO:teuthology.orchestra.run.smithi177.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:54:46.918 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/222 2023-11-27T18:54:46.918 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/222 2023-11-27T18:54:46.918 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:46.928 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:46.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:46.991 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-11-27T18:54:47.196 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:47.200 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:47.200 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:47.202 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:47.202 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:47.543 INFO:teuthology.orchestra.run.smithi177.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:54:47.547 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/223 2023-11-27T18:54:47.547 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/223 2023-11-27T18:54:47.547 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:47.549 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:47.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:47.578 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-11-27T18:54:47.781 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:47.785 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:47.785 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:47.787 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:47.787 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:48.099 INFO:teuthology.orchestra.run.smithi177.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:54:48.103 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/224 2023-11-27T18:54:48.103 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/224 2023-11-27T18:54:48.104 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:48.105 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:48.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:48.131 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-11-27T18:54:48.346 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:48.350 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:48.350 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:48.351 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:48.351 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:48.732 INFO:teuthology.orchestra.run.smithi177.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T18:54:48.736 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/225 2023-11-27T18:54:48.736 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/225 2023-11-27T18:54:48.736 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:48.738 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:48.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:48.938 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-11-27T18:54:49.327 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:49.331 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:49.332 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:49.333 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:49.333 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:49.702 INFO:teuthology.orchestra.run.smithi177.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:54:49.706 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/226 2023-11-27T18:54:49.706 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/226 2023-11-27T18:54:49.706 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:49.708 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:49.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:49.741 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-11-27T18:54:49.944 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:49.947 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:49.947 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:49.948 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:49.949 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:50.779 INFO:teuthology.orchestra.run.smithi177.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:54:50.802 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/227 2023-11-27T18:54:50.802 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/227 2023-11-27T18:54:50.802 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:50.804 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:50.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:50.843 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-11-27T18:54:51.044 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:51.048 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:51.048 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:51.049 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:51.400 INFO:teuthology.orchestra.run.smithi177.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:54:51.404 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/228 2023-11-27T18:54:51.404 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/228 2023-11-27T18:54:51.404 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:51.406 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:51.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:51.430 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-11-27T18:54:51.634 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:51.638 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:51.638 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:51.639 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:51.639 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:52.434 INFO:teuthology.orchestra.run.smithi177.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:54:52.444 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/229 2023-11-27T18:54:52.444 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/229 2023-11-27T18:54:52.444 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:52.452 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:52.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:52.552 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-11-27T18:54:52.761 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:52.765 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:52.766 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:52.767 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:52.767 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:53.099 INFO:teuthology.orchestra.run.smithi177.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:54:53.103 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/230 2023-11-27T18:54:53.103 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/230 2023-11-27T18:54:53.104 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:53.105 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:53.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:53.135 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-11-27T18:54:53.360 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:53.364 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:53.364 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:53.365 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:53.365 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:53.682 INFO:teuthology.orchestra.run.smithi177.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:54:53.686 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/231 2023-11-27T18:54:53.686 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/231 2023-11-27T18:54:53.686 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:53.688 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:53.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:53.715 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-11-27T18:54:53.920 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:53.924 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:53.926 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:54.250 INFO:teuthology.orchestra.run.smithi177.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:54:54.253 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/232 2023-11-27T18:54:54.254 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/232 2023-11-27T18:54:54.254 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:54.255 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:54.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:54.278 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-11-27T18:54:54.497 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:54.501 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:54.501 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:54.502 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:54.502 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:54.822 INFO:teuthology.orchestra.run.smithi177.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:54:54.826 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/233 2023-11-27T18:54:54.826 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/233 2023-11-27T18:54:54.826 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:54.828 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:54.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:54.853 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-11-27T18:54:55.054 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:55.057 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:55.058 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:55.059 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:55.059 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:55.392 INFO:teuthology.orchestra.run.smithi177.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:54:55.396 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/234 2023-11-27T18:54:55.397 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/234 2023-11-27T18:54:55.397 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:55.399 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:55.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:55.418 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-11-27T18:54:55.622 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:55.626 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:55.627 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:55.628 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:55.628 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:55.959 INFO:teuthology.orchestra.run.smithi177.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:54:55.963 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/235 2023-11-27T18:54:55.963 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/235 2023-11-27T18:54:55.964 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:55.966 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:55.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:55.989 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-11-27T18:54:56.197 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:56.201 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:56.202 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:56.203 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:56.203 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:57.597 INFO:teuthology.orchestra.run.smithi177.stdout:generic/236 1s 2023-11-27T18:54:57.602 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/236 2023-11-27T18:54:57.603 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:57.604 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:57.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:57.946 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-11-27T18:54:58.207 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:58.211 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:58.212 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:58.213 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:58.213 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:58.638 INFO:teuthology.orchestra.run.smithi177.stdout:generic/237 0s 2023-11-27T18:54:58.643 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/237 2023-11-27T18:54:58.643 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:54:58.644 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:54:58.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:54:58.747 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-11-27T18:54:59.224 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:54:59.229 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:54:59.229 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:54:59.230 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:54:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:55:00.057 INFO:teuthology.orchestra.run.smithi177.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:55:00.067 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/238 2023-11-27T18:55:00.067 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/238 2023-11-27T18:55:00.067 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:55:00.081 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:55:00.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:55:00.164 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-11-27T18:55:00.378 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:55:00.382 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:55:00.382 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:55:00.383 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:55:00.383 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:55:07.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:07.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:37.410 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:37.414 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:07.588 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:09.571 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:40.025 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:40.027 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:58.237 INFO:teuthology.orchestra.run.smithi177.stdout:generic/239 118s 2023-11-27T18:56:58.242 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/239 2023-11-27T18:56:58.242 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:56:58.244 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:56:58.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:56:58.435 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-11-27T18:56:58.836 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:56:58.840 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:56:58.840 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:56:58.841 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:56:58.841 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:56:59.547 INFO:teuthology.orchestra.run.smithi177.stdout:generic/240 0s 2023-11-27T18:56:59.552 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/240 2023-11-27T18:56:59.552 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:56:59.554 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:56:59.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:56:59.882 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-11-27T18:57:00.137 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:57:00.141 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:57:00.141 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:57:00.142 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:57:00.142 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:57:10.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:10.359 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:40.613 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:40.622 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:40.790 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T18:57:40.787+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 363574) UID: 0 2023-11-27T18:57:40.790 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T18:57:40.787+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 363574) UID: 0 2023-11-27T18:58:15.632 INFO:teuthology.orchestra.run.smithi177.stdout:generic/241 75s 2023-11-27T18:58:15.741 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/241 2023-11-27T18:58:15.741 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:15.742 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:16.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:16.209 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-11-27T18:58:16.961 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:17.000 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:17.006 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:17.008 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:17.009 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:18.499 INFO:teuthology.orchestra.run.smithi177.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:58:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/242 2023-11-27T18:58:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/242 2023-11-27T18:58:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:18.509 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:18.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:18.644 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-11-27T18:58:19.751 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:19.757 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:19.757 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:19.757 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:19.757 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:20.752 INFO:teuthology.orchestra.run.smithi177.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:58:20.919 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/243 2023-11-27T18:58:20.920 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/243 2023-11-27T18:58:20.920 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:20.923 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:20.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:20.965 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-11-27T18:58:21.180 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:21.184 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:21.184 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:21.185 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:21.186 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:21.497 INFO:teuthology.orchestra.run.smithi177.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:58:21.501 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/244 2023-11-27T18:58:21.501 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/244 2023-11-27T18:58:21.501 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:21.503 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:21.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:21.528 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-11-27T18:58:21.730 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:21.734 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:21.734 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:21.735 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:21.735 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:22.135 INFO:teuthology.orchestra.run.smithi177.stdout:generic/245 1s 2023-11-27T18:58:22.235 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/245 2023-11-27T18:58:22.235 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:22.237 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:22.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:22.460 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-11-27T18:58:22.878 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:22.882 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:22.883 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:22.884 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:23.280 INFO:teuthology.orchestra.run.smithi177.stdout:generic/246 0s 2023-11-27T18:58:23.287 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/246 2023-11-27T18:58:23.287 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:23.289 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:23.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:23.570 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-11-27T18:58:23.941 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:23.945 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:23.945 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:23.946 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:23.946 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:33.129 INFO:teuthology.orchestra.run.smithi177.stdout:generic/247 9s 2023-11-27T18:58:33.143 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/247 2023-11-27T18:58:33.143 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:33.145 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:33.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:33.154 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-11-27T18:58:33.391 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:33.395 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:33.397 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:33.397 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:33.397 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:33.746 INFO:teuthology.orchestra.run.smithi177.stdout:generic/248 0s 2023-11-27T18:58:33.753 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/248 2023-11-27T18:58:33.753 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:33.755 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:33.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:33.790 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-11-27T18:58:33.992 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:33.996 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:33.997 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:33.998 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:33.998 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:34.573 INFO:teuthology.orchestra.run.smithi177.stdout:generic/249 0s 2023-11-27T18:58:34.578 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/249 2023-11-27T18:58:34.578 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:34.580 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:34.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:34.892 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-11-27T18:58:35.258 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:35.262 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:35.262 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:35.263 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:35.263 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:35.721 INFO:teuthology.orchestra.run.smithi177.stdout:generic/250 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:58:35.725 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/250 2023-11-27T18:58:35.725 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/250 2023-11-27T18:58:35.725 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:35.727 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:35.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:35.756 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-11-27T18:58:35.974 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:35.978 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:35.978 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:35.979 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:36.496 INFO:teuthology.orchestra.run.smithi177.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:36.516 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/251 2023-11-27T18:58:36.517 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/251 2023-11-27T18:58:36.517 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:36.518 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:36.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:36.538 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-11-27T18:58:36.754 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:36.758 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:36.758 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:36.759 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:36.759 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:37.095 INFO:teuthology.orchestra.run.smithi177.stdout:generic/252 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T18:58:37.099 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/252 2023-11-27T18:58:37.099 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/252 2023-11-27T18:58:37.099 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:37.101 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:37.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:37.130 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-11-27T18:58:37.337 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:37.341 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:37.342 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:37.343 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:37.343 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:38.103 INFO:teuthology.orchestra.run.smithi177.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:58:38.152 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/253 2023-11-27T18:58:38.152 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/253 2023-11-27T18:58:38.153 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:38.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:38.222 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-11-27T18:58:38.506 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:38.510 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:38.510 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:38.511 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:38.511 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:39.251 INFO:teuthology.orchestra.run.smithi177.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:58:39.432 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/254 2023-11-27T18:58:39.432 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/254 2023-11-27T18:58:39.432 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:39.433 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:39.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:39.477 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-11-27T18:58:39.685 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:39.689 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:39.690 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:39.691 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:39.691 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:40.250 INFO:teuthology.orchestra.run.smithi177.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:58:40.254 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/255 2023-11-27T18:58:40.254 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/255 2023-11-27T18:58:40.254 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:40.256 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:40.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:40.471 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-11-27T18:58:40.905 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:40.909 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:40.910 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:40.911 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:40.911 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:42.201 INFO:teuthology.orchestra.run.smithi177.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:58:42.205 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/256 2023-11-27T18:58:42.205 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/256 2023-11-27T18:58:42.205 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:42.207 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:42.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:42.240 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-11-27T18:58:42.459 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:42.463 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:42.463 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:42.464 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:42.464 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:43.351 INFO:teuthology.orchestra.run.smithi177.stdout:generic/257 1s 2023-11-27T18:58:43.356 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/257 2023-11-27T18:58:43.356 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:43.358 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:43.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:43.765 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-11-27T18:58:44.085 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:44.089 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:44.089 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:44.090 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:44.090 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:44.555 INFO:teuthology.orchestra.run.smithi177.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-11-27T18:58:44.559 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/258 2023-11-27T18:58:44.559 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/258 2023-11-27T18:58:44.559 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:44.561 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:44.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:44.584 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-11-27T18:58:44.777 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:44.781 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:44.781 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:44.782 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:44.782 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:45.621 INFO:teuthology.orchestra.run.smithi177.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:58:45.682 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/259 2023-11-27T18:58:45.682 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/259 2023-11-27T18:58:45.682 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:45.745 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:45.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:45.823 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-11-27T18:58:46.069 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:46.073 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:46.073 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:46.075 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:46.075 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:46.551 INFO:teuthology.orchestra.run.smithi177.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:46.563 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/260 2023-11-27T18:58:46.563 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/260 2023-11-27T18:58:46.563 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:46.565 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:46.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:46.588 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-11-27T18:58:46.781 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:46.784 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:46.785 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:46.786 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:46.786 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:47.472 INFO:teuthology.orchestra.run.smithi177.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:58:47.478 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/261 2023-11-27T18:58:47.478 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/261 2023-11-27T18:58:47.479 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:47.482 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:47.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:47.672 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-11-27T18:58:47.913 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:47.917 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:47.918 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:47.919 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:47.919 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:48.592 INFO:teuthology.orchestra.run.smithi177.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:58:48.770 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/262 2023-11-27T18:58:48.771 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/262 2023-11-27T18:58:48.771 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:58:48.780 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:58:48.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:58:48.824 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-11-27T18:58:49.033 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:58:49.037 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:58:49.038 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:58:49.039 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:58:49.039 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:30.901 INFO:teuthology.orchestra.run.smithi177.stdout:generic/263 41s 2023-11-27T18:59:30.906 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/263 2023-11-27T18:59:30.906 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:30.908 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:31.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:31.193 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-11-27T18:59:31.547 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:31.550 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:31.550 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:31.551 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:31.551 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:32.279 INFO:teuthology.orchestra.run.smithi177.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:32.434 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/264 2023-11-27T18:59:32.434 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/264 2023-11-27T18:59:32.434 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:32.438 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:32.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:32.506 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-11-27T18:59:32.722 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:32.726 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:32.726 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:32.727 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:32.727 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:33.711 INFO:teuthology.orchestra.run.smithi177.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:33.736 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/265 2023-11-27T18:59:33.736 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/265 2023-11-27T18:59:33.736 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:33.743 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:33.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:33.782 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-11-27T18:59:33.999 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:34.003 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:34.004 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:34.005 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:34.005 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:34.861 INFO:teuthology.orchestra.run.smithi177.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:34.901 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/266 2023-11-27T18:59:34.902 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/266 2023-11-27T18:59:34.902 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:34.904 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:34.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:34.938 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-11-27T18:59:35.172 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:35.176 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:35.176 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:35.177 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:35.177 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:36.051 INFO:teuthology.orchestra.run.smithi177.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:36.087 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/267 2023-11-27T18:59:36.087 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/267 2023-11-27T18:59:36.087 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:36.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:36.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:36.168 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-11-27T18:59:36.388 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:36.391 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:36.392 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:36.393 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:36.393 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:37.323 INFO:teuthology.orchestra.run.smithi177.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:37.328 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/268 2023-11-27T18:59:37.328 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/268 2023-11-27T18:59:37.328 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:37.348 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:37.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:37.376 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-11-27T18:59:37.598 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:37.602 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:37.603 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:37.604 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:37.604 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:37.923 INFO:teuthology.orchestra.run.smithi177.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:59:37.927 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/269 2023-11-27T18:59:37.927 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/269 2023-11-27T18:59:37.927 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:37.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:37.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:37.956 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-11-27T18:59:38.175 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:38.179 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:38.180 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:38.181 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:38.181 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:38.507 INFO:teuthology.orchestra.run.smithi177.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:59:40.889 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/270 2023-11-27T18:59:40.889 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/270 2023-11-27T18:59:40.889 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:40.889 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:40.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:40.889 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-11-27T18:59:41.159 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:41.162 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:41.163 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:41.164 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:41.164 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:42.080 INFO:teuthology.orchestra.run.smithi177.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:42.088 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/271 2023-11-27T18:59:42.088 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/271 2023-11-27T18:59:42.089 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:42.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:42.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:42.135 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-11-27T18:59:42.375 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:42.378 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:42.379 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:42.380 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:42.380 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:43.193 INFO:teuthology.orchestra.run.smithi177.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:43.225 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/272 2023-11-27T18:59:43.225 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/272 2023-11-27T18:59:43.225 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:43.228 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:43.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:43.313 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-11-27T18:59:43.533 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:43.537 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:43.538 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:43.538 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:43.539 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:43.872 INFO:teuthology.orchestra.run.smithi177.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:59:43.876 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/273 2023-11-27T18:59:43.876 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/273 2023-11-27T18:59:43.876 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:43.878 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:43.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:43.902 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-11-27T18:59:44.111 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:44.115 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:44.115 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:44.116 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:44.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:44.449 INFO:teuthology.orchestra.run.smithi177.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T18:59:44.453 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/274 2023-11-27T18:59:44.453 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/274 2023-11-27T18:59:44.453 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:44.455 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:44.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:44.482 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-11-27T18:59:44.694 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:45.029 INFO:teuthology.orchestra.run.smithi177.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:59:45.033 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/275 2023-11-27T18:59:45.033 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/275 2023-11-27T18:59:45.033 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:45.035 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:45.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:45.055 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-11-27T18:59:45.264 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:45.267 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:45.268 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:45.269 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:45.269 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:46.165 INFO:teuthology.orchestra.run.smithi177.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:46.174 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/276 2023-11-27T18:59:46.174 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/276 2023-11-27T18:59:46.174 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:46.182 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:46.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:46.232 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-11-27T18:59:46.460 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:46.464 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:46.464 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:46.465 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:46.465 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:46.846 INFO:teuthology.orchestra.run.smithi177.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-11-27T18:59:46.850 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/277 2023-11-27T18:59:46.850 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/277 2023-11-27T18:59:46.851 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:46.852 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:46.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:46.879 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-11-27T18:59:47.099 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:47.103 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:47.103 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:47.104 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:47.105 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:47.968 INFO:teuthology.orchestra.run.smithi177.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:47.975 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/278 2023-11-27T18:59:47.975 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/278 2023-11-27T18:59:47.975 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:48.016 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:48.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:48.081 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-11-27T18:59:48.298 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:48.301 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:48.302 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:48.303 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:48.303 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:49.171 INFO:teuthology.orchestra.run.smithi177.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:49.207 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/279 2023-11-27T18:59:49.207 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/279 2023-11-27T18:59:49.207 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:49.213 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:49.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:49.259 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-11-27T18:59:49.476 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:49.480 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:49.481 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:49.482 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:49.482 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:49.837 INFO:teuthology.orchestra.run.smithi177.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:59:49.841 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/280 2023-11-27T18:59:49.841 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/280 2023-11-27T18:59:49.841 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:49.843 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:49.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:49.867 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-11-27T18:59:50.084 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:50.088 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:50.089 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:50.089 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:50.090 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:50.817 INFO:teuthology.orchestra.run.smithi177.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:50.943 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/281 2023-11-27T18:59:50.943 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/281 2023-11-27T18:59:50.943 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:51.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:51.034 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-11-27T18:59:51.263 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:51.267 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:51.268 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:51.269 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:51.269 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:52.116 INFO:teuthology.orchestra.run.smithi177.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:52.208 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/282 2023-11-27T18:59:52.209 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/282 2023-11-27T18:59:52.209 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:52.219 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:52.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:52.253 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-11-27T18:59:52.472 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:52.475 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:52.476 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:52.477 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:52.477 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:53.354 INFO:teuthology.orchestra.run.smithi177.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:53.378 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/283 2023-11-27T18:59:53.378 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/283 2023-11-27T18:59:53.378 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:53.419 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:53.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:53.453 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-11-27T18:59:53.685 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:53.689 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:53.689 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:53.690 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:53.690 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:54.523 INFO:teuthology.orchestra.run.smithi177.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:54.618 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/284 2023-11-27T18:59:54.618 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/284 2023-11-27T18:59:54.618 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:54.632 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:54.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:54.675 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-11-27T18:59:54.900 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:54.903 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:54.904 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:54.905 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:54.905 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:56.473 INFO:teuthology.orchestra.run.smithi177.stdout:generic/285 1s 2023-11-27T18:59:56.477 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/285 2023-11-27T18:59:56.477 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:56.479 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:57.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:57.153 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-11-27T18:59:57.575 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:57.582 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:57.582 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:57.583 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:57.583 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:58.145 INFO:teuthology.orchestra.run.smithi177.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:59:58.154 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/286 2023-11-27T18:59:58.154 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/286 2023-11-27T18:59:58.154 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:58.162 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:58.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:58.205 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-11-27T18:59:58.640 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T18:59:58.649 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T18:59:58.650 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T18:59:58.657 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T18:59:58.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:59.716 INFO:teuthology.orchestra.run.smithi177.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:59.836 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/287 2023-11-27T18:59:59.836 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/287 2023-11-27T18:59:59.837 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T18:59:59.900 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T18:59:59.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T18:59:59.975 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-11-27T19:00:00.478 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:00.482 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:00.482 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:00.484 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:00.484 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:01.255 INFO:teuthology.orchestra.run.smithi177.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:01.284 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/288 2023-11-27T19:00:01.284 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/288 2023-11-27T19:00:01.284 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:01.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:01.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:01.324 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-11-27T19:00:01.782 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:01.788 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:01.788 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:01.790 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:01.790 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:03.063 INFO:teuthology.orchestra.run.smithi177.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:03.084 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/289 2023-11-27T19:00:03.084 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/289 2023-11-27T19:00:03.084 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:03.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:03.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:03.141 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-11-27T19:00:03.459 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:03.463 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:03.463 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:03.464 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:03.464 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:04.312 INFO:teuthology.orchestra.run.smithi177.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:04.320 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/290 2023-11-27T19:00:04.321 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/290 2023-11-27T19:00:04.321 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:04.324 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:04.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:04.434 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-11-27T19:00:04.651 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:04.654 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:04.655 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:04.656 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:04.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:05.531 INFO:teuthology.orchestra.run.smithi177.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:05.588 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/291 2023-11-27T19:00:05.588 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/291 2023-11-27T19:00:05.589 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:05.601 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:05.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:05.639 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-11-27T19:00:05.855 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:05.858 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:05.859 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:05.860 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:05.860 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:06.586 INFO:teuthology.orchestra.run.smithi177.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:06.593 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/292 2023-11-27T19:00:06.593 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/292 2023-11-27T19:00:06.593 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:06.597 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:06.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:06.741 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-11-27T19:00:07.009 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:07.013 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:07.014 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:07.015 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:07.015 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:07.869 INFO:teuthology.orchestra.run.smithi177.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:07.880 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/293 2023-11-27T19:00:07.880 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/293 2023-11-27T19:00:07.880 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:07.896 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:07.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:07.982 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-11-27T19:00:08.208 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:08.212 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:08.213 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:08.214 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:08.214 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:09.202 INFO:teuthology.orchestra.run.smithi177.stdout:generic/294 1s 2023-11-27T19:00:09.211 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/294 2023-11-27T19:00:09.212 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:09.214 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:09.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:09.223 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-11-27T19:00:09.461 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:09.465 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:09.466 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:09.467 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:09.467 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:10.284 INFO:teuthology.orchestra.run.smithi177.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:10.394 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/295 2023-11-27T19:00:10.395 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/295 2023-11-27T19:00:10.395 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:10.409 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:10.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:10.449 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-11-27T19:00:10.653 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:10.657 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:10.657 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:10.658 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:10.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:11.546 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/296 2023-11-27T19:00:11.546 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/296 2023-11-27T19:00:11.546 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:11.601 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:11.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:11.639 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-11-27T19:00:11.868 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:11.872 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:11.873 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:11.874 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:11.874 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:12.832 INFO:teuthology.orchestra.run.smithi177.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:12.840 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/297 2023-11-27T19:00:12.840 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/297 2023-11-27T19:00:12.840 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:12.842 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:12.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:12.870 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-11-27T19:00:13.090 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:13.094 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:13.094 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:13.095 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:13.096 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:14.002 INFO:teuthology.orchestra.run.smithi177.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:14.047 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/298 2023-11-27T19:00:14.047 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/298 2023-11-27T19:00:14.047 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:14.049 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:14.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:14.091 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-11-27T19:00:14.321 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:14.325 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:14.326 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:14.327 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:14.327 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:14.725 INFO:teuthology.orchestra.run.smithi177.stdout:generic/299 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:00:14.729 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/299 2023-11-27T19:00:14.729 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/299 2023-11-27T19:00:14.729 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:14.731 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:14.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:14.761 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-11-27T19:00:14.964 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:14.968 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:14.969 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:14.970 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:14.970 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:15.355 INFO:teuthology.orchestra.run.smithi177.stdout:generic/300 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:00:15.359 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/300 2023-11-27T19:00:15.359 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/300 2023-11-27T19:00:15.359 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:15.361 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:15.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:15.394 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-11-27T19:00:15.600 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:15.604 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:15.605 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:15.606 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:15.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:16.291 INFO:teuthology.orchestra.run.smithi177.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:16.310 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/301 2023-11-27T19:00:16.310 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/301 2023-11-27T19:00:16.310 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:16.406 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:16.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:16.551 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-11-27T19:00:16.784 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:16.787 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:16.788 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:16.789 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:16.789 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:17.625 INFO:teuthology.orchestra.run.smithi177.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:22.577 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/302 2023-11-27T19:00:22.577 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/302 2023-11-27T19:00:22.577 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:22.577 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:22.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:22.577 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-11-27T19:00:22.812 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:22.816 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:22.817 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:22.818 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:22.818 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:23.380 INFO:teuthology.orchestra.run.smithi177.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T19:00:23.384 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/303 2023-11-27T19:00:23.384 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/303 2023-11-27T19:00:23.384 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:23.386 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:23.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:23.761 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-11-27T19:00:24.063 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:24.066 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:24.067 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:24.068 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:24.068 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:24.474 INFO:teuthology.orchestra.run.smithi177.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T19:00:24.478 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/304 2023-11-27T19:00:24.478 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/304 2023-11-27T19:00:24.478 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:24.480 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:24.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:24.871 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-11-27T19:00:25.110 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:25.113 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:25.114 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:25.115 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:25.115 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:25.784 INFO:teuthology.orchestra.run.smithi177.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:00:25.908 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/305 2023-11-27T19:00:25.908 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/305 2023-11-27T19:00:25.908 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:25.949 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:26.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:26.003 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-11-27T19:00:26.231 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:26.235 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:26.235 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:26.236 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:26.237 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:27.176 INFO:teuthology.orchestra.run.smithi177.stdout:generic/306 1s 2023-11-27T19:00:27.189 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/306 2023-11-27T19:00:27.189 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:27.192 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:27.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:27.420 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-11-27T19:00:27.860 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:27.864 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:27.865 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:27.866 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:27.866 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:29.657 INFO:teuthology.orchestra.run.smithi177.stdout:generic/307 1s 2023-11-27T19:00:29.662 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/307 2023-11-27T19:00:29.662 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:29.665 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:29.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:29.673 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-11-27T19:00:29.889 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:29.893 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:29.894 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:29.895 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:29.895 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:30.260 INFO:teuthology.orchestra.run.smithi177.stdout:generic/308 0s 2023-11-27T19:00:30.264 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/308 2023-11-27T19:00:30.264 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:30.266 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:30.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:30.295 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-11-27T19:00:30.508 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:30.512 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:30.512 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:30.513 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:30.513 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:31.917 INFO:teuthology.orchestra.run.smithi177.stdout:generic/309 1s 2023-11-27T19:00:31.922 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/309 2023-11-27T19:00:31.922 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:00:31.925 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:32.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:00:32.238 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-11-27T19:00:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:00:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:00:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:00:32.538 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:00:32.539 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:00:54.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:00:54.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:24.403 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:24.405 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:48.334 INFO:teuthology.orchestra.run.smithi177.stdout:generic/310 76s 2023-11-27T19:01:48.338 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/310 2023-11-27T19:01:48.338 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:01:48.340 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:48.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:01:48.738 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-11-27T19:01:49.277 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:01:49.281 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:01:49.281 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:01:49.282 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:01:49.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:49.694 INFO:teuthology.orchestra.run.smithi177.stdout:generic/311 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:01:49.698 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/311 2023-11-27T19:01:49.698 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/311 2023-11-27T19:01:49.698 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:01:49.700 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:49.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:01:49.736 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-11-27T19:01:49.947 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:01:49.951 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:01:49.952 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:01:49.953 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:01:49.953 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:50.296 INFO:teuthology.orchestra.run.smithi177.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:01:50.300 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/312 2023-11-27T19:01:50.300 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/312 2023-11-27T19:01:50.300 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:01:50.302 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:50.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:01:50.336 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-11-27T19:01:50.542 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:01:50.546 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:01:50.546 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:01:50.548 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:01:50.548 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:54.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:54.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:54.939 INFO:teuthology.orchestra.run.smithi177.stdout:generic/313 4s 2023-11-27T19:01:54.944 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/313 2023-11-27T19:01:54.944 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:01:54.947 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:54.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:01:54.985 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-11-27T19:01:55.212 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:01:55.216 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:01:55.217 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:01:55.218 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:01:55.218 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:55.811 INFO:teuthology.orchestra.run.smithi177.stdout:generic/314 0s 2023-11-27T19:01:55.816 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/314 2023-11-27T19:01:55.816 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:01:55.818 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:55.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:01:55.862 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-11-27T19:01:56.083 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:01:56.086 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:01:56.087 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:01:56.088 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:01:56.088 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:56.430 INFO:teuthology.orchestra.run.smithi177.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T19:01:56.434 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/315 2023-11-27T19:01:56.434 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/315 2023-11-27T19:01:56.434 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:01:56.437 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:56.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:01:56.475 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-11-27T19:01:56.691 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:01:56.696 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:01:56.696 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:01:56.697 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:01:56.697 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:57.173 INFO:teuthology.orchestra.run.smithi177.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T19:01:57.177 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/316 2023-11-27T19:01:57.177 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/316 2023-11-27T19:01:57.178 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:01:57.179 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:01:57.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:01:57.482 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-11-27T19:01:57.809 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:01:57.813 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:01:57.814 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:01:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:01:57.815 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:01.487 INFO:teuthology.orchestra.run.smithi177.stdout:generic/317 3s 2023-11-27T19:02:01.492 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/317 2023-11-27T19:02:01.492 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:02:01.494 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:01.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:02:01.503 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-11-27T19:02:01.721 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:02:01.725 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:02:01.725 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:02:01.726 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:02:01.727 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:02.613 INFO:teuthology.orchestra.run.smithi177.stdout:generic/318 1s 2023-11-27T19:02:02.618 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/318 2023-11-27T19:02:02.618 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:02:02.620 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:02.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:02:02.628 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-11-27T19:02:02.843 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:02:02.847 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:02:02.848 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:02:02.849 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:02:02.849 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:03.456 INFO:teuthology.orchestra.run.smithi177.stdout:generic/319 0s 2023-11-27T19:02:03.460 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/319 2023-11-27T19:02:03.461 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:02:03.462 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:03.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:02:03.471 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-11-27T19:02:03.676 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:02:03.680 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:02:03.681 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:02:03.682 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:02:03.682 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:04.032 INFO:teuthology.orchestra.run.smithi177.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T19:02:04.036 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/320 2023-11-27T19:02:04.036 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/320 2023-11-27T19:02:04.036 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:02:04.038 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:04.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:02:04.060 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-11-27T19:02:04.278 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:02:04.281 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:02:04.281 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:02:04.282 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:02:04.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:04.626 INFO:teuthology.orchestra.run.smithi177.stdout:generic/321 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:02:04.630 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/321 2023-11-27T19:02:04.630 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/321 2023-11-27T19:02:04.630 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:02:04.632 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:04.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:02:04.661 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-11-27T19:02:04.880 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:02:04.884 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:02:04.885 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:02:04.886 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:02:04.886 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:05.230 INFO:teuthology.orchestra.run.smithi177.stdout:generic/322 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:02:05.234 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/322 2023-11-27T19:02:05.234 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/322 2023-11-27T19:02:05.234 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:02:05.237 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:05.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:02:05.267 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-11-27T19:02:05.483 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:02:05.487 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:02:05.487 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:02:05.489 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:02:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:02:24.678 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:02:24.681 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:02:55.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:02:55.095 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:03:25.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:03:25.165 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:03:55.283 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:03:55.286 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:04:06.277 INFO:teuthology.orchestra.run.smithi177.stdout:generic/323 121s 2023-11-27T19:04:06.282 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/323 2023-11-27T19:04:06.282 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:06.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:06.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:06.647 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-11-27T19:04:06.878 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:06.882 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:06.883 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:06.884 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:06.884 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:07.208 INFO:teuthology.orchestra.run.smithi177.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-11-27T19:04:07.212 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/324 2023-11-27T19:04:07.212 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/324 2023-11-27T19:04:07.212 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:07.214 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:07.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:07.241 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-11-27T19:04:07.442 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:07.446 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:07.447 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:07.448 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:07.448 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:07.794 INFO:teuthology.orchestra.run.smithi177.stdout:generic/325 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:04:07.798 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/325 2023-11-27T19:04:07.798 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/325 2023-11-27T19:04:07.798 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:07.800 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:07.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:07.828 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-11-27T19:04:08.046 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:08.050 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:08.051 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:08.052 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:08.052 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:08.780 INFO:teuthology.orchestra.run.smithi177.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:08.855 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/326 2023-11-27T19:04:08.855 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/326 2023-11-27T19:04:08.855 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:08.859 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:08.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:08.974 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-11-27T19:04:09.196 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:09.200 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:09.201 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:09.202 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:09.202 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:10.081 INFO:teuthology.orchestra.run.smithi177.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:10.090 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/327 2023-11-27T19:04:10.091 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/327 2023-11-27T19:04:10.091 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:10.104 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:10.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:10.160 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-11-27T19:04:10.378 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:10.382 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:10.382 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:10.384 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:10.384 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:11.226 INFO:teuthology.orchestra.run.smithi177.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:11.234 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/328 2023-11-27T19:04:11.235 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/328 2023-11-27T19:04:11.235 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:11.255 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:11.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:11.343 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-11-27T19:04:11.559 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:11.563 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:11.564 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:11.565 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:11.565 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:12.500 INFO:teuthology.orchestra.run.smithi177.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:12.535 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/329 2023-11-27T19:04:12.535 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/329 2023-11-27T19:04:12.535 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:12.539 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:12.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:12.566 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-11-27T19:04:12.779 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:12.783 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:12.784 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:12.785 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:12.785 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:13.625 INFO:teuthology.orchestra.run.smithi177.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:13.687 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/330 2023-11-27T19:04:13.688 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/330 2023-11-27T19:04:13.688 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:13.709 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:13.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:13.763 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-11-27T19:04:13.964 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:13.969 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:13.969 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:13.970 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:13.970 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:14.850 INFO:teuthology.orchestra.run.smithi177.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:14.899 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/331 2023-11-27T19:04:14.900 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/331 2023-11-27T19:04:14.900 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:14.907 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:14.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:14.941 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-11-27T19:04:15.166 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:15.170 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:15.171 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:15.172 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:15.172 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:16.085 INFO:teuthology.orchestra.run.smithi177.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:16.105 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/332 2023-11-27T19:04:16.105 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/332 2023-11-27T19:04:16.105 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:16.108 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:16.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:16.141 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-11-27T19:04:16.351 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:16.355 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:16.356 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:16.357 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:17.214 INFO:teuthology.orchestra.run.smithi177.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:17.222 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/333 2023-11-27T19:04:17.222 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/333 2023-11-27T19:04:17.222 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:17.230 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:17.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:17.313 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-11-27T19:04:17.517 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:17.521 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:17.521 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:17.522 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:17.522 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:18.310 INFO:teuthology.orchestra.run.smithi177.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:04:18.319 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/334 2023-11-27T19:04:18.319 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/334 2023-11-27T19:04:18.319 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:18.389 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:18.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:18.479 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-11-27T19:04:18.690 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:18.694 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:18.694 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:18.695 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:18.695 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:19.055 INFO:teuthology.orchestra.run.smithi177.stdout:generic/335 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:04:19.059 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/335 2023-11-27T19:04:19.059 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/335 2023-11-27T19:04:19.060 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:19.062 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:19.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:19.085 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-11-27T19:04:19.306 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:19.310 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:19.310 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:19.311 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:19.311 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:19.668 INFO:teuthology.orchestra.run.smithi177.stdout:generic/336 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:04:19.672 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/336 2023-11-27T19:04:19.672 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/336 2023-11-27T19:04:19.672 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:19.674 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:19.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:19.709 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-11-27T19:04:19.915 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:19.919 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:19.919 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:19.920 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:19.920 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:20.531 INFO:teuthology.orchestra.run.smithi177.stdout:generic/337 0s 2023-11-27T19:04:20.536 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/337 2023-11-27T19:04:20.536 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:20.538 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:20.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:20.546 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-11-27T19:04:20.752 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:20.755 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:20.756 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:20.757 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:20.757 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:21.105 INFO:teuthology.orchestra.run.smithi177.stdout:generic/338 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:04:21.109 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/338 2023-11-27T19:04:21.110 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/338 2023-11-27T19:04:21.110 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:04:21.112 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:21.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:04:21.150 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-11-27T19:04:21.353 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:04:21.357 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:04:21.358 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:04:21.359 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:04:21.359 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:04:25.648 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:04:25.650 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:04:25.694 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T19:04:25.692+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144385) UID: 0 2023-11-27T19:04:25.695 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T19:04:25.692+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144385) UID: 0 2023-11-27T19:04:25.695 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T19:04:25.692+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144385) UID: 0 2023-11-27T19:04:25.695 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T19:04:25.692+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144385) UID: 0 2023-11-27T19:05:14.621 INFO:teuthology.orchestra.run.smithi177.stdout:generic/339 53s 2023-11-27T19:05:14.684 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/339 2023-11-27T19:05:14.684 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:14.687 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:14.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:14.700 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-11-27T19:05:14.918 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:14.921 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:14.922 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:14.923 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:14.923 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:17.861 INFO:teuthology.orchestra.run.smithi177.stdout:generic/340 2s 2023-11-27T19:05:17.868 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/340 2023-11-27T19:05:17.868 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:17.870 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:17.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:17.879 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-11-27T19:05:18.072 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:18.076 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:18.076 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:18.077 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:18.078 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:18.473 INFO:teuthology.orchestra.run.smithi177.stdout:generic/341 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:05:18.485 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/341 2023-11-27T19:05:18.485 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/341 2023-11-27T19:05:18.485 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:18.489 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:18.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:18.529 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-11-27T19:05:18.901 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:18.906 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:18.906 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:18.907 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:18.907 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:19.235 INFO:teuthology.orchestra.run.smithi177.stdout:generic/342 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:05:19.239 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/342 2023-11-27T19:05:19.239 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/342 2023-11-27T19:05:19.240 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:19.241 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:19.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:19.271 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-11-27T19:05:19.489 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:19.494 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:19.494 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:19.495 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:19.495 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:19.847 INFO:teuthology.orchestra.run.smithi177.stdout:generic/343 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:05:19.851 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/343 2023-11-27T19:05:19.851 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/343 2023-11-27T19:05:19.851 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:19.853 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:19.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:19.884 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-11-27T19:05:20.084 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:20.089 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:20.090 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:20.090 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:20.090 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:24.944 INFO:teuthology.orchestra.run.smithi177.stdout:generic/344 4s 2023-11-27T19:05:24.950 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/344 2023-11-27T19:05:24.950 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:24.952 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:24.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:24.961 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-11-27T19:05:25.165 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:25.170 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:25.170 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:25.171 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:25.171 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:30.614 INFO:teuthology.orchestra.run.smithi177.stdout:generic/345 5s 2023-11-27T19:05:30.623 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/345 2023-11-27T19:05:30.623 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:30.631 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:30.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:30.655 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-11-27T19:05:31.018 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:31.031 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:31.032 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:31.033 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:31.034 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:34.441 INFO:teuthology.orchestra.run.smithi177.stdout:generic/346 3s 2023-11-27T19:05:34.454 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/346 2023-11-27T19:05:34.454 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:34.478 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:34.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:34.545 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-11-27T19:05:34.862 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:34.875 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:34.877 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:34.880 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:34.880 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:35.343 INFO:teuthology.orchestra.run.smithi177.stdout:generic/347 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:05:35.347 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/347 2023-11-27T19:05:35.347 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/347 2023-11-27T19:05:35.347 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:35.350 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:35.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:35.382 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-11-27T19:05:35.577 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:35.581 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:35.581 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:35.582 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:35.583 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:35.921 INFO:teuthology.orchestra.run.smithi177.stdout:generic/348 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:05:35.925 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/348 2023-11-27T19:05:35.926 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/348 2023-11-27T19:05:35.926 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:35.928 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:35.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:35.951 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-11-27T19:05:36.147 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:36.151 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:36.152 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:36.153 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:36.153 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:36.582 INFO:teuthology.orchestra.run.smithi177.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T19:05:36.586 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/349 2023-11-27T19:05:36.586 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/349 2023-11-27T19:05:36.586 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:36.588 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:36.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:36.614 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-11-27T19:05:36.834 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:36.838 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:36.839 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:36.840 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:36.840 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:37.730 INFO:teuthology.orchestra.run.smithi177.stdout:generic/350 0s 2023-11-27T19:05:37.735 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/350 2023-11-27T19:05:37.735 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:37.737 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:37.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:37.746 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-11-27T19:05:37.945 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:37.949 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:37.950 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:37.951 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:37.951 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:38.273 INFO:teuthology.orchestra.run.smithi177.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:05:38.277 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/351 2023-11-27T19:05:38.277 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/351 2023-11-27T19:05:38.277 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:38.279 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:38.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:38.304 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-11-27T19:05:38.504 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:38.508 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:38.508 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:38.509 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:38.509 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:39.352 INFO:teuthology.orchestra.run.smithi177.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:05:39.370 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/352 2023-11-27T19:05:39.370 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/352 2023-11-27T19:05:39.370 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:39.372 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:39.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:39.405 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-11-27T19:05:39.600 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:39.604 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:39.605 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:39.605 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:39.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:40.320 INFO:teuthology.orchestra.run.smithi177.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:05:40.411 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/353 2023-11-27T19:05:40.411 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/353 2023-11-27T19:05:40.411 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:40.458 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:40.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:40.504 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-11-27T19:05:40.711 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:40.715 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:40.716 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:40.717 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:40.717 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:45.414 INFO:teuthology.orchestra.run.smithi177.stdout:generic/354 5s 2023-11-27T19:05:45.553 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/354 2023-11-27T19:05:45.553 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:45.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:45.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:45.601 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-11-27T19:05:45.943 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:45.950 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:45.951 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:45.952 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:45.952 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:46.857 INFO:teuthology.orchestra.run.smithi177.stdout:generic/355 0s 2023-11-27T19:05:46.862 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/355 2023-11-27T19:05:46.863 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:46.864 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:47.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:47.195 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-11-27T19:05:47.466 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:47.470 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:47.470 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:47.472 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:47.472 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:48.037 INFO:teuthology.orchestra.run.smithi177.stdout:generic/356 [not run] swapfiles are not supported 2023-11-27T19:05:48.041 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/356 2023-11-27T19:05:48.041 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/356 2023-11-27T19:05:48.042 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:48.043 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:48.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:48.066 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-11-27T19:05:48.272 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:48.277 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:48.277 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:48.278 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:48.278 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:48.811 INFO:teuthology.orchestra.run.smithi177.stdout:generic/357 [not run] swapfiles are not supported 2023-11-27T19:05:48.815 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/357 2023-11-27T19:05:48.815 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/357 2023-11-27T19:05:48.815 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:48.817 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:48.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:48.843 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-11-27T19:05:49.058 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:49.062 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:49.062 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:49.063 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:49.063 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:49.846 INFO:teuthology.orchestra.run.smithi177.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:05:49.863 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/358 2023-11-27T19:05:49.863 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/358 2023-11-27T19:05:49.863 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:49.869 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:49.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:49.949 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-11-27T19:05:50.158 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:50.162 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:50.163 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:50.164 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:50.164 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:51.025 INFO:teuthology.orchestra.run.smithi177.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:05:51.046 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/359 2023-11-27T19:05:51.046 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/359 2023-11-27T19:05:51.046 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:51.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:51.089 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-11-27T19:05:51.290 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:51.294 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:51.294 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:51.296 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:51.296 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:51.654 INFO:teuthology.orchestra.run.smithi177.stdout:generic/360 0s 2023-11-27T19:05:51.659 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/360 2023-11-27T19:05:51.659 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:51.661 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:51.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:51.693 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-11-27T19:05:51.906 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:51.910 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:51.910 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:51.911 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:51.912 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:52.237 INFO:teuthology.orchestra.run.smithi177.stdout:generic/361 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:05:52.241 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/361 2023-11-27T19:05:52.241 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/361 2023-11-27T19:05:52.241 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:52.243 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:52.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:52.263 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-11-27T19:05:52.468 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:52.472 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:52.472 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:52.473 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:52.474 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:52.795 INFO:teuthology.orchestra.run.smithi177.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:52.799 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/362 2023-11-27T19:05:52.799 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/362 2023-11-27T19:05:52.799 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:52.801 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:52.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:52.827 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-11-27T19:05:53.045 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:53.049 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:53.050 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:53.051 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:53.051 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:53.367 INFO:teuthology.orchestra.run.smithi177.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:53.371 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/363 2023-11-27T19:05:53.371 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/363 2023-11-27T19:05:53.371 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:53.373 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:53.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:53.393 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-11-27T19:05:53.595 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:53.599 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:53.599 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:53.600 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:53.600 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:53.903 INFO:teuthology.orchestra.run.smithi177.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:53.907 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/364 2023-11-27T19:05:53.907 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/364 2023-11-27T19:05:53.907 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:53.909 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:53.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:53.933 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-11-27T19:05:54.146 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:54.151 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:54.152 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:54.448 INFO:teuthology.orchestra.run.smithi177.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:54.452 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/365 2023-11-27T19:05:54.452 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/365 2023-11-27T19:05:54.452 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:54.454 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:54.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:54.475 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-11-27T19:05:54.681 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:54.686 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:54.686 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:54.687 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:54.687 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:54.982 INFO:teuthology.orchestra.run.smithi177.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:54.986 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/366 2023-11-27T19:05:54.986 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/366 2023-11-27T19:05:54.986 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:54.988 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:55.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:55.018 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-11-27T19:05:55.229 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:55.233 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:55.234 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:55.237 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:55.237 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:55.529 INFO:teuthology.orchestra.run.smithi177.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:55.533 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/367 2023-11-27T19:05:55.533 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/367 2023-11-27T19:05:55.533 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:55.535 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:55.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:55.558 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-11-27T19:05:55.760 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:55.764 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:55.764 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:55.765 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:55.765 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:56.052 INFO:teuthology.orchestra.run.smithi177.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:56.055 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/368 2023-11-27T19:05:56.056 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/368 2023-11-27T19:05:56.056 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:56.058 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:56.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:56.081 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-11-27T19:05:56.283 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:56.288 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:56.288 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:56.289 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:56.289 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:56.599 INFO:teuthology.orchestra.run.smithi177.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:56.603 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/369 2023-11-27T19:05:56.603 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/369 2023-11-27T19:05:56.603 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:56.605 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:56.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:56.633 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-11-27T19:05:56.847 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:56.851 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:56.851 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:56.853 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:56.853 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:57.164 INFO:teuthology.orchestra.run.smithi177.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T19:05:57.168 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/370 2023-11-27T19:05:57.168 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/370 2023-11-27T19:05:57.168 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:57.170 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:57.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:57.204 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-11-27T19:05:57.405 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:57.409 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:57.409 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:57.410 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:57.410 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:57.741 INFO:teuthology.orchestra.run.smithi177.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:05:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/371 2023-11-27T19:05:57.745 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/371 2023-11-27T19:05:57.746 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:57.747 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:57.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:57.773 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-11-27T19:05:57.994 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:57.998 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:57.998 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:57.999 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:57.999 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:58.592 INFO:teuthology.orchestra.run.smithi177.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:05:58.742 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/372 2023-11-27T19:05:58.742 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/372 2023-11-27T19:05:58.742 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:58.781 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:58.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:58.864 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-11-27T19:05:59.090 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:05:59.094 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:05:59.094 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:05:59.095 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:05:59.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:59.798 INFO:teuthology.orchestra.run.smithi177.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:05:59.893 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/373 2023-11-27T19:05:59.893 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/373 2023-11-27T19:05:59.893 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:05:59.930 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:05:59.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:05:59.975 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-11-27T19:06:00.189 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:00.193 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:00.193 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:00.194 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:00.194 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:00.678 INFO:teuthology.orchestra.run.smithi177.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T19:06:00.967 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/374 2023-11-27T19:06:00.967 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/374 2023-11-27T19:06:00.967 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:01.052 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:01.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:01.101 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-11-27T19:06:01.312 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:01.316 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:01.316 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:01.317 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:01.318 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:01.681 INFO:teuthology.orchestra.run.smithi177.stdout:generic/375 0s 2023-11-27T19:06:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/375 2023-11-27T19:06:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:01.688 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:02.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:02.042 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-11-27T19:06:02.274 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:02.278 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:02.279 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:02.280 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:02.280 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:02.590 INFO:teuthology.orchestra.run.smithi177.stdout:generic/376 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:06:02.594 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/376 2023-11-27T19:06:02.594 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/376 2023-11-27T19:06:02.594 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:02.596 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:02.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:02.617 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-11-27T19:06:02.829 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:02.832 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:02.833 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:02.834 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:02.834 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:03.372 INFO:teuthology.orchestra.run.smithi177.stdout:generic/377 0s 2023-11-27T19:06:03.377 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/377 2023-11-27T19:06:03.377 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:03.379 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:03.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:03.387 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-11-27T19:06:03.609 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:03.613 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:03.613 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:03.617 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:03.617 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:04.039 INFO:teuthology.orchestra.run.smithi177.stdout:generic/378 1s 2023-11-27T19:06:04.044 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/378 2023-11-27T19:06:04.044 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:04.046 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:04.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:04.215 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-11-27T19:06:04.646 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:04.650 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:04.650 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:04.651 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:04.651 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:04.970 INFO:teuthology.orchestra.run.smithi177.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:04.974 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/379 2023-11-27T19:06:04.974 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/379 2023-11-27T19:06:04.974 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:04.977 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:04.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:04.994 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-11-27T19:06:05.187 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:05.191 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:05.192 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:05.193 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:05.193 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:05.494 INFO:teuthology.orchestra.run.smithi177.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:05.498 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/380 2023-11-27T19:06:05.498 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/380 2023-11-27T19:06:05.498 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:05.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:05.522 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-11-27T19:06:05.724 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:05.729 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:05.729 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:05.730 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:05.730 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:06.035 INFO:teuthology.orchestra.run.smithi177.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:06.038 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/381 2023-11-27T19:06:06.039 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/381 2023-11-27T19:06:06.039 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:06.041 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:06.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:06.064 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-11-27T19:06:06.264 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:06.269 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:06.269 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:06.270 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:06.270 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:06.569 INFO:teuthology.orchestra.run.smithi177.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:06.573 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/382 2023-11-27T19:06:06.573 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/382 2023-11-27T19:06:06.573 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:06.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:06.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:06.604 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-11-27T19:06:06.808 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:06.812 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:06.812 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:06.813 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:06.813 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:07.123 INFO:teuthology.orchestra.run.smithi177.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:07.127 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/383 2023-11-27T19:06:07.127 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/383 2023-11-27T19:06:07.127 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:07.129 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:07.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:07.154 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-11-27T19:06:07.354 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:07.358 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:07.359 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:07.360 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:07.360 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:07.666 INFO:teuthology.orchestra.run.smithi177.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:07.670 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/384 2023-11-27T19:06:07.670 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/384 2023-11-27T19:06:07.671 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:07.672 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:07.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:07.693 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-11-27T19:06:07.910 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:07.914 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:07.915 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:07.916 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:07.916 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:08.234 INFO:teuthology.orchestra.run.smithi177.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:08.237 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/385 2023-11-27T19:06:08.237 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/385 2023-11-27T19:06:08.238 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:08.239 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:08.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:08.262 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-11-27T19:06:08.475 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:08.479 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:08.479 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:08.480 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:08.481 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:08.786 INFO:teuthology.orchestra.run.smithi177.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:08.790 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/386 2023-11-27T19:06:08.790 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/386 2023-11-27T19:06:08.790 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:08.792 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:08.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:08.817 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-11-27T19:06:09.011 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:09.016 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:09.016 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:09.017 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:09.017 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:09.707 INFO:teuthology.orchestra.run.smithi177.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:06:09.716 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/387 2023-11-27T19:06:09.716 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/387 2023-11-27T19:06:09.716 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:09.826 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:09.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:09.903 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-11-27T19:06:10.110 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:10.115 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:10.115 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:10.116 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:10.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:10.473 INFO:teuthology.orchestra.run.smithi177.stdout:generic/388 [not run] require 172.21.15.177:6789:/scratch to be local device 2023-11-27T19:06:10.477 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/388 2023-11-27T19:06:10.477 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/388 2023-11-27T19:06:10.477 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:10.479 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:10.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:10.501 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-11-27T19:06:10.702 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:10.706 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:10.706 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:10.707 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:10.707 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:10.998 INFO:teuthology.orchestra.run.smithi177.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-27T19:06:11.002 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/389 2023-11-27T19:06:11.002 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/389 2023-11-27T19:06:11.002 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:11.004 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:11.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:11.021 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-11-27T19:06:11.238 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:11.242 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:11.242 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:11.243 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:11.243 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:11.577 INFO:teuthology.orchestra.run.smithi177.stdout:generic/390 [not run] ceph does not support freezing 2023-11-27T19:06:11.581 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/390 2023-11-27T19:06:11.581 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/390 2023-11-27T19:06:11.581 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:11.583 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:11.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:11.608 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-11-27T19:06:11.826 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:11.830 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:11.830 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:11.831 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:11.832 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:12.160 INFO:teuthology.orchestra.run.smithi177.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:06:12.164 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/391 2023-11-27T19:06:12.164 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/391 2023-11-27T19:06:12.165 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:12.166 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:12.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:12.191 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-11-27T19:06:12.387 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:12.391 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:12.391 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:12.392 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:12.392 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:12.878 INFO:teuthology.orchestra.run.smithi177.stdout:generic/392 [not run] ceph does not support shutdown 2023-11-27T19:06:12.894 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/392 2023-11-27T19:06:12.894 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/392 2023-11-27T19:06:12.895 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:12.896 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:12.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:12.919 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-11-27T19:06:13.137 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:13.140 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:13.141 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:13.142 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:13.142 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:14.207 INFO:teuthology.orchestra.run.smithi177.stdout:generic/393 1s 2023-11-27T19:06:14.211 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/393 2023-11-27T19:06:14.212 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:14.214 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:14.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:14.222 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-11-27T19:06:14.425 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:14.429 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:14.429 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:14.430 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:14.430 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:14.787 INFO:teuthology.orchestra.run.smithi177.stdout:generic/394 0s 2023-11-27T19:06:14.791 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/394 2023-11-27T19:06:14.791 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:14.794 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:15.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:15.126 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-11-27T19:06:15.446 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:15.454 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:15.454 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:15.456 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:15.456 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:16.153 INFO:teuthology.orchestra.run.smithi177.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-11-27T19:06:16.177 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/395 2023-11-27T19:06:16.177 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/395 2023-11-27T19:06:16.177 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:16.179 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:16.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:16.217 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-11-27T19:06:16.576 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:16.585 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:16.585 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:16.586 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:16.586 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:17.202 INFO:teuthology.orchestra.run.smithi177.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-11-27T19:06:17.220 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/396 2023-11-27T19:06:17.220 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/396 2023-11-27T19:06:17.220 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:17.222 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:17.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:17.242 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-11-27T19:06:17.457 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:17.462 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:17.462 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:17.463 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:17.463 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:18.026 INFO:teuthology.orchestra.run.smithi177.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-11-27T19:06:18.042 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/397 2023-11-27T19:06:18.042 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/397 2023-11-27T19:06:18.042 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:18.044 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:18.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:18.075 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-11-27T19:06:18.277 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:18.281 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:18.281 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:18.283 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:18.799 INFO:teuthology.orchestra.run.smithi177.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-11-27T19:06:18.821 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/398 2023-11-27T19:06:18.821 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/398 2023-11-27T19:06:18.821 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:18.822 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:18.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:18.849 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-11-27T19:06:19.067 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:19.071 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:19.072 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:19.072 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:19.072 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:19.609 INFO:teuthology.orchestra.run.smithi177.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-11-27T19:06:19.635 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/399 2023-11-27T19:06:19.635 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/399 2023-11-27T19:06:19.635 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:19.637 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:19.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:19.657 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-11-27T19:06:19.861 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:19.864 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:19.865 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:19.866 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:19.866 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:20.180 INFO:teuthology.orchestra.run.smithi177.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:20.184 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/400 2023-11-27T19:06:20.184 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/400 2023-11-27T19:06:20.184 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:20.186 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:20.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:20.205 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-11-27T19:06:20.417 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:20.421 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:20.422 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:20.422 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:20.423 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:21.256 INFO:teuthology.orchestra.run.smithi177.stdout:generic/401 1s 2023-11-27T19:06:21.268 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/401 2023-11-27T19:06:21.268 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:21.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:21.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:21.329 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-11-27T19:06:21.385 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:06:21.390 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:06:21.596 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:21.601 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:21.601 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:21.602 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:21.602 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:22.137 INFO:teuthology.orchestra.run.smithi177.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-11-27T19:06:22.152 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/402 2023-11-27T19:06:22.152 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/402 2023-11-27T19:06:22.153 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:22.155 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:22.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:22.183 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-11-27T19:06:22.391 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:22.396 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:22.396 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:22.397 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:22.397 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:23.074 INFO:teuthology.orchestra.run.smithi177.stdout:generic/403 1s 2023-11-27T19:06:23.078 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/403 2023-11-27T19:06:23.078 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:23.080 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:23.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:23.089 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-11-27T19:06:23.313 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:23.317 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:23.317 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:23.318 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:23.319 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:23.664 INFO:teuthology.orchestra.run.smithi177.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:06:23.668 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/404 2023-11-27T19:06:23.668 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/404 2023-11-27T19:06:23.668 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:23.670 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:23.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:23.705 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-11-27T19:06:23.906 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:23.910 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:23.911 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:23.912 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:23.912 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:24.282 INFO:teuthology.orchestra.run.smithi177.stdout:generic/405 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:06:24.286 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/405 2023-11-27T19:06:24.287 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/405 2023-11-27T19:06:24.287 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:24.289 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:24.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:24.309 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-11-27T19:06:24.515 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:24.519 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:24.520 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:24.521 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:24.521 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:26.330 INFO:teuthology.orchestra.run.smithi177.stdout:generic/406 2s 2023-11-27T19:06:26.335 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/406 2023-11-27T19:06:26.335 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:26.338 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:26.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:26.346 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-11-27T19:06:26.555 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:26.559 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:26.559 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:26.560 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:26.940 INFO:teuthology.orchestra.run.smithi177.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T19:06:26.944 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/407 2023-11-27T19:06:26.944 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/407 2023-11-27T19:06:26.944 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:26.946 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:27.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:27.282 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-11-27T19:06:27.628 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:27.632 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:27.632 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:27.633 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:27.634 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:27.987 INFO:teuthology.orchestra.run.smithi177.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T19:06:27.991 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/408 2023-11-27T19:06:27.991 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/408 2023-11-27T19:06:27.991 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:27.993 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:28.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:28.387 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-11-27T19:06:28.606 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:28.610 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:28.610 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:28.611 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:28.611 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:28.938 INFO:teuthology.orchestra.run.smithi177.stdout:generic/409 [not run] require 172.21.15.177:6789:/scratch to be local device 2023-11-27T19:06:28.942 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/409 2023-11-27T19:06:28.942 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/409 2023-11-27T19:06:28.942 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:28.944 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:28.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:28.969 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-11-27T19:06:29.175 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:29.178 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:29.179 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:29.180 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:29.180 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:29.505 INFO:teuthology.orchestra.run.smithi177.stdout:generic/410 [not run] require 172.21.15.177:6789:/scratch to be local device 2023-11-27T19:06:29.509 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/410 2023-11-27T19:06:29.509 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/410 2023-11-27T19:06:29.509 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:29.513 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:29.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:29.542 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-11-27T19:06:29.745 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:29.750 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:29.750 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:29.750 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:29.751 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:30.083 INFO:teuthology.orchestra.run.smithi177.stdout:generic/411 [not run] require 172.21.15.177:6789:/scratch to be local device 2023-11-27T19:06:30.087 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/411 2023-11-27T19:06:30.087 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/411 2023-11-27T19:06:30.087 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:30.089 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:30.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:30.111 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-11-27T19:06:30.321 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:30.325 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:30.325 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:30.326 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:30.326 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:31.065 INFO:teuthology.orchestra.run.smithi177.stdout:generic/412 1s 2023-11-27T19:06:31.070 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/412 2023-11-27T19:06:31.070 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:31.072 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:31.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:31.080 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-11-27T19:06:31.297 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:31.301 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:31.302 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:31.303 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:31.303 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:31.767 INFO:teuthology.orchestra.run.smithi177.stdout:generic/413 [not run] mount 172.21.15.177:6789:/scratch with dax failed 2023-11-27T19:06:31.771 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/413 2023-11-27T19:06:31.771 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/413 2023-11-27T19:06:31.771 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:31.773 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:31.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:31.798 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-11-27T19:06:32.016 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:32.021 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:32.021 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:32.022 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:32.022 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:32.779 INFO:teuthology.orchestra.run.smithi177.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:06:32.868 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/414 2023-11-27T19:06:32.868 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/414 2023-11-27T19:06:32.868 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:32.896 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:32.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:32.956 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-11-27T19:06:33.157 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:33.161 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:33.162 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:33.162 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:33.163 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:33.885 INFO:teuthology.orchestra.run.smithi177.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:06:34.033 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/415 2023-11-27T19:06:34.034 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/415 2023-11-27T19:06:34.034 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:34.041 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:34.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:34.096 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-11-27T19:06:34.301 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:34.305 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:34.305 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:34.306 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:34.307 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:34.629 INFO:teuthology.orchestra.run.smithi177.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T19:06:34.633 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/416 2023-11-27T19:06:34.634 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/416 2023-11-27T19:06:34.634 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:34.635 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:34.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:34.664 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-11-27T19:06:34.880 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:34.884 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:34.884 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:34.886 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:34.886 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:35.383 INFO:teuthology.orchestra.run.smithi177.stdout:generic/417 [not run] ceph does not support shutdown 2023-11-27T19:06:35.401 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/417 2023-11-27T19:06:35.401 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/417 2023-11-27T19:06:35.401 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:35.403 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:35.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:35.430 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-11-27T19:06:35.633 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:35.638 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:35.638 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:35.639 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:35.639 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:36.002 INFO:teuthology.orchestra.run.smithi177.stdout:generic/418 [not run] require 172.21.15.177:6789:/test to be valid block disk 2023-11-27T19:06:36.006 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/418 2023-11-27T19:06:36.006 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/418 2023-11-27T19:06:36.006 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:36.008 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:36.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:36.046 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-11-27T19:06:36.267 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:36.271 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:36.271 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:36.272 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:36.273 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:36.817 INFO:teuthology.orchestra.run.smithi177.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-11-27T19:06:36.842 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/419 2023-11-27T19:06:36.842 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/419 2023-11-27T19:06:36.842 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:36.844 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:36.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:36.868 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-11-27T19:06:37.079 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:37.082 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:37.083 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:37.084 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:37.084 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:37.541 INFO:teuthology.orchestra.run.smithi177.stdout:generic/420 0s 2023-11-27T19:06:37.545 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/420 2023-11-27T19:06:37.545 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:37.547 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:37.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:37.948 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-11-27T19:06:38.160 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:38.165 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:38.165 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:38.166 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:38.166 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:38.697 INFO:teuthology.orchestra.run.smithi177.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-11-27T19:06:38.713 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/421 2023-11-27T19:06:38.713 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/421 2023-11-27T19:06:38.713 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:38.715 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:38.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:38.740 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-11-27T19:06:38.943 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:45.092 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:45.092 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:45.093 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:45.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:45.093 INFO:teuthology.orchestra.run.smithi177.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T19:06:45.093 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/422 2023-11-27T19:06:45.093 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/422 2023-11-27T19:06:45.093 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:45.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:45.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:45.093 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-11-27T19:06:45.322 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:45.326 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:45.326 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:45.327 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:45.327 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:45.742 INFO:teuthology.orchestra.run.smithi177.stdout:generic/423 0s 2023-11-27T19:06:45.746 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/423 2023-11-27T19:06:45.747 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:45.749 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:46.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:46.038 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-11-27T19:06:46.372 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:46.376 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:46.377 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:46.377 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:46.379 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:46.717 INFO:teuthology.orchestra.run.smithi177.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-11-27T19:06:46.721 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/424 2023-11-27T19:06:46.721 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/424 2023-11-27T19:06:46.721 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:46.723 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:46.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:46.752 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-11-27T19:06:46.957 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:46.961 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:46.962 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:46.963 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:46.963 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:47.336 INFO:teuthology.orchestra.run.smithi177.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-11-27T19:06:47.339 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/425 2023-11-27T19:06:47.340 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/425 2023-11-27T19:06:47.340 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:06:47.342 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:47.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:06:47.518 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-11-27T19:06:47.943 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:06:47.947 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:06:47.947 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:06:47.948 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:06:47.948 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:06:51.523 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:06:51.526 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:21.870 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:21.964 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:34.742 INFO:teuthology.orchestra.run.smithi177.stdout:generic/426 46s 2023-11-27T19:07:34.838 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/426 2023-11-27T19:07:34.838 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:34.858 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:35.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:35.329 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-11-27T19:07:36.456 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:36.460 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:36.461 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:36.462 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:36.463 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:36.897 INFO:teuthology.orchestra.run.smithi177.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T19:07:36.901 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/427 2023-11-27T19:07:36.901 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/427 2023-11-27T19:07:36.901 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:36.903 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:36.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:36.927 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-11-27T19:07:37.154 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:37.158 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:37.158 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:37.159 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:37.159 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:37.533 INFO:teuthology.orchestra.run.smithi177.stdout:generic/428 0s 2023-11-27T19:07:37.538 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/428 2023-11-27T19:07:37.538 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:37.540 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:37.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:37.567 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-11-27T19:07:37.772 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:37.776 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:37.776 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:37.777 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:37.777 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:38.306 INFO:teuthology.orchestra.run.smithi177.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-11-27T19:07:38.327 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/429 2023-11-27T19:07:38.328 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/429 2023-11-27T19:07:38.328 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:38.329 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:38.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:38.350 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-11-27T19:07:38.568 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:38.572 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:38.573 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:38.574 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:38.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:39.010 INFO:teuthology.orchestra.run.smithi177.stdout:generic/430 1s 2023-11-27T19:07:39.015 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/430 2023-11-27T19:07:39.015 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:39.017 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:39.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:39.407 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-11-27T19:07:39.650 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:39.655 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:39.655 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:39.656 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:39.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:40.057 INFO:teuthology.orchestra.run.smithi177.stdout:generic/431 1s 2023-11-27T19:07:40.062 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/431 2023-11-27T19:07:40.062 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:40.064 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:40.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:40.388 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-11-27T19:07:40.681 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:40.685 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:40.685 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:40.686 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:40.686 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:41.095 INFO:teuthology.orchestra.run.smithi177.stdout:generic/432 1s 2023-11-27T19:07:41.100 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/432 2023-11-27T19:07:41.100 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:41.102 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:41.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:41.399 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-11-27T19:07:41.741 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:41.745 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:41.746 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:41.746 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:41.746 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:42.140 INFO:teuthology.orchestra.run.smithi177.stdout:generic/433 1s 2023-11-27T19:07:42.144 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/433 2023-11-27T19:07:42.145 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:42.147 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:42.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:42.565 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-11-27T19:07:42.780 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:42.784 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:42.784 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:42.785 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:42.785 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:43.179 INFO:teuthology.orchestra.run.smithi177.stdout:generic/434 1s 2023-11-27T19:07:43.183 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/434 2023-11-27T19:07:43.184 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:43.186 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:43.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:43.561 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-11-27T19:07:43.822 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:43.826 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:43.826 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:43.827 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:43.828 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:44.331 INFO:teuthology.orchestra.run.smithi177.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-11-27T19:07:44.348 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/435 2023-11-27T19:07:44.348 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/435 2023-11-27T19:07:44.349 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:44.350 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:44.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:44.373 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-11-27T19:07:44.574 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:44.578 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:44.578 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:44.579 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:44.581 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:45.129 INFO:teuthology.orchestra.run.smithi177.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:07:45.133 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/436 2023-11-27T19:07:45.133 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/436 2023-11-27T19:07:45.134 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:45.135 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:45.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:45.432 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-11-27T19:07:45.741 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:45.745 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:45.745 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:45.746 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:45.746 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:46.723 INFO:teuthology.orchestra.run.smithi177.stdout:generic/437 1s 2023-11-27T19:07:46.728 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/437 2023-11-27T19:07:46.728 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:07:46.730 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:46.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:07:46.759 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-11-27T19:07:46.975 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:07:46.979 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:07:46.979 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:07:46.980 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:07:46.980 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:07:53.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:53.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:23.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:23.647 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:50.274 INFO:teuthology.orchestra.run.smithi177.stdout:generic/438 63s 2023-11-27T19:08:50.279 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/438 2023-11-27T19:08:50.280 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:08:50.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:50.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:08:50.315 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-11-27T19:08:50.526 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:08:50.531 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:08:50.531 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:08:50.532 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:08:50.532 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:51.663 INFO:teuthology.orchestra.run.smithi177.stdout:generic/439 1s 2023-11-27T19:08:51.668 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/439 2023-11-27T19:08:51.668 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:08:51.670 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:51.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:08:51.699 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-11-27T19:08:51.917 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:08:51.922 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:08:51.922 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:08:51.923 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:08:51.923 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:52.487 INFO:teuthology.orchestra.run.smithi177.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-11-27T19:08:52.518 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/440 2023-11-27T19:08:52.518 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/440 2023-11-27T19:08:52.518 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:08:52.520 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:52.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:08:52.550 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-11-27T19:08:52.765 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:08:52.769 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:08:52.769 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:08:52.770 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:08:52.770 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:53.181 INFO:teuthology.orchestra.run.smithi177.stdout:generic/441 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:08:53.185 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/441 2023-11-27T19:08:53.185 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/441 2023-11-27T19:08:53.185 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:08:53.187 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:53.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:08:53.209 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-11-27T19:08:53.414 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:08:53.418 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:08:53.418 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:08:53.419 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:08:53.419 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:53.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:53.764 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:53.769 INFO:teuthology.orchestra.run.smithi177.stdout:generic/442 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:08:53.773 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/442 2023-11-27T19:08:53.773 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/442 2023-11-27T19:08:53.773 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:08:53.774 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:53.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:08:53.801 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-11-27T19:08:54.077 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:08:54.081 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:08:54.082 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:08:54.083 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:08:54.083 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:54.454 INFO:teuthology.orchestra.run.smithi177.stdout:generic/443 0s 2023-11-27T19:08:54.459 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/443 2023-11-27T19:08:54.459 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:08:54.460 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:54.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:08:54.493 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-11-27T19:08:54.696 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:08:54.700 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:08:54.700 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:08:54.702 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:08:54.702 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:55.140 INFO:teuthology.orchestra.run.smithi177.stdout:generic/444 1s 2023-11-27T19:08:55.145 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/444 2023-11-27T19:08:55.145 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:08:55.147 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:55.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:08:55.190 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-11-27T19:08:55.394 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:08:55.399 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:08:55.399 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:08:55.400 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:08:55.400 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:56.167 INFO:teuthology.orchestra.run.smithi177.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:08:56.171 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/445 2023-11-27T19:08:56.171 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/445 2023-11-27T19:08:56.171 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:08:56.173 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:08:56.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:08:56.496 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-11-27T19:08:56.771 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:08:56.775 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:08:56.775 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:08:56.776 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:08:56.776 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:17.172 INFO:teuthology.orchestra.run.smithi177.stdout:generic/446 21s 2023-11-27T19:09:17.227 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/446 2023-11-27T19:09:17.227 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:17.244 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:17.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:17.274 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-11-27T19:09:17.478 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:17.482 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:17.482 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:17.483 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:17.484 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:18.357 INFO:teuthology.orchestra.run.smithi177.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:09:18.390 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/447 2023-11-27T19:09:18.390 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/447 2023-11-27T19:09:18.391 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:18.392 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:18.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:18.433 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-11-27T19:09:18.648 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:18.652 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:18.652 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:18.653 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:18.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:19.867 INFO:teuthology.orchestra.run.smithi177.stdout:generic/448 1s 2023-11-27T19:09:19.872 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/448 2023-11-27T19:09:19.872 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:20.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:20.236 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-11-27T19:09:20.482 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:20.486 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:20.486 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:20.487 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:20.488 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:20.856 INFO:teuthology.orchestra.run.smithi177.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T19:09:20.860 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/449 2023-11-27T19:09:20.860 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/449 2023-11-27T19:09:20.860 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:20.862 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:21.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:21.262 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-11-27T19:09:21.489 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:21.493 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:21.493 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:21.494 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:21.494 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:22.208 INFO:teuthology.orchestra.run.smithi177.stdout:generic/450 1s 2023-11-27T19:09:22.213 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/450 2023-11-27T19:09:22.213 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:22.215 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:22.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:22.545 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-11-27T19:09:22.842 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:22.846 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:22.846 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:22.847 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:22.847 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:23.823 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:23.826 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:53.314 INFO:teuthology.orchestra.run.smithi177.stdout:generic/451 30s 2023-11-27T19:09:53.318 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/451 2023-11-27T19:09:53.318 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:53.320 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:53.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:53.585 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-11-27T19:09:53.921 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:53.925 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:53.926 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:53.926 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:53.941 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:53.943 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:54.533 INFO:teuthology.orchestra.run.smithi177.stdout:generic/452 0s 2023-11-27T19:09:54.538 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/452 2023-11-27T19:09:54.538 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:54.540 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:54.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:54.548 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-11-27T19:09:54.761 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:54.766 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:54.766 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:54.767 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:54.767 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:55.104 INFO:teuthology.orchestra.run.smithi177.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-11-27T19:09:55.109 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/453 2023-11-27T19:09:55.109 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/453 2023-11-27T19:09:55.109 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:55.111 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:55.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:55.147 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-11-27T19:09:55.352 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:55.356 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:55.357 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:55.358 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:55.358 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:55.705 INFO:teuthology.orchestra.run.smithi177.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-11-27T19:09:55.709 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/454 2023-11-27T19:09:55.709 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/454 2023-11-27T19:09:55.709 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:55.711 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:55.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:55.752 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-11-27T19:09:55.962 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:55.966 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:55.966 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:55.967 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:55.967 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:56.383 INFO:teuthology.orchestra.run.smithi177.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-11-27T19:09:56.387 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/455 2023-11-27T19:09:56.387 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/455 2023-11-27T19:09:56.387 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:56.389 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:56.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:56.421 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-11-27T19:09:56.632 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:56.636 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:56.637 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:56.637 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:56.638 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:57.010 INFO:teuthology.orchestra.run.smithi177.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:09:57.014 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/456 2023-11-27T19:09:57.014 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/456 2023-11-27T19:09:57.014 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:57.016 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:57.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:57.053 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-11-27T19:09:57.268 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:57.272 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:57.273 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:57.273 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:57.274 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:58.200 INFO:teuthology.orchestra.run.smithi177.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:09:58.209 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/457 2023-11-27T19:09:58.210 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/457 2023-11-27T19:09:58.210 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:58.214 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:58.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:58.243 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-11-27T19:09:58.445 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:58.449 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:58.450 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:58.451 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:58.451 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:59.320 INFO:teuthology.orchestra.run.smithi177.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:09:59.343 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/458 2023-11-27T19:09:59.343 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/458 2023-11-27T19:09:59.343 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:09:59.345 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:09:59.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:09:59.377 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-11-27T19:09:59.592 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:09:59.596 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:09:59.597 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:09:59.598 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:09:59.598 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:00.128 INFO:teuthology.orchestra.run.smithi177.stdout:generic/459 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:10:00.132 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/459 2023-11-27T19:10:00.132 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/459 2023-11-27T19:10:00.132 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:10:00.134 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:00.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:10:00.165 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-11-27T19:10:00.371 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:10:00.375 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:10:00.375 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:10:00.376 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:10:00.377 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:02.278 INFO:teuthology.orchestra.run.smithi177.stdout:generic/460 2s 2023-11-27T19:10:02.283 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/460 2023-11-27T19:10:02.284 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:10:02.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:02.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:10:02.295 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-11-27T19:10:02.509 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:10:02.513 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:10:02.514 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:10:02.515 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:10:02.515 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:03.130 INFO:teuthology.orchestra.run.smithi177.stdout:generic/461 [not run] ceph does not support shutdown 2023-11-27T19:10:03.137 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/461 2023-11-27T19:10:03.137 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/461 2023-11-27T19:10:03.138 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:10:03.143 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:03.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:10:03.194 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-11-27T19:10:03.464 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:10:03.468 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:10:03.469 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:10:03.470 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:10:03.470 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:03.936 INFO:teuthology.orchestra.run.smithi177.stdout:generic/462 [not run] mount 172.21.15.177:6789:/scratch with dax failed 2023-11-27T19:10:03.940 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/462 2023-11-27T19:10:03.940 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/462 2023-11-27T19:10:03.941 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:10:03.942 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:03.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:10:03.966 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-11-27T19:10:04.185 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:10:04.189 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:10:04.190 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:10:04.190 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:10:04.191 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:04.575 INFO:teuthology.orchestra.run.smithi177.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T19:10:04.580 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/463 2023-11-27T19:10:04.580 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/463 2023-11-27T19:10:04.580 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:10:04.581 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:04.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:10:04.717 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-11-27T19:10:05.195 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:10:05.199 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:10:05.199 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:10:05.200 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:10:05.200 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:10:24.070 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:24.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:54.292 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:54.299 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:01.844 INFO:teuthology.orchestra.run.smithi177.stdout:generic/464 56s 2023-11-27T19:11:01.849 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/464 2023-11-27T19:11:01.849 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:11:01.851 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:11:01.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:11:01.860 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-11-27T19:11:02.090 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:11:02.094 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:11:02.094 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:11:02.095 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:11:02.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:11:06.530 INFO:teuthology.orchestra.run.smithi177.stdout:generic/465 4s 2023-11-27T19:11:06.541 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/465 2023-11-27T19:11:06.542 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:11:06.547 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:11:06.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:11:06.558 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-11-27T19:11:06.782 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:11:06.786 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:11:06.786 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:11:06.787 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:11:06.787 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:11:07.108 INFO:teuthology.orchestra.run.smithi177.stdout:generic/466 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:11:07.112 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/466 2023-11-27T19:11:07.112 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/466 2023-11-27T19:11:07.112 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:11:07.114 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:11:07.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:11:07.144 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-11-27T19:11:07.346 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:11:07.350 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:11:07.351 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:11:07.352 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:11:07.352 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:11:24.486 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:24.512 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:55.224 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:55.248 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:07.840 INFO:teuthology.orchestra.run.smithi177.stdout:generic/467 60s 2023-11-27T19:12:07.923 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/467 2023-11-27T19:12:07.924 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:07.925 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:08.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:08.232 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-11-27T19:12:09.399 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:12:09.404 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:12:09.404 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:12:09.405 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:12:09.405 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:09.960 INFO:teuthology.orchestra.run.smithi177.stdout:generic/468 [not run] ceph does not support shutdown 2023-11-27T19:12:09.982 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/468 2023-11-27T19:12:09.982 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/468 2023-11-27T19:12:09.982 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:09.984 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:10.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:10.010 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-11-27T19:12:10.235 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:12:10.239 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:12:10.239 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:12:10.240 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:12:10.240 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:10.594 INFO:teuthology.orchestra.run.smithi177.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T19:12:10.598 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/469 2023-11-27T19:12:10.598 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/469 2023-11-27T19:12:10.598 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:10.600 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:10.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:10.633 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-11-27T19:12:10.839 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:12:10.843 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:12:10.844 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:12:10.845 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:12:10.845 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:11.213 INFO:teuthology.orchestra.run.smithi177.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-11-27T19:12:11.218 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/470 2023-11-27T19:12:11.218 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/470 2023-11-27T19:12:11.218 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:11.220 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:11.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:11.246 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-11-27T19:12:11.452 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:12:11.456 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:12:11.457 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:12:11.458 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:12:11.458 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:25.873 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:25.876 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:55.524 INFO:teuthology.orchestra.run.smithi177.stdout:generic/471 44s 2023-11-27T19:12:55.533 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/471 2023-11-27T19:12:55.533 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:55.536 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:55.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:55.836 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-11-27T19:12:56.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:56.107 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:56.979 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:12:57.051 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:12:57.051 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:12:57.051 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:12:57.051 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:57.792 INFO:teuthology.orchestra.run.smithi177.stdout:generic/472 [not run] swapfiles are not supported 2023-11-27T19:12:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/472 2023-11-27T19:12:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/472 2023-11-27T19:12:57.796 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:57.798 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:57.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:57.834 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-11-27T19:12:58.041 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:12:58.045 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:12:58.045 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:12:58.047 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:12:58.047 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T19:12:58.416 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/473 2023-11-27T19:12:58.417 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/473 2023-11-27T19:12:58.417 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:58.419 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:58.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:58.443 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-11-27T19:12:58.649 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:12:58.653 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:12:58.654 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:12:58.655 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:12:58.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:59.146 INFO:teuthology.orchestra.run.smithi177.stdout:generic/474 [not run] ceph does not support shutdown 2023-11-27T19:12:59.170 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/474 2023-11-27T19:12:59.170 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/474 2023-11-27T19:12:59.170 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:59.171 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:59.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:59.193 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-11-27T19:12:59.396 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:12:59.401 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:12:59.401 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:12:59.402 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:12:59.402 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:59.756 INFO:teuthology.orchestra.run.smithi177.stdout:generic/475 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T19:12:59.760 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/475 2023-11-27T19:12:59.760 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/475 2023-11-27T19:12:59.760 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T19:12:59.762 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:12:59.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T19:12:59.790 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-11-27T19:12:59.996 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T19:13:00.000 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T19:13:00.001 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T19:13:00.002 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T19:13:00.002 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T19:13:26.209 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:13:26.225 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:13:26.823 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T19:13:26.820+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671597) UID: 0 2023-11-27T19:13:26.823 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T19:13:26.820+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671597) UID: 0 2023-11-27T19:13:26.824 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T19:13:26.820+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671597) UID: 0 2023-11-27T19:13:26.824 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T19:13:26.820+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671597) UID: 0 2023-11-27T19:17:11.242 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:17:11.253 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:17:11.455 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T19:17:11.449+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 671999) UID: 0 2023-11-27T19:17:11.474 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T19:17:11.454+0000 7ff5bf82d700 -1 received signal: Hangup from (PID: 671999) UID: 0 2023-11-27T19:21:46.438 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:21:46.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:22:16.901 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:22:16.912 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:22:47.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:22:47.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:17.416 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:17.423 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:47.597 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:47.607 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:17.755 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:17.775 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:47.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:47.909 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:17.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:18.000 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:18.375 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T19:25:18.368+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672399) UID: 0 2023-11-27T19:25:18.376 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T19:25:18.367+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672399) UID: 0 2023-11-27T19:25:18.378 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T19:25:18.372+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672399) UID: 0 2023-11-27T19:25:18.397 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T19:25:18.368+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672399) UID: 0 2023-11-27T19:28:59.528 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:28:59.531 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:28:59.684 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T19:28:59.681+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146029) UID: 0 2023-11-27T19:28:59.684 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T19:28:59.681+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146029) UID: 0 2023-11-27T19:28:59.685 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T19:28:59.681+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146029) UID: 0 2023-11-27T19:28:59.685 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T19:28:59.681+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146029) UID: 0 2023-11-27T19:32:40.171 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:32:40.174 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:32:40.238 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T19:32:40.235+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 672517) UID: 0 2023-11-27T19:32:40.263 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T19:32:40.237+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 672517) UID: 0 2023-11-27T19:36:22.074 INFO:teuthology.orchestra.run.smithi177.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2023-11-27T19:36:22.075 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: stdin: file size changed while zipping 2023-11-27T19:36:23.582 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T19:36:23.580+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672575) UID: 0 2023-11-27T19:36:23.590 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T19:36:23.589+0000 7f8f0e69b700 -1 Fail to open '/proc/672575/cmdline' error = (2) No such file or directory 2023-11-27T19:36:23.590 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T19:36:23.589+0000 7f8f0e69b700 -1 received signal: Hangup from (PID: 672575) UID: 0 2023-11-27T19:36:23.591 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T19:36:23.589+0000 7f28d87cf700 -1 Fail to open '/proc/672575/cmdline' error = (2) No such file or directory 2023-11-27T19:36:23.591 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T19:36:23.589+0000 7f28d87cf700 -1 received signal: Hangup from (PID: 672575) UID: 0 2023-11-27T19:36:23.593 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T19:36:23.584+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672575) UID: 0 2023-11-27T19:40:15.891 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:40:15.895 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:40:15.961 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T19:40:15.959+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146205) UID: 0 2023-11-27T19:40:15.961 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T19:40:15.959+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146205) UID: 0 2023-11-27T19:40:15.962 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T19:40:15.959+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146205) UID: 0 2023-11-27T19:40:15.962 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T19:40:15.959+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146205) UID: 0 2023-11-27T19:43:45.875 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:43:45.878 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:43:45.955 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T19:43:45.953+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146285) UID: 0 2023-11-27T19:43:45.956 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T19:43:45.953+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146285) UID: 0 2023-11-27T19:43:45.956 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T19:43:45.954+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146285) UID: 0 2023-11-27T19:43:45.956 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T19:43:45.953+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146285) UID: 0 2023-11-27T19:47:22.175 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:47:22.186 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:47:22.535 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T19:47:22.530+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 672759) UID: 0 2023-11-27T19:47:22.567 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T19:47:22.536+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 672759) UID: 0 2023-11-27T19:51:33.595 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T19:51:33.593+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672811) UID: 0 2023-11-27T19:51:33.614 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T19:51:33.593+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672811) UID: 0 2023-11-27T19:51:33.614 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T19:51:33.596+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672811) UID: 0 2023-11-27T19:51:33.614 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T19:51:33.593+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672811) UID: 0 2023-11-27T19:55:42.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:55:42.242 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:55:42.306 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T19:55:42.303+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146470) UID: 0 2023-11-27T19:55:42.306 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T19:55:42.303+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146470) UID: 0 2023-11-27T19:55:42.306 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T19:55:42.303+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146470) UID: 0 2023-11-27T19:55:42.307 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T19:55:42.303+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146470) UID: 0 2023-11-27T19:59:28.522 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:28.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:58.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:58.684 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:58.815 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T19:59:58.811+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 672979) UID: 0 2023-11-27T19:59:58.815 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T19:59:58.803+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 672979) UID: 0 2023-11-27T20:03:24.361 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T20:03:24.358+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 673226) UID: 0 2023-11-27T20:03:24.362 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T20:03:24.358+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 673226) UID: 0 2023-11-27T20:03:24.366 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T20:03:24.359+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 673226) UID: 0 2023-11-27T20:03:24.366 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T20:03:24.360+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 673226) UID: 0 2023-11-27T20:07:11.473 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:11.476 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:42.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:42.146 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:42.206 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T20:07:42.204+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 673323) UID: 0 2023-11-27T20:07:42.207 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T20:07:42.205+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 673323) UID: 0 2023-11-27T20:07:42.207 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T20:07:42.205+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 673323) UID: 0 2023-11-27T20:07:42.211 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T20:07:42.206+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 673323) UID: 0 2023-11-27T20:11:14.991 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:15.020 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:45.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:45.234 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:15.827 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:15.837 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:46.147 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:46.159 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:46.245 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T20:12:46.244+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 673481) UID: 0 2023-11-27T20:12:46.487 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T20:12:46.234+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 673481) UID: 0 2023-11-27T20:13:58.406 INFO:teuthology.orchestra.run.smithi177.stdout:generic/476 3658s 2023-11-27T20:13:58.422 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/476 2023-11-27T20:13:58.422 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:13:58.424 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:13:58.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:13:58.435 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-11-27T20:14:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:14:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:14:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:14:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:14:11.629 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:15:37.059 INFO:teuthology.orchestra.run.smithi177.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2023-11-27T20:15:37.059 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: stdin: file size changed while zipping 2023-11-27T20:16:10.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:10.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:40.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:40.866 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:10.995 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:10.997 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:41.093 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:41.095 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:11.218 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:13.368 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:43.851 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:44.297 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:44.350 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T20:18:44.347+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 673953) UID: 0 2023-11-27T20:18:44.350 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T20:18:44.347+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 673953) UID: 0 2023-11-27T20:21:47.413 INFO:teuthology.orchestra.run.smithi177.stdout:generic/477 21s 2023-11-27T20:21:47.488 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/477 2023-11-27T20:21:47.488 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:21:47.519 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:21:47.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:21:47.635 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-11-27T20:21:48.902 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:21:48.907 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:21:48.907 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:21:48.909 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:21:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:21:52.069 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:21:52.072 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:00.107 INFO:teuthology.orchestra.run.smithi177.stdout:generic/478 11s 2023-11-27T20:22:00.117 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/478 2023-11-27T20:22:00.117 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:00.121 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:00.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:00.166 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-11-27T20:22:00.515 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:00.520 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:00.521 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:00.522 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:00.522 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:01.092 INFO:teuthology.orchestra.run.smithi177.stdout:generic/479 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:01.097 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/479 2023-11-27T20:22:01.097 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/479 2023-11-27T20:22:01.097 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:01.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:01.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:01.153 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-11-27T20:22:01.501 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:01.511 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:01.512 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:01.517 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:01.517 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:02.036 INFO:teuthology.orchestra.run.smithi177.stdout:generic/480 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:02.041 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/480 2023-11-27T20:22:02.042 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/480 2023-11-27T20:22:02.042 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:02.044 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:02.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:02.085 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-11-27T20:22:02.438 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:02.443 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:02.443 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:02.444 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:02.444 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:02.909 INFO:teuthology.orchestra.run.smithi177.stdout:generic/481 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:02.914 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/481 2023-11-27T20:22:02.914 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/481 2023-11-27T20:22:02.915 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:02.917 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:02.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:02.955 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-11-27T20:22:03.332 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:03.337 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:03.338 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:03.339 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:03.339 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:03.890 INFO:teuthology.orchestra.run.smithi177.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-11-27T20:22:03.894 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/482 2023-11-27T20:22:03.894 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/482 2023-11-27T20:22:03.895 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:03.896 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:03.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:03.927 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-11-27T20:22:04.258 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:04.262 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:04.262 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:04.264 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:04.264 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:04.789 INFO:teuthology.orchestra.run.smithi177.stdout:generic/483 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:04.793 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/483 2023-11-27T20:22:04.793 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/483 2023-11-27T20:22:04.793 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:04.796 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:04.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:04.833 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-11-27T20:22:05.161 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:05.171 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:05.172 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:05.172 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:05.173 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:05.741 INFO:teuthology.orchestra.run.smithi177.stdout:generic/484 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:05.746 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/484 2023-11-27T20:22:05.746 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/484 2023-11-27T20:22:05.746 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:05.748 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:05.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:05.772 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-11-27T20:22:06.154 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:06.166 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:06.166 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:06.167 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:06.167 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:06.684 INFO:teuthology.orchestra.run.smithi177.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T20:22:06.688 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/485 2023-11-27T20:22:06.689 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/485 2023-11-27T20:22:06.689 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:06.691 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:06.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:06.737 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-11-27T20:22:07.127 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:07.135 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:07.135 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:07.136 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:07.136 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:08.048 INFO:teuthology.orchestra.run.smithi177.stdout:generic/486 1s 2023-11-27T20:22:08.053 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/486 2023-11-27T20:22:08.053 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:08.055 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:08.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:08.072 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-11-27T20:22:08.441 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:08.445 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:08.445 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:08.446 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:08.446 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:08.969 INFO:teuthology.orchestra.run.smithi177.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-11-27T20:22:08.974 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/487 2023-11-27T20:22:08.974 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/487 2023-11-27T20:22:08.974 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:08.988 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:09.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:09.019 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-11-27T20:22:09.344 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:09.349 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:09.349 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:09.350 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:09.350 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:09.866 INFO:teuthology.orchestra.run.smithi177.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T20:22:09.878 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/488 2023-11-27T20:22:09.878 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/488 2023-11-27T20:22:09.879 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:09.881 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:09.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:09.913 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-11-27T20:22:10.231 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:10.235 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:10.235 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:10.236 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:10.236 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:10.748 INFO:teuthology.orchestra.run.smithi177.stdout:generic/489 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:10.755 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/489 2023-11-27T20:22:10.755 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/489 2023-11-27T20:22:10.755 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:10.755 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:10.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:10.792 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-11-27T20:22:11.157 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:11.169 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:11.170 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:11.171 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:11.171 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:13.518 INFO:teuthology.orchestra.run.smithi177.stdout:generic/490 2s 2023-11-27T20:22:13.526 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/490 2023-11-27T20:22:13.527 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:13.529 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:13.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:13.822 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-11-27T20:22:14.350 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:14.357 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:14.357 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:14.358 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:14.358 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:15.117 INFO:teuthology.orchestra.run.smithi177.stdout:generic/491 [not run] ceph does not support freezing 2023-11-27T20:22:15.127 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/491 2023-11-27T20:22:15.127 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/491 2023-11-27T20:22:15.127 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:15.129 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:15.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:15.174 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-11-27T20:22:15.505 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:15.513 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:15.518 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:15.519 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:15.519 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:16.039 INFO:teuthology.orchestra.run.smithi177.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-11-27T20:22:16.044 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/492 2023-11-27T20:22:16.044 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/492 2023-11-27T20:22:16.044 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:16.046 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:16.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:16.078 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-11-27T20:22:16.422 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:16.426 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:16.426 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:16.427 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:16.427 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:17.267 INFO:teuthology.orchestra.run.smithi177.stdout:generic/493 [not run] swapfiles are not supported 2023-11-27T20:22:17.273 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/493 2023-11-27T20:22:17.274 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/493 2023-11-27T20:22:17.274 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:17.278 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:17.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:17.318 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-11-27T20:22:17.654 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:17.665 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:17.665 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:17.671 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:17.671 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:18.475 INFO:teuthology.orchestra.run.smithi177.stdout:generic/494 [not run] swapfiles are not supported 2023-11-27T20:22:18.482 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/494 2023-11-27T20:22:18.483 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/494 2023-11-27T20:22:18.483 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:18.493 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:18.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:18.535 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-11-27T20:22:18.844 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:18.855 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:18.855 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:18.856 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:18.856 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:19.664 INFO:teuthology.orchestra.run.smithi177.stdout:generic/495 [not run] swapfiles are not supported 2023-11-27T20:22:19.669 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/495 2023-11-27T20:22:19.669 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/495 2023-11-27T20:22:19.669 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:19.672 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:19.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:19.723 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-11-27T20:22:20.099 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:20.103 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:20.103 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:20.105 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:20.105 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:20.991 INFO:teuthology.orchestra.run.smithi177.stdout:generic/496 [not run] swapfiles are not supported 2023-11-27T20:22:20.993 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/496 2023-11-27T20:22:20.993 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/496 2023-11-27T20:22:20.993 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:21.000 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:21.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:21.035 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-11-27T20:22:21.421 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:21.425 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:21.426 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:21.427 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:21.427 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:22.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:22.241 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:22.315 INFO:teuthology.orchestra.run.smithi177.stdout:generic/497 [not run] swapfiles are not supported 2023-11-27T20:22:22.319 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/497 2023-11-27T20:22:22.319 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/497 2023-11-27T20:22:22.319 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:22.325 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:22.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:22.367 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-11-27T20:22:22.717 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:22.721 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:22.721 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:22.722 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:22.722 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:23.251 INFO:teuthology.orchestra.run.smithi177.stdout:generic/498 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:23.257 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/498 2023-11-27T20:22:23.257 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/498 2023-11-27T20:22:23.257 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:23.260 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:23.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:23.299 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-11-27T20:22:23.643 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:23.647 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:23.647 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:23.648 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:23.648 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:24.147 INFO:teuthology.orchestra.run.smithi177.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T20:22:24.151 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/499 2023-11-27T20:22:24.151 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/499 2023-11-27T20:22:24.152 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:24.154 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:24.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:24.210 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-11-27T20:22:24.524 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:24.534 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:24.534 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:24.535 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:24.535 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:25.054 INFO:teuthology.orchestra.run.smithi177.stdout:generic/500 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:25.060 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/500 2023-11-27T20:22:25.060 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/500 2023-11-27T20:22:25.060 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:25.066 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:25.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:25.091 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-11-27T20:22:25.464 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:25.471 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:25.472 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:25.472 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:25.473 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:26.568 INFO:teuthology.orchestra.run.smithi177.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T20:22:26.576 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/501 2023-11-27T20:22:26.576 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/501 2023-11-27T20:22:26.576 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:26.584 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:26.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:26.672 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-11-27T20:22:27.020 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:27.026 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:27.026 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:27.027 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:27.027 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:27.532 INFO:teuthology.orchestra.run.smithi177.stdout:generic/502 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:27.541 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/502 2023-11-27T20:22:27.541 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/502 2023-11-27T20:22:27.541 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:27.544 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:27.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:27.589 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-11-27T20:22:27.957 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:27.962 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:27.966 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:27.967 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:27.967 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:28.482 INFO:teuthology.orchestra.run.smithi177.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T20:22:28.495 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/503 2023-11-27T20:22:28.495 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/503 2023-11-27T20:22:28.495 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:28.504 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:28.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:28.558 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-11-27T20:22:28.936 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:28.943 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:28.943 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:28.944 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:28.945 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:29.498 INFO:teuthology.orchestra.run.smithi177.stdout:generic/504 0s 2023-11-27T20:22:29.503 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/504 2023-11-27T20:22:29.504 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:29.506 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:29.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:29.543 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-11-27T20:22:29.866 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:29.874 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:29.875 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:29.876 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:29.876 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:30.610 INFO:teuthology.orchestra.run.smithi177.stdout:generic/505 [not run] ceph does not support shutdown 2023-11-27T20:22:30.630 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/505 2023-11-27T20:22:30.630 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/505 2023-11-27T20:22:30.630 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:30.632 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:30.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:30.658 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-11-27T20:22:31.013 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:31.031 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:31.031 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:31.032 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:31.032 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:31.552 INFO:teuthology.orchestra.run.smithi177.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T20:22:31.556 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/506 2023-11-27T20:22:31.556 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/506 2023-11-27T20:22:31.557 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:31.558 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:31.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:31.587 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-11-27T20:22:31.917 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:31.921 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:31.922 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:31.923 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:31.923 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:32.450 INFO:teuthology.orchestra.run.smithi177.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-27T20:22:32.457 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/507 2023-11-27T20:22:32.458 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/507 2023-11-27T20:22:32.458 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:32.467 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:32.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:32.510 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-11-27T20:22:32.849 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:32.869 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:32.870 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:32.871 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:32.871 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:33.369 INFO:teuthology.orchestra.run.smithi177.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-11-27T20:22:33.379 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/508 2023-11-27T20:22:33.380 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/508 2023-11-27T20:22:33.380 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:33.382 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:33.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:33.415 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-11-27T20:22:33.782 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:33.786 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:33.787 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:33.788 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:33.788 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:34.317 INFO:teuthology.orchestra.run.smithi177.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-11-27T20:22:34.325 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/509 2023-11-27T20:22:34.325 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/509 2023-11-27T20:22:34.325 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:34.328 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:34.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:34.363 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-11-27T20:22:34.708 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:34.715 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:34.715 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:34.716 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:34.716 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:35.249 INFO:teuthology.orchestra.run.smithi177.stdout:generic/510 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:35.255 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/510 2023-11-27T20:22:35.255 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/510 2023-11-27T20:22:35.255 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:35.256 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:35.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:35.303 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-11-27T20:22:35.651 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:35.678 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:35.679 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:35.680 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:35.680 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:36.202 INFO:teuthology.orchestra.run.smithi177.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T20:22:36.206 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/511 2023-11-27T20:22:36.207 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/511 2023-11-27T20:22:36.207 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:36.209 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:36.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:36.251 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-11-27T20:22:36.597 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:36.602 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:36.603 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:36.604 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:36.605 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:37.125 INFO:teuthology.orchestra.run.smithi177.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T20:22:37.131 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/512 2023-11-27T20:22:37.131 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/512 2023-11-27T20:22:37.131 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:37.143 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:37.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:37.174 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-11-27T20:22:37.490 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:37.502 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:37.502 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:37.503 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:37.503 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:38.554 INFO:teuthology.orchestra.run.smithi177.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T20:22:38.652 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/513 2023-11-27T20:22:38.652 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/513 2023-11-27T20:22:38.652 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:38.721 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:38.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:38.769 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-11-27T20:22:39.114 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:39.118 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:39.119 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:39.120 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:39.120 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:40.191 INFO:teuthology.orchestra.run.smithi177.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T20:22:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/514 2023-11-27T20:22:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/514 2023-11-27T20:22:40.198 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:40.208 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:40.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:40.393 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-11-27T20:22:40.784 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:40.789 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:40.789 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:40.790 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:40.790 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:41.808 INFO:teuthology.orchestra.run.smithi177.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T20:22:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/515 2023-11-27T20:22:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/515 2023-11-27T20:22:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:41.947 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:42.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:42.119 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-11-27T20:22:42.521 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:42.525 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:42.525 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:42.526 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:42.527 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:43.066 INFO:teuthology.orchestra.run.smithi177.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T20:22:43.071 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/516 2023-11-27T20:22:43.071 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/516 2023-11-27T20:22:43.071 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:43.084 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:43.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:43.297 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-11-27T20:22:43.834 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:43.838 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:43.839 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:43.843 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:43.843 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:44.598 INFO:teuthology.orchestra.run.smithi177.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T20:22:44.782 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/517 2023-11-27T20:22:44.782 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/517 2023-11-27T20:22:44.782 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:44.789 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:45.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:45.036 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-11-27T20:22:45.479 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:45.484 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:45.484 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:45.485 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:45.485 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:46.640 INFO:teuthology.orchestra.run.smithi177.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T20:22:46.669 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/518 2023-11-27T20:22:46.670 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/518 2023-11-27T20:22:46.670 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:46.689 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:46.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:46.751 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-11-27T20:22:47.151 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:47.159 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:47.160 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:47.161 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:47.161 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:47.849 INFO:teuthology.orchestra.run.smithi177.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-11-27T20:22:47.857 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/519 2023-11-27T20:22:47.858 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/519 2023-11-27T20:22:47.858 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:47.863 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:48.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:48.224 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-11-27T20:22:48.727 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:48.731 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:48.731 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:48.732 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:48.732 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:49.285 INFO:teuthology.orchestra.run.smithi177.stdout:generic/520 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T20:22:49.294 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/520 2023-11-27T20:22:49.294 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/520 2023-11-27T20:22:49.294 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T20:22:49.296 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:49.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T20:22:49.330 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-11-27T20:22:49.676 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T20:22:49.682 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T20:22:49.682 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T20:22:49.684 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T20:22:49.684 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T20:22:52.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:52.335 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:22.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:22.723 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:52.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:52.960 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:23.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:23.045 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:53.146 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:53.149 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:53.253 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T20:24:53.252+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147306) UID: 0 2023-11-27T20:24:53.254 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T20:24:53.252+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147306) UID: 0 2023-11-27T20:24:53.254 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T20:24:53.252+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147306) UID: 0 2023-11-27T20:24:53.258 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T20:24:53.256+0000 7efc559e2700 -1 Fail to open '/proc/147306/cmdline' error = (2) No such file or directory 2023-11-27T20:24:53.258 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T20:24:53.256+0000 7efc559e2700 -1 received signal: Hangup from (PID: 147306) UID: 0 2023-11-27T20:27:45.423 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:27:45.426 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:27:45.564 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T20:27:45.563+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147354) UID: 0 2023-11-27T20:27:45.564 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T20:27:45.563+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147354) UID: 0 2023-11-27T20:27:45.566 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T20:27:45.564+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 147354) UID: 0 2023-11-27T20:27:45.569 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T20:27:45.568+0000 7efc559e2700 -1 Fail to open '/proc/147354/cmdline' error = (2) No such file or directory 2023-11-27T20:27:45.569 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T20:27:45.568+0000 7efc559e2700 -1 received signal: Hangup from (PID: 147354) UID: 0 2023-11-27T20:30:42.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:30:42.753 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:13.116 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:13.123 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:43.207 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:43.210 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:13.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:13.667 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:43.738 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:43.743 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:13.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:13.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:43.913 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:43.916 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:14.018 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:14.022 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:44.110 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:44.113 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:14.263 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:14.266 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:44.462 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:44.465 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:14.560 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:14.563 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:45.050 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:45.053 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:15.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:15.190 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:45.255 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:45.258 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:45.311 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T20:37:45.310+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697014) UID: 0 2023-11-27T20:37:45.311 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T20:37:45.310+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697014) UID: 0 2023-11-27T20:37:45.312 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T20:37:45.311+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697014) UID: 0 2023-11-27T20:37:45.312 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T20:37:45.311+0000 7f29622c1700 -1 Fail to open '/proc/697014/cmdline' error = (2) No such file or directory 2023-11-27T20:37:45.312 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T20:37:45.311+0000 7f29622c1700 -1 received signal: Hangup from (PID: 697014) UID: 0 2023-11-27T20:40:37.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:37.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:37.482 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T20:40:37.482+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147813) UID: 0 2023-11-27T20:40:37.483 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T20:40:37.482+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147813) UID: 0 2023-11-27T20:40:37.483 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T20:40:37.482+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147813) UID: 0 2023-11-27T20:40:37.483 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T20:40:37.482+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147813) UID: 0 2023-11-27T20:43:29.861 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:29.864 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:59.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:59.981 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:00.051 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T20:44:00.049+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147883) UID: 0 2023-11-27T20:44:00.051 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T20:44:00.050+0000 7efc559e2700 -1 received signal: Hangup from (PID: 147883) UID: 0 2023-11-27T20:44:00.051 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T20:44:00.050+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 147883) UID: 0 2023-11-27T20:44:00.052 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T20:44:00.050+0000 7f164d737700 -1 Fail to open '/proc/147883/cmdline' error = (2) No such file or directory 2023-11-27T20:44:00.052 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T20:44:00.050+0000 7f164d737700 -1 received signal: Hangup from (PID: 147883) UID: 0 2023-11-27T20:46:53.236 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:53.241 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:23.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:25.407 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:55.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:55.489 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:55.571 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T20:47:55.570+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697233) UID: 0 2023-11-27T20:47:55.571 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T20:47:55.570+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697233) UID: 0 2023-11-27T20:47:55.572 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T20:47:55.571+0000 7efc3ee86700 -1 Fail to read '/proc/697233/cmdline' error = (3) No such process 2023-11-27T20:47:55.572 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T20:47:55.571+0000 7efc3ee86700 -1 received signal: Hangup from (PID: 697233) UID: 0 2023-11-27T20:47:55.573 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T20:47:55.570+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697233) UID: 0 2023-11-27T20:50:43.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:50:43.133 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:13.410 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:13.413 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:43.535 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:43.538 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:13.710 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:13.714 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:43.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:43.829 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:13.921 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:13.924 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:44.048 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:44.051 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:14.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:14.190 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:44.516 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:44.519 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:14.595 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:14.598 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:44.685 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:44.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:15.003 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:15.007 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:45.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:45.135 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:15.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:15.249 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:45.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:45.342 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:45.385 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T20:57:45.383+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148387) UID: 0 2023-11-27T20:57:45.385 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T20:57:45.384+0000 7f5fc2f9d700 -1 Fail to open '/proc/148387/cmdline' error = (2) No such file or directory 2023-11-27T20:57:45.386 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T20:57:45.384+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 148387) UID: 0 2023-11-27T20:57:45.386 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T20:57:45.384+0000 7f61c2af4700 -1 Fail to open '/proc/148387/cmdline' error = (2) No such file or directory 2023-11-27T20:57:45.386 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T20:57:45.384+0000 7f61c2af4700 -1 received signal: Hangup from (PID: 148387) UID: 0 2023-11-27T20:57:45.387 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T20:57:45.384+0000 7efc559e2700 -1 Fail to open '/proc/148387/cmdline' error = (2) No such file or directory 2023-11-27T20:57:45.387 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T20:57:45.384+0000 7efc559e2700 -1 received signal: Hangup from (PID: 148387) UID: 0 2023-11-27T21:00:33.444 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:33.447 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:33.619 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T21:00:33.616+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697689) UID: 0 2023-11-27T21:00:33.619 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T21:00:33.616+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697689) UID: 0 2023-11-27T21:00:33.619 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T21:00:33.616+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697689) UID: 0 2023-11-27T21:00:33.619 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T21:00:33.616+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697689) UID: 0 2023-11-27T21:03:26.822 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:26.825 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:56.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:56.992 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:27.079 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:27.082 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:57.201 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:57.204 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:27.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:27.335 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:57.486 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:57.491 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:27.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:27.611 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:57.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:57.709 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:27.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:27.795 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:27.901 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T21:07:27.900+0000 7ff5bf82d700 -1 Fail to open '/proc/697953/cmdline' error = (2) No such file or directory 2023-11-27T21:07:27.901 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T21:07:27.900+0000 7ff5bf82d700 -1 received signal: Hangup from (PID: 697953) UID: 0 2023-11-27T21:07:27.901 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T21:07:27.900+0000 7f12602ca700 -1 Fail to open '/proc/697953/cmdline' error = (2) No such file or directory 2023-11-27T21:07:27.901 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T21:07:27.900+0000 7f12602ca700 -1 received signal: Hangup from (PID: 697953) UID: 0 2023-11-27T21:10:28.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:28.713 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:59.012 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:59.016 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:29.415 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:29.417 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:59.573 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:59.581 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:30.064 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:30.067 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:00.191 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:00.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:30.297 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:30.302 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:30.351 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T21:13:30.348+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 698160) UID: 0 2023-11-27T21:13:30.351 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T21:13:30.348+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 698160) UID: 0 2023-11-27T21:13:30.352 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T21:13:30.350+0000 7f28d87cf700 -1 Fail to open '/proc/698160/cmdline' error = (2) No such file or directory 2023-11-27T21:13:30.352 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T21:13:30.350+0000 7f28d87cf700 -1 received signal: Hangup from (PID: 698160) UID: 0 2023-11-27T21:13:30.352 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T21:13:30.350+0000 7efc3ee86700 -1 Fail to open '/proc/698160/cmdline' error = (2) No such file or directory 2023-11-27T21:13:30.352 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T21:13:30.350+0000 7efc3ee86700 -1 received signal: Hangup from (PID: 698160) UID: 0 2023-11-27T21:16:22.396 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:22.403 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:52.582 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:52.585 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:22.690 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:22.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:52.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:52.812 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:22.914 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:22.918 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:53.127 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:53.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:23.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:23.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:53.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:53.425 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:23.833 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:23.835 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:53.907 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:53.916 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:54.043 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T21:20:54.041+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149367) UID: 0 2023-11-27T21:20:54.044 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T21:20:54.041+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149367) UID: 0 2023-11-27T21:20:54.045 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T21:20:54.043+0000 7efc559e2700 -1 Fail to open '/proc/149367/cmdline' error = (2) No such file or directory 2023-11-27T21:20:54.045 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T21:20:54.043+0000 7efc559e2700 -1 received signal: Hangup from (PID: 149367) UID: 0 2023-11-27T21:20:54.045 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T21:20:54.044+0000 7f164d737700 -1 Fail to open '/proc/149367/cmdline' error = (2) No such file or directory 2023-11-27T21:20:54.045 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T21:20:54.044+0000 7f164d737700 -1 received signal: Hangup from (PID: 149367) UID: 0 2023-11-27T21:23:53.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:53.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:53.116 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T21:23:53.115+0000 7f29622c1700 -1 Fail to open '/proc/698485/cmdline' error = (2) No such file or directory 2023-11-27T21:23:53.117 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T21:23:53.115+0000 7f29622c1700 -1 received signal: Hangup from (PID: 698485) UID: 0 2023-11-27T21:23:53.117 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T21:23:53.115+0000 7efc3ee86700 -1 Fail to open '/proc/698485/cmdline' error = (2) No such file or directory 2023-11-27T21:23:53.117 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T21:23:53.115+0000 7efc3ee86700 -1 received signal: Hangup from (PID: 698485) UID: 0 2023-11-27T21:23:53.117 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T21:23:53.115+0000 7f8f0e69b700 -1 Fail to open '/proc/698485/cmdline' error = (2) No such file or directory 2023-11-27T21:23:53.117 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T21:23:53.115+0000 7f8f0e69b700 -1 received signal: Hangup from (PID: 698485) UID: 0 2023-11-27T21:23:53.118 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T21:23:53.115+0000 7f28d87cf700 -1 Fail to open '/proc/698485/cmdline' error = (2) No such file or directory 2023-11-27T21:23:53.118 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T21:23:53.115+0000 7f28d87cf700 -1 received signal: Hangup from (PID: 698485) UID: 0 2023-11-27T21:26:51.849 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:51.855 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:21.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:21.927 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:52.031 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:52.034 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:22.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:22.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:52.244 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:52.247 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:22.629 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:22.632 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:52.725 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:52.728 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:22.855 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:22.858 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:52.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:52.961 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:53.012 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T21:30:53.010+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149670) UID: 0 2023-11-27T21:30:53.012 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T21:30:53.010+0000 7f5fc2f9d700 -1 Fail to open '/proc/149670/cmdline' error = (2) No such file or directory 2023-11-27T21:30:53.013 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T21:30:53.010+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 149670) UID: 0 2023-11-27T21:30:53.013 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T21:30:53.011+0000 7f164d737700 -1 Fail to open '/proc/149670/cmdline' error = (2) No such file or directory 2023-11-27T21:30:53.013 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T21:30:53.011+0000 7f164d737700 -1 received signal: Hangup from (PID: 149670) UID: 0 2023-11-27T21:30:53.014 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T21:30:53.011+0000 7efc559e2700 -1 Fail to open '/proc/149670/cmdline' error = (2) No such file or directory 2023-11-27T21:30:53.014 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T21:30:53.011+0000 7efc559e2700 -1 received signal: Hangup from (PID: 149670) UID: 0 2023-11-27T21:33:44.300 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:33:44.303 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:33:44.356 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T21:33:44.354+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149721) UID: 0 2023-11-27T21:33:44.357 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T21:33:44.354+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149721) UID: 0 2023-11-27T21:33:44.358 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T21:33:44.355+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149721) UID: 0 2023-11-27T21:33:44.358 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T21:33:44.354+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149721) UID: 0 2023-11-27T21:36:34.518 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:36:34.521 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:36:34.613 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T21:36:34.611+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 698835) UID: 0 2023-11-27T21:36:34.613 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T21:36:34.611+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 698835) UID: 0 2023-11-27T21:36:34.613 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T21:36:34.611+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 698835) UID: 0 2023-11-27T21:36:34.614 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T21:36:34.611+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 698835) UID: 0 2023-11-27T21:39:28.313 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:28.320 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:58.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:58.629 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:28.738 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:28.745 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:58.840 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:58.843 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:28.932 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:28.935 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:59.068 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:59.072 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:42:29.177 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:42:29.938 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:00.023 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:00.026 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:30.331 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:30.334 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:00.404 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:00.407 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:30.539 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:30.542 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:00.959 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:00.962 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:31.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:31.069 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:01.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:01.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:31.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:31.272 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:01.372 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:01.375 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:31.471 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:31.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:01.651 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:01.659 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:31.781 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:31.786 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:01.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:01.896 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:31.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:31.992 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:02.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:02.152 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:32.579 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:32.581 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:02.661 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:02.664 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:32.783 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:32.785 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:02.936 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:02.939 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:33.225 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:33.228 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:03.331 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:03.333 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:33.410 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:33.414 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:03.498 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:03.500 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:33.678 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:33.680 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:03.950 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:03.952 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:34.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:34.041 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:04.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:04.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:34.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:34.279 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:04.580 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:04.583 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:35.104 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:35.109 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:05.224 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:05.227 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:35.553 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:35.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:05.946 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:05.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:36.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:36.045 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:06.360 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:06.363 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:36.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:36.455 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:06.546 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:06.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:36.642 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:36.645 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:06.709 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:06.715 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:36.838 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:36.840 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:07.003 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:07.005 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:07.214 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T22:03:07.210+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151022) UID: 0 2023-11-27T22:03:07.215 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T22:03:07.211+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151022) UID: 0 2023-11-27T22:03:07.215 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:03:07.211+0000 7efc559e2700 -1 Fail to open '/proc/151022/cmdline' error = (2) No such file or directory 2023-11-27T22:03:07.215 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:03:07.211+0000 7efc559e2700 -1 received signal: Hangup from (PID: 151022) UID: 0 2023-11-27T22:03:07.215 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T22:03:07.211+0000 7f61c2af4700 -1 Fail to open '/proc/151022/cmdline' error = (2) No such file or directory 2023-11-27T22:03:07.215 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T22:03:07.211+0000 7f61c2af4700 -1 received signal: Hangup from (PID: 151022) UID: 0 2023-11-27T22:06:07.672 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:06:07.675 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:06:07.716 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:06:07.715+0000 7efc559e2700 -1 Fail to open '/proc/151072/cmdline' error = (2) No such file or directory 2023-11-27T22:06:07.716 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:06:07.715+0000 7efc559e2700 -1 received signal: Hangup from (PID: 151072) UID: 0 2023-11-27T22:06:07.716 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T22:06:07.715+0000 7f164d737700 -1 Fail to open '/proc/151072/cmdline' error = (2) No such file or directory 2023-11-27T22:06:07.717 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T22:06:07.715+0000 7f164d737700 -1 received signal: Hangup from (PID: 151072) UID: 0 2023-11-27T22:06:07.717 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T22:06:07.716+0000 7f61c2af4700 -1 Fail to open '/proc/151072/cmdline' error = (2) No such file or directory 2023-11-27T22:06:07.717 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T22:06:07.716+0000 7f61c2af4700 -1 received signal: Hangup from (PID: 151072) UID: 0 2023-11-27T22:06:07.719 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T22:06:07.716+0000 7f5fc2f9d700 -1 Fail to open '/proc/151072/cmdline' error = (2) No such file or directory 2023-11-27T22:06:07.719 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T22:06:07.716+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 151072) UID: 0 2023-11-27T22:07:35.841 INFO:teuthology.orchestra.run.smithi177.stdout:generic/521 6286s 2023-11-27T22:07:35.861 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/521 2023-11-27T22:07:35.861 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T22:07:35.863 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T22:07:36.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:07:36.195 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-11-27T22:07:36.877 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T22:07:36.882 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T22:07:36.883 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T22:07:36.884 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T22:07:36.884 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T22:09:03.786 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:09:03.789 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:09:04.065 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T22:09:04.063+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700676) UID: 0 2023-11-27T22:09:04.066 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T22:09:04.063+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700676) UID: 0 2023-11-27T22:09:04.067 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T22:09:04.063+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700676) UID: 0 2023-11-27T22:09:04.071 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T22:09:04.063+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700676) UID: 0 2023-11-27T22:11:58.367 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:11:58.370 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:28.510 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:28.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:28.582 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T22:12:28.581+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151201) UID: 0 2023-11-27T22:12:28.583 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T22:12:28.581+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151201) UID: 0 2023-11-27T22:12:28.586 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T22:12:28.581+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151201) UID: 0 2023-11-27T22:12:28.586 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:12:28.581+0000 7efc559e2700 -1 Fail to open '/proc/151201/cmdline' error = (2) No such file or directory 2023-11-27T22:12:28.586 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:12:28.581+0000 7efc559e2700 -1 received signal: Hangup from (PID: 151201) UID: 0 2023-11-27T22:15:17.416 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:17.419 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:47.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:47.636 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:17.957 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:17.961 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:48.278 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:48.280 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:18.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:18.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:48.517 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:48.523 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:18.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:18.620 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:18.673 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T22:18:18.671+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700949) UID: 0 2023-11-27T22:18:18.674 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T22:18:18.672+0000 7f29622c1700 -1 Fail to open '/proc/700949/cmdline' error = (2) No such file or directory 2023-11-27T22:18:18.674 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T22:18:18.672+0000 7f29622c1700 -1 received signal: Hangup from (PID: 700949) UID: 0 2023-11-27T22:18:18.675 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T22:18:18.672+0000 7efc3ee86700 -1 Fail to open '/proc/700949/cmdline' error = (2) No such file or directory 2023-11-27T22:18:18.675 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T22:18:18.672+0000 7efc3ee86700 -1 received signal: Hangup from (PID: 700949) UID: 0 2023-11-27T22:18:18.675 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T22:18:18.672+0000 7f28d87cf700 -1 Fail to open '/proc/700949/cmdline' error = (2) No such file or directory 2023-11-27T22:18:18.675 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T22:18:18.672+0000 7f28d87cf700 -1 received signal: Hangup from (PID: 700949) UID: 0 2023-11-27T22:18:18.679 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T22:18:18.677+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151395) UID: 0 2023-11-27T22:18:18.679 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T22:18:18.677+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151395) UID: 0 2023-11-27T22:18:18.680 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T22:18:18.677+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151395) UID: 0 2023-11-27T22:18:18.683 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:18:18.681+0000 7efc559e2700 -1 Fail to open '/proc/151395/cmdline' error = (2) No such file or directory 2023-11-27T22:18:18.683 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:18:18.681+0000 7efc559e2700 -1 received signal: Hangup from (PID: 151395) UID: 0 2023-11-27T22:21:11.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:11.613 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:41.937 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:41.940 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:12.222 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:12.225 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:42.316 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:42.318 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:12.416 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:12.418 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:42.780 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:42.811 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:42.856 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T22:23:42.854+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701132) UID: 0 2023-11-27T22:23:42.857 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T22:23:42.854+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701132) UID: 0 2023-11-27T22:23:42.857 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T22:23:42.854+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701132) UID: 0 2023-11-27T22:23:42.857 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T22:23:42.854+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701132) UID: 0 2023-11-27T22:26:33.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:26:33.710 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:03.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:03.891 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:33.985 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:33.987 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:04.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:04.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:34.183 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:34.186 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:04.300 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:04.303 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:34.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:34.421 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:04.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:04.512 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:34.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:34.608 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:04.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:04.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:34.864 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:34.867 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:34.931 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T22:31:34.929+0000 7f12602ca700 -1 received signal: Hangup from (PID: 701439) UID: 0 2023-11-27T22:31:34.931 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T22:31:34.928+0000 7ff5bf82d700 -1 received signal: Hangup from (PID: 701439) UID: 0 2023-11-27T22:34:11.587 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T22:34:11.585+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701459) UID: 0 2023-11-27T22:34:11.588 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T22:34:11.585+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701459) UID: 0 2023-11-27T22:34:11.588 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T22:34:11.585+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701459) UID: 0 2023-11-27T22:34:11.588 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T22:34:11.586+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701459) UID: 0 2023-11-27T22:37:12.366 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:12.369 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:42.618 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:42.621 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:12.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:12.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:42.825 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:42.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:12.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:12.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:43.260 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:43.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:13.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:13.339 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:43.446 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:43.451 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:13.535 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:13.538 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:43.672 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:43.676 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:13.817 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:13.820 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:43.935 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:43.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:14.024 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:14.026 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:44.179 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:44.186 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:14.528 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:14.532 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:44.605 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:44.608 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:14.710 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:14.716 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:45.098 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:45.100 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:15.185 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:15.188 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:45.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:45.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:15.489 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:15.492 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:45.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:45.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:15.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:15.942 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:46.030 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:46.034 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:16.160 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:16.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:46.342 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:46.345 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:16.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:16.517 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:46.615 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:46.619 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:16.712 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:16.715 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:47.033 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:47.038 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:47.103 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T22:51:47.102+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152693) UID: 0 2023-11-27T22:51:47.104 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T22:51:47.102+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152693) UID: 0 2023-11-27T22:51:47.104 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T22:51:47.102+0000 7f5fc2f9d700 -1 Fail to open '/proc/152693/cmdline' error = (2) No such file or directory 2023-11-27T22:51:47.104 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T22:51:47.102+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 152693) UID: 0 2023-11-27T22:51:47.106 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:51:47.105+0000 7efc559e2700 -1 Fail to open '/proc/152693/cmdline' error = (2) No such file or directory 2023-11-27T22:51:47.106 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:51:47.105+0000 7efc559e2700 -1 received signal: Hangup from (PID: 152693) UID: 0 2023-11-27T22:54:38.384 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:38.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:38.462 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:54:38.460+0000 7efc559e2700 -1 Fail to open '/proc/152743/cmdline' error = (2) No such file or directory 2023-11-27T22:54:38.462 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T22:54:38.460+0000 7efc559e2700 -1 received signal: Hangup from (PID: 152743) UID: 0 2023-11-27T22:54:38.463 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T22:54:38.460+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152743) UID: 0 2023-11-27T22:54:38.463 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T22:54:38.460+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152743) UID: 0 2023-11-27T22:54:38.463 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T22:54:38.460+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152743) UID: 0 2023-11-27T22:57:38.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:38.669 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:08.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:08.813 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:39.231 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:39.234 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:09.315 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:09.320 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:39.451 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:39.455 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:09.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:09.609 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:09.664 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T23:00:09.662+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 702476) UID: 0 2023-11-27T23:00:09.664 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T23:00:09.663+0000 7f8f0e69b700 -1 Fail to open '/proc/702476/cmdline' error = (2) No such file or directory 2023-11-27T23:00:09.664 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T23:00:09.663+0000 7f8f0e69b700 -1 received signal: Hangup from (PID: 702476) UID: 0 2023-11-27T23:00:09.665 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T23:00:09.663+0000 7f29622c1700 -1 Fail to open '/proc/702476/cmdline' error = (2) No such file or directory 2023-11-27T23:00:09.665 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T23:00:09.663+0000 7f29622c1700 -1 received signal: Hangup from (PID: 702476) UID: 0 2023-11-27T23:00:09.665 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T23:00:09.663+0000 7f28d87cf700 -1 Fail to open '/proc/702476/cmdline' error = (2) No such file or directory 2023-11-27T23:00:09.665 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T23:00:09.663+0000 7f28d87cf700 -1 received signal: Hangup from (PID: 702476) UID: 0 2023-11-27T23:03:07.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:07.464 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:37.754 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:37.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:07.857 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:07.860 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:37.981 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:37.988 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:08.094 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:08.097 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:08.171 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T23:05:08.169+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153080) UID: 0 2023-11-27T23:05:08.171 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T23:05:08.169+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153080) UID: 0 2023-11-27T23:05:08.171 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T23:05:08.169+0000 7f5fc2f9d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153080) UID: 0 2023-11-27T23:05:08.172 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T23:05:08.171+0000 7efc559e2700 -1 Fail to open '/proc/153080/cmdline' error = (2) No such file or directory 2023-11-27T23:05:08.172 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T23:05:08.171+0000 7efc559e2700 -1 received signal: Hangup from (PID: 153080) UID: 0 2023-11-27T23:07:59.712 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:07:59.715 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:29.861 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:29.863 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:00.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:00.003 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:30.112 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:30.115 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:00.364 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:00.367 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:30.731 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:30.733 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:00.862 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:00.865 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:30.975 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:30.982 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:31.056 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T23:11:31.056+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 702870) UID: 0 2023-11-27T23:11:31.057 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T23:11:31.056+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 702870) UID: 0 2023-11-27T23:11:31.057 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T23:11:31.057+0000 7f29622c1700 -1 Fail to open '/proc/702870/cmdline' error = (2) No such file or directory 2023-11-27T23:11:31.057 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T23:11:31.057+0000 7f29622c1700 -1 received signal: Hangup from (PID: 702870) UID: 0 2023-11-27T23:11:31.058 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T23:11:31.057+0000 7efc3ee86700 -1 Fail to open '/proc/702870/cmdline' error = (2) No such file or directory 2023-11-27T23:11:31.058 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T23:11:31.057+0000 7efc3ee86700 -1 received signal: Hangup from (PID: 702870) UID: 0 2023-11-27T23:13:37.453 INFO:teuthology.orchestra.run.smithi177.stdout:generic/522 3960s 2023-11-27T23:13:37.496 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/522 2023-11-27T23:13:37.496 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:37.498 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:37.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:37.564 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-11-27T23:13:38.450 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:38.454 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:38.455 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:38.456 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:38.456 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:39.511 INFO:teuthology.orchestra.run.smithi177.stdout:generic/523 1s 2023-11-27T23:13:39.520 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/523 2023-11-27T23:13:39.520 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:39.524 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:39.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:39.537 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-11-27T23:13:39.986 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:39.995 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:39.995 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:39.997 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:39.997 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:46.435 INFO:teuthology.orchestra.run.smithi177.stdout:generic/524 6s 2023-11-27T23:13:46.441 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/524 2023-11-27T23:13:46.441 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:46.444 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:46.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:46.456 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-11-27T23:13:46.892 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:46.896 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:46.897 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:46.900 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:46.900 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:47.736 INFO:teuthology.orchestra.run.smithi177.stdout:generic/525 [not run] filesystem does not support huge file size 2023-11-27T23:13:47.768 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/525 2023-11-27T23:13:47.768 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/525 2023-11-27T23:13:47.768 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:47.770 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:47.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:47.814 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-11-27T23:13:48.323 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:48.328 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:48.328 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:48.329 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:48.329 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:49.064 INFO:teuthology.orchestra.run.smithi177.stdout:generic/526 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:13:51.825 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/526 2023-11-27T23:13:51.825 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/526 2023-11-27T23:13:51.825 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:51.826 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:51.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:51.826 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-11-27T23:13:52.226 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:52.230 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:52.230 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:52.233 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:52.233 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:52.782 INFO:teuthology.orchestra.run.smithi177.stdout:generic/527 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:13:52.788 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/527 2023-11-27T23:13:52.788 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/527 2023-11-27T23:13:52.788 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:52.790 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:52.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:52.849 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-11-27T23:13:53.294 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:53.305 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:53.305 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:53.306 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:53.306 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:54.098 INFO:teuthology.orchestra.run.smithi177.stdout:generic/528 1s 2023-11-27T23:13:54.105 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/528 2023-11-27T23:13:54.105 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:54.107 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:54.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:54.583 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-11-27T23:13:55.011 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:55.018 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:55.018 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:55.019 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:55.019 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:56.163 INFO:teuthology.orchestra.run.smithi177.stdout:generic/529 1s 2023-11-27T23:13:56.171 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/529 2023-11-27T23:13:56.171 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:56.173 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:56.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:56.188 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-11-27T23:13:56.538 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:56.543 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:56.545 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:56.547 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:56.547 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:57.301 INFO:teuthology.orchestra.run.smithi177.stdout:generic/530 [not run] ceph does not support shutdown 2023-11-27T23:13:57.336 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/530 2023-11-27T23:13:57.336 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/530 2023-11-27T23:13:57.336 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:57.338 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:57.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:57.389 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-11-27T23:13:57.752 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:57.759 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:57.763 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:57.764 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:57.764 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:58.243 INFO:teuthology.orchestra.run.smithi177.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-11-27T23:13:58.248 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/531 2023-11-27T23:13:58.248 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/531 2023-11-27T23:13:58.248 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:58.250 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:58.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:58.296 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-11-27T23:13:58.630 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:58.637 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:58.637 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:58.639 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:58.639 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:59.159 INFO:teuthology.orchestra.run.smithi177.stdout:generic/532 1s 2023-11-27T23:13:59.170 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/532 2023-11-27T23:13:59.170 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:13:59.181 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:13:59.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:59.230 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-11-27T23:13:59.545 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:13:59.555 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:13:59.555 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:13:59.556 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:13:59.556 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:00.784 INFO:teuthology.orchestra.run.smithi177.stdout:generic/533 1s 2023-11-27T23:14:00.791 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/533 2023-11-27T23:14:00.791 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:14:00.794 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:00.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:14:00.826 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-11-27T23:14:01.187 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:14:01.192 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:14:01.192 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:14:01.193 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:14:01.193 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:01.681 INFO:teuthology.orchestra.run.smithi177.stdout:generic/534 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:14:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/534 2023-11-27T23:14:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/534 2023-11-27T23:14:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:14:01.689 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:01.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:14:01.723 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-11-27T23:14:02.079 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:14:02.089 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:14:02.089 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:14:02.090 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:14:02.090 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:02.584 INFO:teuthology.orchestra.run.smithi177.stdout:generic/535 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:14:02.592 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/535 2023-11-27T23:14:02.592 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/535 2023-11-27T23:14:02.592 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:14:02.595 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:02.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:14:02.616 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-11-27T23:14:02.959 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:14:02.965 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:14:02.965 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:14:02.966 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:14:02.966 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:03.664 INFO:teuthology.orchestra.run.smithi177.stdout:generic/536 [not run] ceph does not support shutdown 2023-11-27T23:14:03.686 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/536 2023-11-27T23:14:03.686 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/536 2023-11-27T23:14:03.687 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:14:03.688 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:03.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:14:03.716 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-11-27T23:14:04.023 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:14:04.027 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:14:04.028 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:14:04.029 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:14:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:04.708 INFO:teuthology.orchestra.run.smithi177.stdout:generic/537 [not run] FSTRIM not supported 2023-11-27T23:14:04.737 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/537 2023-11-27T23:14:04.737 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/537 2023-11-27T23:14:04.737 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:14:04.740 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:04.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:14:04.780 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-11-27T23:14:05.098 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:14:05.107 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:14:05.107 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:14:05.108 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:14:05.108 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:14:25.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:25.775 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:55.918 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:55.920 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:26.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:26.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:56.130 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:56.133 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:26.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:26.627 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:26.669 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-11-27T23:16:26.668+0000 7f8f0e69b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 712984) UID: 0 2023-11-27T23:16:26.669 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-11-27T23:16:26.668+0000 7efc3ee86700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 712984) UID: 0 2023-11-27T23:16:26.670 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-11-27T23:16:26.668+0000 7f29622c1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 712984) UID: 0 2023-11-27T23:16:26.670 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-11-27T23:16:26.668+0000 7f28d87cf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 712984) UID: 0 2023-11-27T23:19:20.348 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:20.354 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:50.513 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:50.516 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:20.837 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:20.840 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:50.959 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:50.962 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:21.032 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:21.035 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:51.220 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:51.223 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:21.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:21.311 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:51.390 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:51.393 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:52.582 INFO:teuthology.orchestra.run.smithi177.stdout:generic/538 527s 2023-11-27T23:22:52.588 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/538 2023-11-27T23:22:52.588 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:22:52.590 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:22:53.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:22:53.013 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-11-27T23:22:53.446 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:22:53.451 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:22:53.451 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:22:53.452 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:22:53.452 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:22:55.909 INFO:teuthology.orchestra.run.smithi177.stdout:generic/539 2s 2023-11-27T23:22:55.920 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/539 2023-11-27T23:22:55.920 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:22:55.926 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:22:56.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:22:56.248 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-11-27T23:22:56.665 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:22:56.670 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:22:56.670 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:22:56.671 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:22:56.671 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:22:57.716 INFO:teuthology.orchestra.run.smithi177.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:22:57.834 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/540 2023-11-27T23:22:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/540 2023-11-27T23:22:57.835 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:22:57.872 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:22:57.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:22:57.945 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-11-27T23:22:58.303 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:22:58.308 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:22:58.308 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:22:58.309 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:22:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:22:59.320 INFO:teuthology.orchestra.run.smithi177.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:22:59.388 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/541 2023-11-27T23:22:59.388 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/541 2023-11-27T23:22:59.388 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:22:59.404 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:22:59.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:22:59.518 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-11-27T23:22:59.886 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:22:59.890 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:22:59.890 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:22:59.891 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:22:59.892 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:00.851 INFO:teuthology.orchestra.run.smithi177.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:23:00.972 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/542 2023-11-27T23:23:00.973 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/542 2023-11-27T23:23:00.973 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:00.997 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:01.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:01.107 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-11-27T23:23:01.458 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:01.470 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:01.470 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:01.471 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:01.471 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:02.686 INFO:teuthology.orchestra.run.smithi177.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:23:02.711 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/543 2023-11-27T23:23:02.712 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/543 2023-11-27T23:23:02.712 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:02.725 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:02.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:02.833 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-11-27T23:23:03.182 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:03.187 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:03.187 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:03.188 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:03.188 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:04.232 INFO:teuthology.orchestra.run.smithi177.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:23:04.381 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/544 2023-11-27T23:23:04.381 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/544 2023-11-27T23:23:04.381 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:04.385 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:04.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:04.442 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-11-27T23:23:04.805 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:04.810 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:04.810 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:04.811 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:04.812 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:05.386 INFO:teuthology.orchestra.run.smithi177.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-11-27T23:23:05.391 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/545 2023-11-27T23:23:05.391 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/545 2023-11-27T23:23:05.391 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:05.394 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:05.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:05.440 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-11-27T23:23:05.794 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:05.799 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:05.803 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:05.805 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:05.805 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:06.402 INFO:teuthology.orchestra.run.smithi177.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T23:23:06.406 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/546 2023-11-27T23:23:06.406 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/546 2023-11-27T23:23:06.407 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:06.409 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:06.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:06.448 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-11-27T23:23:06.846 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:06.856 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:06.856 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:06.857 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:06.858 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:07.373 INFO:teuthology.orchestra.run.smithi177.stdout:generic/547 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:23:07.378 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/547 2023-11-27T23:23:07.378 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/547 2023-11-27T23:23:07.378 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:07.380 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:07.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:07.415 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-11-27T23:23:07.811 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:07.815 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:07.816 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:07.817 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:07.817 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:08.594 INFO:teuthology.orchestra.run.smithi177.stdout:generic/548 [not run] kernel does not support ceph encryption 2023-11-27T23:23:08.621 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/548 2023-11-27T23:23:08.621 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/548 2023-11-27T23:23:08.621 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:08.623 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:08.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:08.660 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-11-27T23:23:08.990 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:08.995 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:08.995 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:08.996 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:08.996 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:09.803 INFO:teuthology.orchestra.run.smithi177.stdout:generic/549 [not run] kernel does not support ceph encryption 2023-11-27T23:23:09.829 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/549 2023-11-27T23:23:09.829 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/549 2023-11-27T23:23:09.829 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:09.837 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:09.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:09.870 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-11-27T23:23:10.271 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:10.279 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:10.279 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:10.280 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:10.280 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:11.017 INFO:teuthology.orchestra.run.smithi177.stdout:generic/550 [not run] kernel does not support ceph encryption 2023-11-27T23:23:11.056 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/550 2023-11-27T23:23:11.056 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/550 2023-11-27T23:23:11.056 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:23:11.058 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:11.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:23:11.095 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-11-27T23:23:11.438 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:23:11.446 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:23:11.447 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:23:11.448 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:23:11.448 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:23:21.495 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:21.501 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:51.854 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:51.862 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:21.976 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:21.979 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:52.462 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:52.472 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:22.961 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:22.966 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:53.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:53.082 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:23.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:23.164 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:53.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:53.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:23.512 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:23.515 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:53.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:55.077 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:25.337 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:25.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:55.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:55.467 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:25.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:25.755 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:25.821 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T23:29:25.820+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154145) UID: 0 2023-11-27T23:29:25.821 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T23:29:25.820+0000 7efc559e2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154145) UID: 0 2023-11-27T23:29:25.822 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T23:29:25.820+0000 7f164d737700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154145) UID: 0 2023-11-27T23:29:25.822 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T23:29:25.821+0000 7f5fc2f9d700 -1 Fail to open '/proc/154145/cmdline' error = (2) No such file or directory 2023-11-27T23:29:25.822 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T23:29:25.821+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 154145) UID: 0 2023-11-27T23:32:15.453 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:15.475 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:15.739 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-27T23:32:15.738+0000 7f61c2af4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154191) UID: 0 2023-11-27T23:32:15.742 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-27T23:32:15.739+0000 7f164d737700 -1 received signal: Hangup from (PID: 154191) UID: 0 2023-11-27T23:32:15.742 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-27T23:32:15.739+0000 7efc559e2700 -1 received signal: Hangup from (PID: 154191) UID: 0 2023-11-27T23:32:15.743 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-27T23:32:15.742+0000 7f5fc2f9d700 -1 received signal: Hangup from (PID: 154191) UID: 0 2023-11-27T23:34:46.672 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:46.680 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:16.840 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:16.843 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:46.972 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:46.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:17.110 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:17.113 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:47.281 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:47.284 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:17.363 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:17.365 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:38.907 INFO:teuthology.orchestra.run.smithi177.stdout:generic/551 867s 2023-11-27T23:37:38.927 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/551 2023-11-27T23:37:38.927 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:38.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:38.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:38.939 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-11-27T23:37:39.336 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:39.340 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:39.340 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:39.341 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:39.341 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:39.774 INFO:teuthology.orchestra.run.smithi177.stdout:generic/552 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:37:39.778 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/552 2023-11-27T23:37:39.778 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/552 2023-11-27T23:37:39.779 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:39.781 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:39.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:39.817 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-11-27T23:37:40.025 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:40.029 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:40.029 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:40.030 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:40.030 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:40.408 INFO:teuthology.orchestra.run.smithi177.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-11-27T23:37:40.412 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/553 2023-11-27T23:37:40.412 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/553 2023-11-27T23:37:40.412 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:40.414 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:40.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:40.817 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-11-27T23:37:41.117 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:41.122 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:41.122 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:41.123 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:41.123 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:41.782 INFO:teuthology.orchestra.run.smithi177.stdout:generic/554 [not run] swapfiles are not supported 2023-11-27T23:37:41.786 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/554 2023-11-27T23:37:41.786 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/554 2023-11-27T23:37:41.786 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:41.788 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:42.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:42.127 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-11-27T23:37:42.417 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:42.421 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:42.422 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:42.423 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:42.423 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:42.890 INFO:teuthology.orchestra.run.smithi177.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-11-27T23:37:42.894 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/555 2023-11-27T23:37:42.894 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/555 2023-11-27T23:37:42.894 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:42.896 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:43.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:43.007 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-11-27T23:37:43.523 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:43.527 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:43.528 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:43.529 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:43.529 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:43.869 INFO:teuthology.orchestra.run.smithi177.stdout:generic/556 [not run] ceph does not support casefold feature 2023-11-27T23:37:43.873 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/556 2023-11-27T23:37:43.873 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/556 2023-11-27T23:37:43.873 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:43.875 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:43.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:43.899 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-11-27T23:37:44.109 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:44.114 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:44.114 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:44.115 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:44.115 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:44.460 INFO:teuthology.orchestra.run.smithi177.stdout:generic/557 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:37:44.464 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/557 2023-11-27T23:37:44.464 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/557 2023-11-27T23:37:44.464 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:44.466 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:44.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:44.503 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-11-27T23:37:44.719 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:44.723 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:44.724 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:44.725 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:44.725 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:45.071 INFO:teuthology.orchestra.run.smithi177.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T23:37:45.075 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/558 2023-11-27T23:37:45.075 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/558 2023-11-27T23:37:45.075 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:45.077 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:45.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:45.098 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-11-27T23:37:45.307 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:45.311 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:45.311 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:45.313 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:45.313 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:45.650 INFO:teuthology.orchestra.run.smithi177.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-11-27T23:37:45.654 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/559 2023-11-27T23:37:45.654 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/559 2023-11-27T23:37:45.654 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:45.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:45.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:45.687 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-11-27T23:37:45.896 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:45.900 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:45.901 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:45.902 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:45.902 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:46.245 INFO:teuthology.orchestra.run.smithi177.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-11-27T23:37:46.249 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/560 2023-11-27T23:37:46.249 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/560 2023-11-27T23:37:46.249 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:46.251 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:46.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:46.280 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-11-27T23:37:46.489 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:46.493 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:46.494 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:46.495 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:46.495 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:46.836 INFO:teuthology.orchestra.run.smithi177.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-11-27T23:37:46.840 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/561 2023-11-27T23:37:46.840 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/561 2023-11-27T23:37:46.840 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:46.842 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:46.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:46.873 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-11-27T23:37:47.081 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:47.085 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:47.085 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:47.086 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:47.086 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:47.516 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:47.518 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:47.962 INFO:teuthology.orchestra.run.smithi177.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:37:48.021 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/562 2023-11-27T23:37:48.022 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/562 2023-11-27T23:37:48.022 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:48.025 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:48.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:48.074 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-11-27T23:37:48.278 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:48.283 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:48.283 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:48.284 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:48.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:48.641 INFO:teuthology.orchestra.run.smithi177.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-11-27T23:37:48.645 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/563 2023-11-27T23:37:48.645 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/563 2023-11-27T23:37:48.645 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:48.647 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:48.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:48.683 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-11-27T23:37:48.889 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:48.893 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:48.893 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:48.894 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:48.894 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:49.309 INFO:teuthology.orchestra.run.smithi177.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-11-27T23:37:49.313 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/564 2023-11-27T23:37:49.313 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/564 2023-11-27T23:37:49.313 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:49.315 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:49.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:49.560 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-11-27T23:37:49.957 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:49.961 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:49.962 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:49.963 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:49.963 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:50.588 INFO:teuthology.orchestra.run.smithi177.stdout:generic/565 0s 2023-11-27T23:37:50.592 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/565 2023-11-27T23:37:50.593 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:50.595 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:50.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:50.945 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-11-27T23:37:51.215 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:51.220 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:51.220 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:51.221 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:51.221 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:51.573 INFO:teuthology.orchestra.run.smithi177.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T23:37:51.577 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/566 2023-11-27T23:37:51.577 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/566 2023-11-27T23:37:51.577 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:51.579 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:51.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:51.610 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-11-27T23:37:51.814 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:51.818 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:51.818 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:51.819 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:51.820 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:52.601 INFO:teuthology.orchestra.run.smithi177.stdout:generic/567 0s 2023-11-27T23:37:52.606 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/567 2023-11-27T23:37:52.606 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:52.608 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:52.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:52.617 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-11-27T23:37:52.827 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:52.831 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:52.831 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:52.832 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:52.833 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:53.187 INFO:teuthology.orchestra.run.smithi177.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T23:37:53.191 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/568 2023-11-27T23:37:53.191 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/568 2023-11-27T23:37:53.191 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:53.193 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:53.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:53.233 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-11-27T23:37:53.439 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:53.443 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:53.444 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:53.445 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:53.445 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:53.798 INFO:teuthology.orchestra.run.smithi177.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T23:37:53.802 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/569 2023-11-27T23:37:53.802 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/569 2023-11-27T23:37:53.802 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:53.804 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:53.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:53.834 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-11-27T23:37:54.046 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:54.050 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:54.051 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:54.052 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:54.052 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:54.374 INFO:teuthology.orchestra.run.smithi177.stdout:generic/570 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:37:54.377 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/570 2023-11-27T23:37:54.377 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/570 2023-11-27T23:37:54.378 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:54.380 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:54.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:54.409 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-11-27T23:37:54.621 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:54.625 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:54.626 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:54.627 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:54.627 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:54.983 INFO:teuthology.orchestra.run.smithi177.stdout:generic/571 [not run] Require fcntl setlease support 2023-11-27T23:37:54.987 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/571 2023-11-27T23:37:54.987 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/571 2023-11-27T23:37:54.988 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:54.989 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:55.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:55.019 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-11-27T23:37:55.237 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:55.241 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:55.242 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:55.243 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:55.243 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:55.583 INFO:teuthology.orchestra.run.smithi177.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-11-27T23:37:55.587 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/572 2023-11-27T23:37:55.588 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/572 2023-11-27T23:37:55.588 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:55.590 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:55.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:55.623 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-11-27T23:37:55.828 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:55.834 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:55.835 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:55.835 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:55.836 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:56.172 INFO:teuthology.orchestra.run.smithi177.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-11-27T23:37:56.176 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/573 2023-11-27T23:37:56.176 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/573 2023-11-27T23:37:56.176 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:56.178 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:56.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:56.201 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-11-27T23:37:56.420 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:56.424 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:56.424 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:56.425 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:56.425 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:56.744 INFO:teuthology.orchestra.run.smithi177.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-11-27T23:37:56.748 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/574 2023-11-27T23:37:56.748 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/574 2023-11-27T23:37:56.749 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:56.750 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:56.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:56.777 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-11-27T23:37:56.984 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:56.988 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:56.988 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:56.989 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:56.989 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:57.316 INFO:teuthology.orchestra.run.smithi177.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-11-27T23:37:57.320 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/575 2023-11-27T23:37:57.320 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/575 2023-11-27T23:37:57.320 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:57.322 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:57.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:57.347 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-11-27T23:37:57.556 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:57.560 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:57.560 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:57.561 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:57.561 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:57.911 INFO:teuthology.orchestra.run.smithi177.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-11-27T23:37:57.917 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/576 2023-11-27T23:37:57.917 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/576 2023-11-27T23:37:57.917 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:57.917 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:57.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:57.956 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-11-27T23:37:58.168 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:58.172 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:58.173 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:58.174 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:58.174 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:58.509 INFO:teuthology.orchestra.run.smithi177.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-11-27T23:37:58.513 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/577 2023-11-27T23:37:58.514 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/577 2023-11-27T23:37:58.514 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:58.516 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:58.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:58.548 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-11-27T23:37:58.765 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:58.769 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:58.769 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:58.770 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:58.770 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:59.135 INFO:teuthology.orchestra.run.smithi177.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T23:37:59.139 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/578 2023-11-27T23:37:59.139 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/578 2023-11-27T23:37:59.139 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:59.141 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:59.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:59.171 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-11-27T23:37:59.380 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:59.384 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:59.385 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:59.386 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:59.386 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:59.724 INFO:teuthology.orchestra.run.smithi177.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-11-27T23:37:59.728 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/579 2023-11-27T23:37:59.728 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/579 2023-11-27T23:37:59.728 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:37:59.730 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:37:59.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:37:59.754 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-11-27T23:37:59.984 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:37:59.988 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:37:59.988 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:37:59.989 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:37:59.989 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:00.539 INFO:teuthology.orchestra.run.smithi177.stdout:generic/580 [not run] kernel does not support ceph encryption 2023-11-27T23:38:00.558 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/580 2023-11-27T23:38:00.558 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/580 2023-11-27T23:38:00.558 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:00.560 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:00.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:00.588 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-11-27T23:38:00.795 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:00.799 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:00.800 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:00.801 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:00.801 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:01.627 INFO:teuthology.orchestra.run.smithi177.stdout:generic/581 [not run] kernel does not support ceph encryption 2023-11-27T23:38:01.652 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/581 2023-11-27T23:38:01.652 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/581 2023-11-27T23:38:01.652 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:01.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:01.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:01.675 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-11-27T23:38:01.881 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:01.885 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:01.885 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:01.886 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:01.886 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:02.450 INFO:teuthology.orchestra.run.smithi177.stdout:generic/582 [not run] kernel does not support ceph encryption 2023-11-27T23:38:02.475 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/582 2023-11-27T23:38:02.476 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/582 2023-11-27T23:38:02.476 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:02.477 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:02.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:02.507 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-11-27T23:38:02.727 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:02.732 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:02.732 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:02.733 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:02.733 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:03.289 INFO:teuthology.orchestra.run.smithi177.stdout:generic/583 [not run] kernel does not support ceph encryption 2023-11-27T23:38:03.309 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/583 2023-11-27T23:38:03.309 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/583 2023-11-27T23:38:03.309 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:03.311 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:03.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:03.331 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-11-27T23:38:03.552 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:03.556 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:03.556 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:03.557 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:03.557 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:04.116 INFO:teuthology.orchestra.run.smithi177.stdout:generic/584 [not run] kernel does not support ceph encryption 2023-11-27T23:38:04.137 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/584 2023-11-27T23:38:04.137 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/584 2023-11-27T23:38:04.137 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:04.139 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:04.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:04.166 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-11-27T23:38:04.380 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:04.384 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:04.385 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:04.386 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:04.386 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:04.762 INFO:teuthology.orchestra.run.smithi177.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-11-27T23:38:04.767 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/585 2023-11-27T23:38:04.767 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/585 2023-11-27T23:38:04.767 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:04.769 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:05.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:05.150 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-11-27T23:38:05.402 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:05.406 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:05.406 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:05.407 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:05.408 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:05.827 INFO:teuthology.orchestra.run.smithi177.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T23:38:05.831 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/586 2023-11-27T23:38:05.831 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/586 2023-11-27T23:38:05.831 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:05.833 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:06.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:06.149 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-11-27T23:38:06.476 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:06.480 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:06.481 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:06.482 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:06.482 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:06.814 INFO:teuthology.orchestra.run.smithi177.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T23:38:06.818 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/587 2023-11-27T23:38:06.818 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/587 2023-11-27T23:38:06.818 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:06.820 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:06.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:06.852 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-11-27T23:38:07.063 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:07.067 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:07.067 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:07.068 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:07.069 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:07.771 INFO:teuthology.orchestra.run.smithi177.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:38:07.777 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/588 2023-11-27T23:38:07.777 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/588 2023-11-27T23:38:07.777 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:07.781 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:08.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:08.008 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-11-27T23:38:08.260 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:08.264 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:08.265 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:08.266 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:08.629 INFO:teuthology.orchestra.run.smithi177.stdout:generic/589 [not run] require 172.21.15.177:6789:/scratch to be local device 2023-11-27T23:38:08.633 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/589 2023-11-27T23:38:08.633 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/589 2023-11-27T23:38:08.633 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:08.635 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:08.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:08.664 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-11-27T23:38:08.874 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:08.878 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:08.878 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:08.879 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:08.880 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:09.225 INFO:teuthology.orchestra.run.smithi177.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T23:38:09.229 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/590 2023-11-27T23:38:09.229 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/590 2023-11-27T23:38:09.229 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:09.232 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:09.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:09.265 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-11-27T23:38:09.473 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:09.477 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:09.477 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:09.478 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:09.479 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:09.925 INFO:teuthology.orchestra.run.smithi177.stdout:generic/591 0s 2023-11-27T23:38:09.930 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/591 2023-11-27T23:38:09.930 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:09.932 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:10.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:10.262 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-11-27T23:38:10.576 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:10.581 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:10.581 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:10.582 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:10.582 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:11.115 INFO:teuthology.orchestra.run.smithi177.stdout:generic/592 [not run] kernel does not support ceph encryption 2023-11-27T23:38:11.142 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/592 2023-11-27T23:38:11.142 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/592 2023-11-27T23:38:11.142 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:11.144 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:11.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:11.170 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-11-27T23:38:11.379 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:11.384 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:11.385 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:11.385 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:11.929 INFO:teuthology.orchestra.run.smithi177.stdout:generic/593 [not run] kernel does not support ceph encryption 2023-11-27T23:38:11.950 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/593 2023-11-27T23:38:11.950 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/593 2023-11-27T23:38:11.950 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:11.952 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:11.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:11.980 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-11-27T23:38:12.196 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:12.200 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:12.200 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:12.201 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:12.201 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:12.551 INFO:teuthology.orchestra.run.smithi177.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T23:38:12.554 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/594 2023-11-27T23:38:12.555 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/594 2023-11-27T23:38:12.555 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:12.557 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:12.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:12.589 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-11-27T23:38:12.796 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:12.801 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:12.801 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:12.802 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:12.802 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:13.378 INFO:teuthology.orchestra.run.smithi177.stdout:generic/595 [not run] kernel does not support ceph encryption 2023-11-27T23:38:13.402 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/595 2023-11-27T23:38:13.402 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/595 2023-11-27T23:38:13.402 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:13.404 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:13.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:13.432 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-11-27T23:38:13.637 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:13.641 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:13.641 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:13.642 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:13.643 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:14.167 INFO:teuthology.orchestra.run.smithi177.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-11-27T23:38:14.171 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/596 2023-11-27T23:38:14.171 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/596 2023-11-27T23:38:14.172 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:14.173 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:14.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:14.211 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-11-27T23:38:14.434 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:14.438 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:14.438 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:14.439 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:14.439 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:15.142 INFO:teuthology.orchestra.run.smithi177.stdout:generic/597 1s 2023-11-27T23:38:15.147 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/597 2023-11-27T23:38:15.147 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:15.149 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:15.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:15.467 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-11-27T23:38:15.766 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:15.771 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:15.771 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:15.772 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:15.772 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:16.443 INFO:teuthology.orchestra.run.smithi177.stdout:generic/598 1s 2023-11-27T23:38:16.447 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/598 2023-11-27T23:38:16.447 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:16.449 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:16.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:16.740 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-11-27T23:38:17.068 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:17.072 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:17.073 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:17.073 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:17.074 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:17.584 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:17.586 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:17.595 INFO:teuthology.orchestra.run.smithi177.stdout:generic/599 [not run] ceph does not support shutdown 2023-11-27T23:38:17.619 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/599 2023-11-27T23:38:17.619 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/599 2023-11-27T23:38:17.619 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:17.621 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:17.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:17.644 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-11-27T23:38:17.913 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:17.917 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:17.917 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:17.919 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:17.919 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:18.243 INFO:teuthology.orchestra.run.smithi177.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T23:38:18.246 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/600 2023-11-27T23:38:18.247 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/600 2023-11-27T23:38:18.247 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:18.249 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:18.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:18.283 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-11-27T23:38:18.500 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:18.504 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:18.505 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:18.506 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:18.829 INFO:teuthology.orchestra.run.smithi177.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T23:38:18.833 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/601 2023-11-27T23:38:18.833 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/601 2023-11-27T23:38:18.833 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:18.835 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:18.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:18.865 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-11-27T23:38:19.081 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:19.085 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:19.086 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:19.087 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:19.087 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:19.638 INFO:teuthology.orchestra.run.smithi177.stdout:generic/602 [not run] kernel does not support ceph encryption 2023-11-27T23:38:19.664 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/602 2023-11-27T23:38:19.664 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/602 2023-11-27T23:38:19.664 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:19.666 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:19.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:19.693 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-11-27T23:38:19.914 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:19.918 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:19.919 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:19.920 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:19.920 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:20.261 INFO:teuthology.orchestra.run.smithi177.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T23:38:20.265 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/603 2023-11-27T23:38:20.265 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/603 2023-11-27T23:38:20.265 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:20.270 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:20.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:20.291 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-11-27T23:38:20.511 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:20.515 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:20.516 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:20.516 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:20.517 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:24.058 INFO:teuthology.orchestra.run.smithi177.stdout:generic/604 4s 2023-11-27T23:38:24.062 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/604 2023-11-27T23:38:24.062 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:24.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:24.073 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-11-27T23:38:24.284 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:24.288 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:24.288 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:24.289 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:24.290 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:25.736 INFO:teuthology.orchestra.run.smithi177.stdout:generic/605 [not run] mount 172.21.15.177:6789:/scratch with dax=always failed 2023-11-27T23:38:25.741 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/605 2023-11-27T23:38:25.741 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/605 2023-11-27T23:38:25.741 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:25.743 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:25.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:25.778 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-11-27T23:38:26.373 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:26.386 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:26.387 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:26.388 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:26.388 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:26.848 INFO:teuthology.orchestra.run.smithi177.stdout:generic/606 [not run] mount 172.21.15.177:6789:/scratch with dax=always failed 2023-11-27T23:38:26.853 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/606 2023-11-27T23:38:26.853 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/606 2023-11-27T23:38:26.853 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:26.855 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:26.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:26.888 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-11-27T23:38:27.095 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:27.099 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:27.099 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:27.100 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:27.100 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:27.448 INFO:teuthology.orchestra.run.smithi177.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-11-27T23:38:27.452 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/607 2023-11-27T23:38:27.452 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/607 2023-11-27T23:38:27.452 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:27.454 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:27.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:27.743 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-11-27T23:38:28.087 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:28.091 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:28.092 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:28.093 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:28.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:28.546 INFO:teuthology.orchestra.run.smithi177.stdout:generic/608 [not run] mount 172.21.15.177:6789:/scratch with dax=always failed 2023-11-27T23:38:28.550 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/608 2023-11-27T23:38:28.550 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/608 2023-11-27T23:38:28.551 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:28.553 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:28.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:28.580 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-11-27T23:38:28.783 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:28.787 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:28.788 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:28.789 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:28.789 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:29.322 INFO:teuthology.orchestra.run.smithi177.stdout:generic/609 0s 2023-11-27T23:38:29.327 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/609 2023-11-27T23:38:29.327 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:29.329 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:29.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:29.625 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-11-27T23:38:29.942 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:29.946 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:29.947 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:29.948 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:29.948 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:30.385 INFO:teuthology.orchestra.run.smithi177.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T23:38:30.389 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/610 2023-11-27T23:38:30.389 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/610 2023-11-27T23:38:30.389 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:30.391 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:30.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:30.431 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-11-27T23:38:30.659 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:30.663 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:30.664 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:30.665 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:30.665 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:31.406 INFO:teuthology.orchestra.run.smithi177.stdout:generic/611 1s 2023-11-27T23:38:31.411 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/611 2023-11-27T23:38:31.411 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:31.413 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:31.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:31.422 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-11-27T23:38:31.632 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:31.636 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:31.636 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:31.637 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:31.637 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:32.032 INFO:teuthology.orchestra.run.smithi177.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T23:38:32.036 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/612 2023-11-27T23:38:32.036 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/612 2023-11-27T23:38:32.036 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:32.038 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:32.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:32.352 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-11-27T23:38:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:32.667 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:33.248 INFO:teuthology.orchestra.run.smithi177.stdout:generic/613 [not run] kernel does not support ceph encryption 2023-11-27T23:38:33.275 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/613 2023-11-27T23:38:33.275 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/613 2023-11-27T23:38:33.275 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:33.277 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:33.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:33.301 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-11-27T23:38:33.504 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:33.508 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:33.508 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:33.509 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:33.509 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:34.058 INFO:teuthology.orchestra.run.smithi177.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-11-27T23:38:34.092 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/614 2023-11-27T23:38:34.092 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/614 2023-11-27T23:38:34.092 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:38:34.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:34.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:38:34.132 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-11-27T23:38:34.352 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:38:34.356 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:38:34.357 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:38:34.357 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:38:34.357 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:38:47.649 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:47.651 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:07.442 INFO:teuthology.orchestra.run.smithi177.stdout:generic/615 33s 2023-11-27T23:39:07.447 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/615 2023-11-27T23:39:07.448 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:07.449 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:07.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:07.458 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-11-27T23:39:07.670 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:07.675 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:07.675 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:07.676 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:07.676 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:08.013 INFO:teuthology.orchestra.run.smithi177.stdout:generic/616 [not run] kernel does not support IO_URING 2023-11-27T23:39:08.017 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/616 2023-11-27T23:39:08.017 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/616 2023-11-27T23:39:08.017 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:08.019 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:08.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:08.047 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-11-27T23:39:08.252 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:08.256 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:08.256 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:08.257 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:08.257 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:08.639 INFO:teuthology.orchestra.run.smithi177.stdout:generic/617 [not run] kernel does not support IO_URING 2023-11-27T23:39:08.643 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/617 2023-11-27T23:39:08.643 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/617 2023-11-27T23:39:08.643 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:08.645 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:08.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:08.694 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-11-27T23:39:08.899 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:08.903 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:08.904 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:08.905 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:08.905 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:09.628 INFO:teuthology.orchestra.run.smithi177.stdout:generic/618 0s 2023-11-27T23:39:09.633 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/618 2023-11-27T23:39:09.633 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:09.635 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:09.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:09.644 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-11-27T23:39:09.849 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:09.853 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:09.853 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:09.854 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:09.855 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:10.216 INFO:teuthology.orchestra.run.smithi177.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T23:39:10.221 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/619 2023-11-27T23:39:10.221 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/619 2023-11-27T23:39:10.221 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:10.222 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:10.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:10.265 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-11-27T23:39:10.481 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:10.485 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:10.486 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:10.487 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:10.487 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:10.880 INFO:teuthology.orchestra.run.smithi177.stdout:generic/620 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:39:10.884 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/620 2023-11-27T23:39:10.885 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/620 2023-11-27T23:39:10.885 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:10.887 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:10.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:10.920 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-11-27T23:39:11.129 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:11.133 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:11.133 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:11.135 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:11.135 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:11.688 INFO:teuthology.orchestra.run.smithi177.stdout:generic/621 [not run] kernel does not support ceph encryption 2023-11-27T23:39:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/621 2023-11-27T23:39:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/621 2023-11-27T23:39:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:11.715 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:11.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:11.742 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-11-27T23:39:11.957 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:11.961 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:11.961 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:11.962 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:11.962 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:12.481 INFO:teuthology.orchestra.run.smithi177.stdout:generic/622 [not run] ceph does not support shutdown 2023-11-27T23:39:12.507 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/622 2023-11-27T23:39:12.507 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/622 2023-11-27T23:39:12.507 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:12.509 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:12.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:12.545 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-11-27T23:39:12.768 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:12.772 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:12.772 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:12.773 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:12.773 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:13.274 INFO:teuthology.orchestra.run.smithi177.stdout:generic/623 [not run] ceph does not support shutdown 2023-11-27T23:39:13.305 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/623 2023-11-27T23:39:13.305 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/623 2023-11-27T23:39:13.305 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:13.306 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:13.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:13.346 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-11-27T23:39:13.568 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:13.572 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:13.573 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:13.574 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:13.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:13.917 INFO:teuthology.orchestra.run.smithi177.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-11-27T23:39:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/624 2023-11-27T23:39:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/624 2023-11-27T23:39:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:13.923 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:13.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:13.955 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-11-27T23:39:14.170 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:14.174 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:14.175 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:14.176 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:14.176 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:14.512 INFO:teuthology.orchestra.run.smithi177.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-11-27T23:39:14.516 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/625 2023-11-27T23:39:14.516 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/625 2023-11-27T23:39:14.516 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:14.518 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:14.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:14.547 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-11-27T23:39:14.768 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:14.772 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:14.773 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:14.774 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:14.774 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:15.152 INFO:teuthology.orchestra.run.smithi177.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-11-27T23:39:15.156 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/626 2023-11-27T23:39:15.156 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/626 2023-11-27T23:39:15.156 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:15.158 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:15.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:15.533 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-11-27T23:39:15.786 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:15.790 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:15.791 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:15.791 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:15.792 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:16.185 INFO:teuthology.orchestra.run.smithi177.stdout:generic/627 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:39:16.190 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/627 2023-11-27T23:39:16.190 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/627 2023-11-27T23:39:16.190 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:16.192 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:16.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:16.224 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-11-27T23:39:16.431 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:16.435 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:16.435 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:16.436 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:16.436 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:17.286 INFO:teuthology.orchestra.run.smithi177.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:39:17.346 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/628 2023-11-27T23:39:17.346 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/628 2023-11-27T23:39:17.346 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:17.348 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:17.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:17.427 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-11-27T23:39:17.631 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:17.635 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:17.635 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:17.636 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:17.636 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:17.797 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:17.799 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:17.989 INFO:teuthology.orchestra.run.smithi177.stdout:generic/629 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:39:17.994 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/629 2023-11-27T23:39:17.994 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/629 2023-11-27T23:39:17.994 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:17.996 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:18.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:18.028 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-11-27T23:39:18.248 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:18.252 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:18.252 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:18.253 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:18.253 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:18.767 INFO:teuthology.orchestra.run.smithi177.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T23:39:19.039 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/630 2023-11-27T23:39:19.040 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/630 2023-11-27T23:39:19.040 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:39:19.045 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:19.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:39:19.163 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-11-27T23:39:19.411 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:19.415 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:19.416 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:19.417 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:19.417 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:47.877 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:47.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:50.801 INFO:teuthology.orchestra.run.smithi177.stdout:generic/631 - output mismatch (see /tmp/tmp.nfQXm1uy9xxfstests-dev/results//generic/631.out.bad) 2023-11-27T23:39:50.808 INFO:teuthology.orchestra.run.smithi177.stdout: --- tests/generic/631.out 2023-11-27 17:49:24.175709853 +0000 2023-11-27T23:39:50.808 INFO:teuthology.orchestra.run.smithi177.stdout: +++ /tmp/tmp.nfQXm1uy9xxfstests-dev/results//generic/631.out.bad 2023-11-27 23:39:50.774380622 +0000 2023-11-27T23:39:50.808 INFO:teuthology.orchestra.run.smithi177.stdout: @@ -1,2 +1,3416 @@ 2023-11-27T23:39:50.808 INFO:teuthology.orchestra.run.smithi177.stdout: QA output created by 631 2023-11-27T23:39:50.808 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.809 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.810 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.811 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.811 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.811 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.811 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.812 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.812 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.812 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.812 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.813 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.813 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.813 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.813 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.813 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.813 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.814 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.814 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.814 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.814 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.814 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.814 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.815 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.815 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.815 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.815 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: touch: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.815 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.815 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.815 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.816 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.816 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.816 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.816 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.816 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.816 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.817 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.817 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.817 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.817 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.817 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.817 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.818 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.818 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.818 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.818 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.818 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.818 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.819 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.819 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.819 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.819 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.819 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.819 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.820 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.822 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.823 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.825 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.826 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.827 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.828 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.829 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.830 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.831 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.833 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf' 2023-11-27T23:39:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: +: No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.835 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.836 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.837 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.838 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.839 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.840 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.841 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.842 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.843 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.844 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.845 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.846 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.846 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.846 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.846 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.846 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.846 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.847 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.848 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.848 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.848 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.848 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.848 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.848 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.848 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.849 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.850 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.851 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.852 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.854 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +: No such file or directory 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.855 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.856 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.857 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.858 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.859 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted./tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.860 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.861 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.862 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.863 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.864 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.865 INFO:teuthology.orchestra.run.smithi177.stdout: +: No such file or directory 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.866 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.867 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.868 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.869 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.870 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.871 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.872 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.873 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.874 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.875 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.876 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.877 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.878 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.878 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.878 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.878 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.878 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.878 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.878 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.878 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.879 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.880 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.881 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.882 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.883 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.884 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.885 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.886 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.887 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directorymv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.888 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.889 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.890 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.891 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.892 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.893 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.893 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.893 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.893 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.893 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.893 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.893 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.894 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.894 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.894 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.894 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.894 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.894 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.895 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.895 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.895 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.895 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.895 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.895 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.895 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.896 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.897 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.897 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.897 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.897 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.897 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.897 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.897 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.897 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.898 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.898 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.898 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.898 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.898 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.898 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.898 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.899 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.899 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.899 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.899 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.899 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.899 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.899 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.900 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.900 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.900 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.900 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.900 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.900 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.900 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.901 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.901 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.901 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.901 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.901 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.901 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.901 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.901 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.902 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.902 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.902 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.902 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.902 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.902 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted.touch: 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.903 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.904 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.905 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.906 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.907 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.908 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.909 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.910 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.911 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.912 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.913 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.914 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.915 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.916 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.917 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.918 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.919 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.921 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf' 2023-11-27T23:39:50.922 INFO:teuthology.orchestra.run.smithi177.stdout: +: No such file or directory 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted./tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.923 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.924 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.925 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.926 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.927 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.928 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.929 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.930 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.931 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.931 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.931 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.931 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.932 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.933 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.933 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.933 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.933 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.933 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.933 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.933 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.933 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.934 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.935 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.936 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.937 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.938 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.939 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.940 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.941 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.942 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.943 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.944 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.945 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.946 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.947 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.948 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +: No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.949 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.951 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.952 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.953 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.954 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.955 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.957 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.958 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.959 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.960 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted./tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.961 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.962 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.963 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.964 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.965 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.966 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.967 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.968 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.969 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.970 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf' 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +: No such file or directory 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.971 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.972 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.973 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.974 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.975 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.976 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.977 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.978 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.979 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.980 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.982 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.984 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.985 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.986 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.987 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.988 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.989 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.990 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.991 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted./tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.992 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.993 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.994 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.995 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.996 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.997 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:50.998 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:50.999 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.000 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.001 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.touch: 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.002 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.003 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.004 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.005 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.006 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:51.007 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.008 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.009 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.010 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.011 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.012 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.013 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.014 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.016 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.017 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.018 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.019 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.020 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.021 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.022 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.023 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.024 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.025 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.026 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.027 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.028 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.029 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.030 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.031 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.032 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.033 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.034 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.035 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.036 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.037 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.038 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.039 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.040 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.041 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.042 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.043 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.045 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.046 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.047 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.048 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.049 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directorycannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf' 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +: No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.050 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.051 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.052 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.053 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.054 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.055 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.056 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.057 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.059 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.060 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.061 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.062 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.064 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.065 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.067 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.069 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.070 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.071 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.072 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: + 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.074 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.075 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.076 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.077 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.078 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.079 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.080 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.081 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.082 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.083 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.084 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.085 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.086 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.087 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.088 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.089 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.090 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.091 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.092 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.093 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged3/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged3: not mounted. 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.094 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged2/etc/access.conf': No such file or directory 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged2: not mounted. 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged0/etc/access.conf': No such file or directory 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged0: not mounted. 2023-11-27T23:39:51.095 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged1/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged1: not mounted. 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged5/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged5: not mounted. 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +mount: /tmp/tmp.NJ4jZWycDSscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.096 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.097 INFO:teuthology.orchestra.run.smithi177.stdout: +mv: cannot stat '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.097 INFO:teuthology.orchestra.run.smithi177.stdout: +touch: cannot touch '/tmp/tmp.NJ4jZWycDSscratch/merged4/etc/access.conf': No such file or directory 2023-11-27T23:39:51.097 INFO:teuthology.orchestra.run.smithi177.stdout: +umount: /tmp/tmp.NJ4jZWycDSscratch/merged4: not mounted. 2023-11-27T23:39:51.097 INFO:teuthology.orchestra.run.smithi177.stdout: Silence is golden. 2023-11-27T23:39:51.097 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:51.097 INFO:teuthology.orchestra.run.smithi177.stdout:HINT: You _MAY_ be missing kernel fix: 2023-11-27T23:39:51.097 INFO:teuthology.orchestra.run.smithi177.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-11-27T23:39:51.097 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:51.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T23:39:51.099 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/631 2023-11-27T23:39:51.099 INFO:teuthology.orchestra.run.smithi177.stdout:Failures: generic/631 2023-11-27T23:39:51.099 INFO:teuthology.orchestra.run.smithi177.stdout:Failed 1 of 1 tests 2023-11-27T23:39:51.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:39:51.099 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T23:39:51.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T23:39:51.100 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-11-27T23:39:51.466 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:39:51.470 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:39:51.471 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:39:51.472 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:39:51.472 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:40:18.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:18.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:48.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:48.276 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:18.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:18.430 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:23.153 INFO:teuthology.orchestra.run.smithi177.stdout:generic/632 92s 2023-11-27T23:41:23.159 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/632 2023-11-27T23:41:23.159 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:23.161 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:23.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:23.199 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-11-27T23:41:23.418 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:23.422 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:23.423 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:23.424 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:23.424 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:24.480 INFO:teuthology.orchestra.run.smithi177.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.nfQXm1uy9xxfstests-dev/results//generic/633.out.bad) 2023-11-27T23:41:24.485 INFO:teuthology.orchestra.run.smithi177.stdout: --- tests/generic/633.out 2023-11-27 17:49:24.175709853 +0000 2023-11-27T23:41:24.485 INFO:teuthology.orchestra.run.smithi177.stdout: +++ /tmp/tmp.nfQXm1uy9xxfstests-dev/results//generic/633.out.bad 2023-11-27 23:41:24.467908792 +0000 2023-11-27T23:41:24.486 INFO:teuthology.orchestra.run.smithi177.stdout: @@ -1,2 +1,4 @@ 2023-11-27T23:41:24.486 INFO:teuthology.orchestra.run.smithi177.stdout: QA output created by 633 2023-11-27T23:41:24.486 INFO:teuthology.orchestra.run.smithi177.stdout: Silence is golden 2023-11-27T23:41:24.486 INFO:teuthology.orchestra.run.smithi177.stdout: +vfstest.c: 1645: setgid_create - Success - failure: is_setgid 2023-11-27T23:41:24.486 INFO:teuthology.orchestra.run.smithi177.stdout: +vfstest.c: 2418: run_test - Success - failure: create operations in directories with setgid bit set 2023-11-27T23:41:24.490 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/633 2023-11-27T23:41:24.490 INFO:teuthology.orchestra.run.smithi177.stdout:Failures: generic/633 2023-11-27T23:41:24.490 INFO:teuthology.orchestra.run.smithi177.stdout:Failed 1 of 1 tests 2023-11-27T23:41:24.493 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:24.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T23:41:24.502 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T23:41:24.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T23:41:24.503 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-11-27T23:41:24.742 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:24.746 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:24.746 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:24.747 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:24.747 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:25.907 INFO:teuthology.orchestra.run.smithi177.stdout:generic/634 1s 2023-11-27T23:41:25.912 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/634 2023-11-27T23:41:25.912 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:25.914 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:25.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:25.922 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-11-27T23:41:26.128 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:26.132 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:26.132 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:26.133 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:26.133 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:26.651 INFO:teuthology.orchestra.run.smithi177.stdout:generic/635 [not run] ceph does not support shutdown 2023-11-27T23:41:26.680 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/635 2023-11-27T23:41:26.681 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/635 2023-11-27T23:41:26.681 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:26.682 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:26.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:26.708 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-11-27T23:41:26.914 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:26.918 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:26.918 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:26.919 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:26.919 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:27.513 INFO:teuthology.orchestra.run.smithi177.stdout:generic/636 [not run] swapfiles are not supported 2023-11-27T23:41:27.517 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/636 2023-11-27T23:41:27.517 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/636 2023-11-27T23:41:27.517 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:27.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:27.553 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-11-27T23:41:27.773 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:27.777 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:27.777 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:27.778 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:27.778 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:28.434 INFO:teuthology.orchestra.run.smithi177.stdout:generic/637 1s 2023-11-27T23:41:28.439 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/637 2023-11-27T23:41:28.439 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:28.441 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:28.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:28.833 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-11-27T23:41:29.112 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:29.116 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:29.117 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:29.118 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:29.118 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:29.498 INFO:teuthology.orchestra.run.smithi177.stdout:generic/638 0s 2023-11-27T23:41:29.503 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/638 2023-11-27T23:41:29.503 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:29.506 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:29.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:29.537 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-11-27T23:41:29.746 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:29.750 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:29.751 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:29.752 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:29.752 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:30.256 INFO:teuthology.orchestra.run.smithi177.stdout:generic/639 1s 2023-11-27T23:41:30.261 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/639 2023-11-27T23:41:30.261 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:30.263 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:30.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:30.301 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-11-27T23:41:30.510 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:30.514 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:30.515 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:30.516 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:30.516 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:30.852 INFO:teuthology.orchestra.run.smithi177.stdout:generic/640 [not run] require 172.21.15.177:6789:/scratch to be valid block disk 2023-11-27T23:41:30.856 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/640 2023-11-27T23:41:30.856 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/640 2023-11-27T23:41:30.856 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:30.858 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:30.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:30.896 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-11-27T23:41:31.110 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:31.114 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:31.114 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:31.115 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:31.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:31.685 INFO:teuthology.orchestra.run.smithi177.stdout:generic/641 [not run] swapfiles are not supported 2023-11-27T23:41:31.689 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/641 2023-11-27T23:41:31.689 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/641 2023-11-27T23:41:31.689 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:41:31.691 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:31.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:41:31.724 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-11-27T23:41:31.935 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:41:31.939 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:41:31.939 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:41:31.940 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:41:31.940 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:41:48.561 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:48.563 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:18.839 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:18.841 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:18.897 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T23:42:18.896+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 824113) UID: 0 2023-11-27T23:42:18.898 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T23:42:18.896+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 824113) UID: 0 2023-11-27T23:46:08.574 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:08.577 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:38.817 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:38.819 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:08.981 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:08.984 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:09.106 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T23:47:09.105+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 824223) UID: 0 2023-11-27T23:47:09.107 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T23:47:09.105+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 824223) UID: 0 2023-11-27T23:50:41.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:41.174 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:10.455 INFO:teuthology.orchestra.run.smithi177.stdout:generic/642 578s 2023-11-27T23:51:10.460 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/642 2023-11-27T23:51:10.460 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:51:10.462 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:51:10.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:51:10.471 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-11-27T23:51:11.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:11.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:14.504 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:51:14.509 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:51:14.510 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:51:14.511 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:51:14.511 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:51:41.853 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:41.855 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:41.891 INFO:tasks.ceph.mds.a.smithi177.stderr:2023-11-27T23:51:41.890+0000 7f12602ca700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 824628) UID: 0 2023-11-27T23:51:41.892 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-11-27T23:51:41.890+0000 7ff5bf82d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 824628) UID: 0 2023-11-27T23:54:46.800 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:46.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:49.093 INFO:teuthology.orchestra.run.smithi177.stdout:generic/643 [not run] swapfiles are not supported 2023-11-27T23:54:49.097 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/643 2023-11-27T23:54:49.098 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/643 2023-11-27T23:54:49.098 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:54:49.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:49.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:49.125 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-11-27T23:54:49.332 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:54:49.336 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:54:49.337 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:54:49.338 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:54:49.338 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:49.700 INFO:teuthology.orchestra.run.smithi177.stdout:generic/644 [not run] kernel does not support mount_setattr syscall 2023-11-27T23:54:49.704 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/644 2023-11-27T23:54:49.704 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/644 2023-11-27T23:54:49.704 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:54:49.706 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:49.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:49.732 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-11-27T23:54:49.941 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:54:49.945 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:54:49.946 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:54:49.947 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:54:49.947 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:50.270 INFO:teuthology.orchestra.run.smithi177.stdout:generic/645 [not run] kernel does not support mount_setattr syscall 2023-11-27T23:54:50.274 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/645 2023-11-27T23:54:50.274 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/645 2023-11-27T23:54:50.274 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:54:50.276 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:50.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:50.308 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-11-27T23:54:50.531 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:54:50.535 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:54:50.536 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:54:50.537 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:54:50.537 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:51.044 INFO:teuthology.orchestra.run.smithi177.stdout:generic/646 [not run] ceph does not support shutdown 2023-11-27T23:54:51.063 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/646 2023-11-27T23:54:51.064 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/646 2023-11-27T23:54:51.064 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:54:51.066 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:51.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:51.093 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-11-27T23:54:51.313 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:54:51.317 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:54:51.317 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:54:51.318 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:54:51.319 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:51.874 INFO:teuthology.orchestra.run.smithi177.stdout:generic/647 0s 2023-11-27T23:54:51.879 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/647 2023-11-27T23:54:51.879 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:54:51.881 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:52.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:52.199 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-11-27T23:54:52.509 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:54:52.513 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:54:52.513 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:54:52.514 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:54:52.514 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:53.445 INFO:teuthology.orchestra.run.smithi177.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T23:54:53.456 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/648 2023-11-27T23:54:53.456 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/648 2023-11-27T23:54:53.457 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:54:53.485 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:53.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:53.514 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-11-27T23:54:53.729 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:54:53.733 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:54:53.734 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:54:53.734 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:54:53.735 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:54.150 INFO:teuthology.orchestra.run.smithi177.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T23:54:54.153 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: generic/649 2023-11-27T23:54:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: generic/649 2023-11-27T23:54:54.154 INFO:teuthology.orchestra.run.smithi177.stdout:Passed all 1 tests 2023-11-27T23:54:54.156 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:54:54.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:54.488 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.nfQXm1uy9xxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-11-27T23:54:54.777 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2023-11-27T23:54:54.781 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-11-27T23:54:54.781 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.177:6789:/scratch 2023-11-27T23:54:54.782 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAn1mRlgh1FLhAAWYB5Z1ByBm8fYgQjvOWkVg== -o context=system_u:object_r:root_t:s0 172.21.15.177:6789:/scratch /tmp/tmp.NJ4jZWycDSscratch 2023-11-27T23:54:54.782 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-11-27T23:55:17.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:17.089 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:47.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:47.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:17.349 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:17.353 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:47.488 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:47.492 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:17.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:17.589 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:47.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:47.718 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:17.853 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:17.856 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:48.000 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:48.004 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:18.145 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:18.149 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:48.272 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:48.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:18.404 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:18.408 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:48.484 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:48.488 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:01:18.665 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:01:18.668 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:01:48.805 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:01:48.815 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:18.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:18.982 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:49.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:49.121 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:03:19.289 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:03:19.293 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:03:49.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:03:49.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:04:19.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:04:19.589 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:04:49.688 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:04:50.943 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:05:21.010 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:05:21.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:05:51.131 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:05:51.134 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:06:21.254 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:06:21.257 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:06:51.398 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:06:51.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:07:21.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:07:21.464 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:07:51.583 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:07:54.532 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:08:24.595 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:08:24.600 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:08:54.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:08:54.746 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:24.898 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:24.901 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:55.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:55.042 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:10:25.178 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:10:25.181 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:10:55.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:10:55.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:11:25.497 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:11:25.501 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:11:55.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:11:55.656 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:12:25.791 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:12:28.475 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:12:58.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:12:58.624 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:13:28.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:13:28.745 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:13:58.986 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:13:58.990 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:14:29.154 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:14:29.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:14:59.226 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:14:59.231 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:15:29.316 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:15:29.319 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:15:59.454 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:15:59.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:16:29.633 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:16:29.636 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:16:59.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:17:02.761 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:17:32.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:17:32.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:18:03.111 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:18:03.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:18:33.240 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:18:33.244 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:19:03.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:19:03.375 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:19:33.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:19:33.614 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:20:03.682 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:20:03.685 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:20:33.827 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:20:33.830 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:21:03.910 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:21:03.913 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:21:33.998 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:21:34.001 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:22:04.233 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:22:04.236 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:22:34.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:22:34.381 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:23:04.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:23:04.546 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:23:34.695 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:23:34.699 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:24:04.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:24:04.788 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:24:34.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:24:34.918 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:25:05.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:25:05.012 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:25:35.147 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:25:35.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:26:05.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:26:05.281 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:26:35.432 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:26:35.435 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:27:05.553 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:27:05.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:27:35.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:27:35.671 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:28:05.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:28:05.815 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:28:35.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:28:35.944 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:29:06.095 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:29:06.099 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:29:36.254 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:29:36.258 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:30:06.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:30:06.426 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:30:36.577 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:30:36.581 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:31:06.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:31:06.668 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:31:36.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:31:36.796 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:32:06.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:32:06.909 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:32:37.066 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:32:37.070 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:33:07.214 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:33:07.218 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:33:37.349 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:33:37.352 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:34:07.523 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:34:07.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:34:37.661 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:34:37.665 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:35:07.823 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:35:07.826 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:35:37.986 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:35:37.990 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:36:08.108 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:36:08.112 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:36:38.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:36:38.278 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:37:08.379 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:37:08.382 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:37:38.517 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:37:38.522 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:38:08.706 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:38:08.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:38:38.860 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:38:38.864 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:39:08.983 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:39:08.988 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:39:39.132 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:39:39.135 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:40:09.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:40:09.201 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:40:39.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:40:39.279 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:41:09.348 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:41:09.380 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:41:39.551 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:41:39.558 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:42:09.693 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:42:09.697 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:42:39.772 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:42:39.776 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:43:10.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:43:10.066 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:43:40.132 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:43:40.136 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:10.290 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:10.294 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:40.360 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:40.363 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:45:10.490 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:45:10.494 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:45:40.646 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:45:40.650 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:46:10.790 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:46:10.794 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:46:40.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:46:40.889 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:47:11.008 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:47:11.012 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:47:41.163 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:47:41.168 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:48:11.372 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:48:11.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:48:41.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:48:41.456 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:49:11.585 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:49:11.589 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:49:41.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:49:41.744 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:50:11.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:50:11.847 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:50:41.985 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:50:41.989 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:51:12.105 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:51:12.109 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:51:42.262 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:51:42.270 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:52:12.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:52:12.337 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:52:42.505 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:52:42.509 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:53:12.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:53:12.653 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:53:42.798 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:53:42.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:54:12.928 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:54:12.931 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:54:43.066 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:54:43.069 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:55:13.221 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:55:13.225 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:55:43.359 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:55:43.363 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:13.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:13.433 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:43.608 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:43.612 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:57:13.756 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:57:13.760 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:57:43.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:57:43.982 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:58:14.048 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:58:14.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:58:44.195 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:58:44.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:59:14.291 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:59:14.295 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:59:44.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:59:44.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:00:14.547 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:00:14.551 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:00:44.678 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:00:44.682 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:01:14.818 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:01:14.821 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:01:44.964 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:01:44.968 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:02:15.102 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:02:15.105 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:02:45.166 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:02:45.170 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:03:15.357 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:03:15.360 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:03:45.493 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:03:45.497 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:04:15.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:04:15.777 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:04:45.831 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:04:45.834 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:05:15.953 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:05:15.956 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:05:46.053 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:05:46.057 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:06:16.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:06:16.180 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:06:46.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:06:46.334 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:07:16.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:07:16.429 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:07:46.564 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:07:46.568 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:08:16.845 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:08:16.849 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:08:46.975 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:08:46.980 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:09:17.071 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:09:17.074 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:09:47.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:09:47.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:10:17.348 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:10:17.353 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:10:47.505 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:10:47.508 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:11:17.633 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:11:17.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:11:47.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:11:47.775 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:12:17.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:12:17.909 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:12:48.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:12:48.058 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:13:18.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:13:18.137 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:13:48.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:13:48.278 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:14:18.419 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:14:18.422 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:14:48.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:14:48.488 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:15:18.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:15:18.635 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:15:48.761 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:15:48.764 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:16:18.930 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:16:18.934 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:16:49.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:16:49.057 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:17:19.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:17:19.190 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:17:49.334 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:17:49.337 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:18:19.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:18:19.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:18:49.567 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:18:49.570 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:19:19.717 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:19:19.721 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:19:49.850 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:19:49.853 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:20:20.006 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:20:20.010 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:20:50.068 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:20:50.071 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:21:20.173 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:21:20.177 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:21:50.320 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:21:50.324 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:22:20.417 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:22:20.421 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:22:50.487 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:22:50.490 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:20.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:20.579 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:50.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:50.887 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:24:20.965 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:24:20.968 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:24:51.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:24:51.094 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:25:21.228 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:25:21.233 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:25:51.300 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:25:51.304 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:26:21.386 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:26:21.389 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:26:51.475 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:26:51.478 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:27:21.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:27:21.633 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:27:51.769 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:27:51.773 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:22.108 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:22.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:52.179 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:52.183 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:29:22.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:29:22.276 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:29:52.385 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:29:52.389 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:30:22.496 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:30:22.500 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:30:52.627 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:30:52.631 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:31:22.774 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:31:22.783 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:31:52.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:31:52.959 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:32:23.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:32:23.022 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:32:53.358 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:32:53.361 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:33:23.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:33:23.438 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:33:53.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:33:53.618 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:34:23.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:34:23.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:34:53.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:34:53.904 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:35:24.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:35:24.056 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:35:54.192 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:35:54.195 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:36:24.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:36:24.359 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:36:54.503 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:36:54.506 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:37:24.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:37:24.636 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:37:54.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:37:54.723 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:38:24.816 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:38:24.819 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:38:55.125 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:38:55.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:39:25.272 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:39:25.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:39:55.403 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:39:55.406 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:40:25.545 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:40:25.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:40:55.697 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:40:55.700 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:41:25.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:41:25.850 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:41:56.058 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:41:56.061 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:42:26.215 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:42:26.218 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:42:56.310 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:42:56.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:43:26.428 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:43:26.434 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:43:56.573 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:43:56.576 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:44:26.677 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:44:26.680 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:44:56.825 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:44:56.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:45:26.979 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:45:26.993 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:45:57.107 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:45:57.111 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:46:27.254 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:46:27.299 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:46:57.388 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:46:57.391 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:47:27.597 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:47:27.601 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:47:57.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:47:57.707 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:48:27.831 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:48:27.834 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:48:57.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:48:57.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:49:28.074 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:49:28.077 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:49:58.216 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:49:58.219 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:50:28.349 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:50:30.280 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:51:00.420 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:51:00.423 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:51:30.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:51:30.495 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:52:00.637 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:52:00.640 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:52:30.736 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:52:30.739 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:00.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:00.816 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:30.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:30.956 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:54:01.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:54:01.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:54:31.191 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:54:31.194 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:55:01.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:55:01.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:55:31.487 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:55:31.490 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:56:01.619 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:56:01.627 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:56:31.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:56:31.790 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:57:01.908 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:57:01.912 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:57:32.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:57:32.064 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:58:02.201 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:58:02.204 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:58:32.357 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:58:32.362 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:59:02.511 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:59:02.515 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:59:32.858 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:59:32.862 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:00:02.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:00:02.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:00:33.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:00:33.088 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:01:03.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:01:03.203 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:01:33.333 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:01:33.337 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:03.406 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:03.410 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:33.545 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:33.551 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:03:03.684 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:03:03.687 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:03:33.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:03:33.847 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:04:03.974 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:04:03.977 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:04:34.036 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:04:34.755 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:05:04.824 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:05:04.827 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:05:34.961 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:05:34.964 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:06:05.017 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:06:05.020 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:06:35.146 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:06:35.149 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:07:05.308 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:07:05.311 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:07:35.439 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:07:35.442 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:08:05.607 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:08:05.610 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:08:35.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:08:35.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:09:05.896 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:09:05.899 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:09:36.023 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:09:36.027 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:10:06.174 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:10:06.177 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:10:36.308 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:10:36.312 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:11:06.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:11:06.483 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:11:36.618 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:11:36.623 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:12:06.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:12:06.787 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:12:36.943 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:12:36.946 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:13:07.073 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:13:07.076 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:13:37.200 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:13:37.203 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:14:07.339 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:14:07.343 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:14:37.471 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:14:37.474 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:15:07.584 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:15:07.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:15:37.914 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:15:37.917 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:16:07.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:16:07.981 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:16:38.111 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:16:38.115 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:17:08.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:17:08.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:17:38.506 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:17:38.509 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:18:08.651 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:18:08.656 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:18:38.790 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:18:38.793 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:19:08.918 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:19:08.922 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:19:39.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:19:39.069 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:20:09.169 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:20:09.172 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:20:39.262 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:20:39.265 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:21:09.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:21:09.415 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:21:39.557 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:21:39.560 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:22:09.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:22:09.709 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:22:39.818 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:22:39.821 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:23:09.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:23:09.958 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:23:40.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:23:40.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:24:10.122 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:24:10.124 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:24:40.277 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:24:40.280 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:25:10.338 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:25:10.342 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:25:40.477 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:25:40.481 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:26:10.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:26:10.635 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:26:40.795 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:26:40.801 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:27:10.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:27:10.951 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:27:41.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:27:41.089 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:28:11.208 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:28:11.211 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:28:41.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:28:41.270 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:29:11.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:29:11.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:29:41.396 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:29:41.400 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:30:11.517 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:30:11.521 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:30:41.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:30:41.626 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:31:11.706 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:31:11.709 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:31:41.776 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:31:41.779 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:32:11.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:32:11.909 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:32:42.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:32:42.031 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:33:12.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:33:12.180 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:33:42.248 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:33:42.252 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:34:12.437 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:34:12.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:34:42.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:34:42.578 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:35:12.703 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:35:12.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:35:42.853 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:35:42.856 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:36:12.919 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:36:12.922 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:36:42.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:36:42.983 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:37:13.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:37:13.064 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:37:43.134 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:37:43.137 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:38:13.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:38:13.201 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:38:43.320 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:38:43.323 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:39:13.483 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:39:13.486 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:39:43.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:39:43.551 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:40:13.611 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:40:13.614 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:40:43.750 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:40:43.753 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:41:13.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:41:13.859 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:41:43.936 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:41:43.939 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:42:14.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:42:14.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:42:44.096 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:42:44.099 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:43:14.228 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:43:14.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:43:44.359 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:43:44.361 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:44:14.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:44:14.458 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:44:44.595 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:44:44.597 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:45:14.717 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:45:14.720 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:45:44.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:45:44.785 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:46:14.936 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:46:14.939 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:46:45.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:46:45.004 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:47:15.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:47:15.084 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:47:45.153 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:47:45.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:48:15.234 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:48:15.243 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:48:45.301 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:48:45.304 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:49:15.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:49:15.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:49:45.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:49:45.589 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:50:15.673 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:50:15.676 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:50:45.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:50:45.774 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:51:15.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:51:15.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:51:46.088 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:51:46.091 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:52:16.158 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:52:16.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:52:46.304 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:52:46.307 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:16.368 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:16.371 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:46.504 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:46.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:54:16.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:54:16.747 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:54:46.808 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:54:46.811 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:55:16.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:55:16.952 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:55:47.105 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:55:47.108 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:56:17.171 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:56:17.174 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:56:47.314 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:56:47.317 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:57:17.454 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:57:17.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:57:47.550 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:57:47.553 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:58:17.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:58:17.684 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:58:47.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:58:47.814 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:59:17.966 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:59:17.969 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:59:48.087 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:59:48.090 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:00:18.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:00:18.146 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:00:48.247 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:00:48.250 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:01:18.360 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:01:18.364 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:01:48.427 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:01:48.430 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:02:18.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:02:18.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:02:48.688 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:02:48.691 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:03:18.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:03:18.839 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:03:48.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:03:48.961 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:04:19.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:04:19.025 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:04:49.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:04:49.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:05:19.266 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:05:19.269 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:05:49.338 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:05:49.341 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:06:19.462 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:06:19.465 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:06:49.535 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:06:49.538 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:07:19.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:07:19.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:07:49.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:07:49.707 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:08:19.847 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:08:19.852 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:08:49.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:08:49.918 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:09:19.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:09:19.992 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:09:50.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:09:50.054 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:10:20.192 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:10:20.196 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:10:50.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:10:50.333 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:11:20.459 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:11:20.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:11:50.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:11:50.609 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:12:20.735 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:12:20.738 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:12:50.859 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:12:50.878 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:13:21.011 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:13:21.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:13:51.163 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:13:51.166 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:14:21.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:14:21.312 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:14:51.448 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:14:51.450 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:15:21.595 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:15:21.598 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:15:51.724 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:15:51.728 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:16:21.872 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:16:21.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:16:51.944 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:16:51.947 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:17:22.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:17:22.079 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:17:52.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:17:52.360 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:18:22.478 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:18:22.481 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:18:52.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:18:52.795 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:19:22.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:19:22.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:19:52.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:19:52.993 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:20:23.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:20:23.143 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:20:53.291 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:20:53.294 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:21:23.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:21:23.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:21:53.580 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:21:53.583 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:22:23.668 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:22:23.671 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:22:53.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:22:53.748 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:23:23.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:23:23.814 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:23:53.873 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:23:53.876 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:24:23.954 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:24:23.962 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:24:54.018 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:24:54.021 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:25:24.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:25:24.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:25:54.137 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:25:54.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:26:24.260 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:26:24.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:26:54.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:26:54.494 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:27:24.555 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:27:24.558 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:27:54.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:27:54.648 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:28:24.845 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:28:24.848 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:28:54.921 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:28:54.924 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:29:25.036 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:29:25.039 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:29:55.158 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:29:55.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:30:25.255 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:30:25.260 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:30:55.395 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:30:55.397 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:31:25.533 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:31:25.536 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:31:55.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:31:55.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:32:26.020 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:32:26.023 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:32:56.091 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:32:56.094 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:33:26.263 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:33:26.266 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:33:56.326 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:33:56.330 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:34:26.449 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:34:26.494 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:34:56.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:34:56.649 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:35:26.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:35:26.755 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:35:56.891 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:35:56.894 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:36:27.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:36:27.040 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:36:57.354 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:36:57.400 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:37:27.465 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:37:27.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:37:57.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:37:57.624 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:38:27.743 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:38:57.805 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:38:57.808 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:39:27.962 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:39:27.965 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:39:58.123 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:39:58.126 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:40:28.240 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:40:28.244 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:40:58.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:40:58.452 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:41:28.510 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:41:30.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:42:00.899 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:42:00.902 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:42:31.053 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:42:31.059 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:43:01.192 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:43:01.195 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:43:31.329 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:43:31.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:44:01.484 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:44:01.487 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:44:31.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:44:31.625 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:45:01.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:45:01.750 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:45:31.890 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:45:31.893 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:46:02.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:46:02.040 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:46:32.174 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:46:32.177 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:47:02.328 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:47:02.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:47:32.467 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:47:32.471 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:48:02.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:48:02.624 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:48:32.718 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:48:32.721 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:49:02.846 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:49:02.851 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:49:32.984 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:49:32.987 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:50:03.122 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:50:03.125 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:50:33.350 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:50:33.354 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:51:03.490 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:51:03.494 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:51:33.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:51:33.748 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:52:03.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:52:03.915 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:52:34.070 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:52:34.073 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:53:04.217 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:53:04.222 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:53:34.350 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:53:34.354 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:54:04.497 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:54:04.502 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:54:34.587 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:54:34.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:55:04.683 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:55:04.690 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:55:34.830 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:55:34.833 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:56:04.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:56:04.956 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:56:35.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:56:35.070 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:57:05.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:57:05.191 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:57:35.265 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:57:35.268 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:58:05.337 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:58:05.340 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:58:35.398 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:58:35.401 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:59:05.520 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:59:05.532 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:59:35.668 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:59:35.671 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:00:05.803 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:00:05.806 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:00:35.871 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:00:35.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:01:05.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:01:05.991 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:01:36.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:01:36.070 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:02:06.206 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:02:06.210 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:02:36.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:02:36.272 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:03:06.425 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:03:07.748 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:03:37.815 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:03:37.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:04:07.945 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:04:07.948 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:04:38.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:04:38.112 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:05:08.173 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:05:11.714 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:05:41.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:05:41.785 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:06:11.918 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:06:11.920 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:06:41.991 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:06:41.994 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:07:12.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:07:12.141 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:07:42.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:07:42.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:12.457 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:12.460 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:42.588 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:42.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:09:12.809 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:09:12.813 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:09:43.010 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:09:43.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:10:13.080 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:10:13.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:10:43.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:10:43.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:11:13.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:11:13.359 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:11:43.488 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:11:43.491 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:12:13.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:12:13.661 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:12:43.798 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:12:43.801 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:13:13.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:13:13.925 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:13:44.080 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:13:44.084 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:14:14.342 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:14:16.107 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:14:46.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:14:46.241 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:15:16.393 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:15:16.396 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:15:46.507 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:15:46.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:16:16.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:16:16.633 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:16:46.765 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:16:46.768 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:17:16.912 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:17:16.915 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:17:47.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:17:47.038 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:18:17.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:18:17.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:18:47.335 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:18:47.338 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:19:17.497 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:19:17.500 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:19:47.594 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:19:47.597 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:20:17.725 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:20:17.728 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:20:47.888 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:20:47.891 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:21:17.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:21:17.954 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:21:48.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:21:48.045 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:22:18.106 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:22:18.109 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:22:48.170 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:22:48.173 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:23:18.320 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:23:18.323 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:23:48.483 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:23:48.486 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:24:18.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:24:18.634 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:24:48.794 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:24:48.797 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:25:18.957 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:25:18.961 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:25:49.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:25:49.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:26:19.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:26:19.131 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:26:49.272 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:26:49.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:27:19.419 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:27:19.422 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:27:49.490 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:27:49.494 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:28:19.579 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:28:19.582 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:28:49.725 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:28:49.729 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:29:19.857 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:29:19.860 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:29:49.992 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:29:49.995 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:30:20.124 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:30:20.127 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:30:50.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:30:50.274 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:31:20.401 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:31:20.404 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:31:50.574 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:31:50.577 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:32:20.703 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:32:20.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:32:50.833 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:32:50.836 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:33:20.999 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:33:21.002 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:33:51.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:33:51.136 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:34:21.293 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:34:21.296 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:34:51.451 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:34:51.454 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:35:21.607 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:35:21.610 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:35:51.736 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:35:51.739 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:36:21.884 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:36:21.887 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:36:52.006 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:36:52.009 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:37:22.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:37:22.139 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:37:52.266 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:37:52.269 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:38:22.390 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:38:22.393 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:38:52.529 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:38:52.534 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:39:22.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:39:22.650 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:39:52.777 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:39:52.780 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:40:22.931 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:40:22.934 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:40:53.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:40:53.088 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:41:23.198 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:41:23.201 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:41:53.320 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:41:53.337 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:42:23.466 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:42:23.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:42:53.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:42:53.607 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:43:23.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:43:23.871 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:43:53.993 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:43:53.996 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:44:24.093 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:44:24.096 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:44:54.246 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:44:54.249 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:45:24.344 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:45:24.348 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:45:54.490 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:45:54.493 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:46:24.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:46:24.656 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:46:54.808 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:46:54.811 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:47:24.918 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:47:24.922 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:47:55.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:47:55.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:48:25.139 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:48:25.144 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:48:55.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:48:55.333 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:49:25.424 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:49:25.428 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:49:55.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:49:55.579 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:50:25.697 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:50:25.700 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:50:55.778 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:50:55.781 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:51:25.942 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:51:25.945 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:51:56.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:51:56.085 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:52:26.235 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:52:26.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:52:56.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:52:56.359 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:53:26.437 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:53:26.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:53:56.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:53:56.578 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:54:26.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:54:26.708 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:54:56.869 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:54:56.871 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:55:26.975 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:55:26.978 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:55:57.112 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:55:57.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:56:27.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:56:27.274 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:56:57.420 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:56:57.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:57:27.559 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:57:27.563 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:57:57.665 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:57:57.668 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:58:27.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:58:27.838 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:58:58.008 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:58:58.011 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:59:28.147 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:59:28.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:59:58.294 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:59:59.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:00:29.225 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:00:29.228 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:00:59.344 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:00:59.347 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:01:29.474 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:01:29.478 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:01:59.639 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:01:59.642 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:02:29.783 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:02:35.366 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:03:05.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:03:05.459 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:03:35.612 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:03:35.615 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:04:05.776 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:04:05.779 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:04:35.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:04:35.925 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:05:06.068 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:05:06.072 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:05:36.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:05:36.136 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:06:06.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:06:06.283 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:06:36.422 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:06:36.426 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:07:06.578 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:07:06.581 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:07:36.724 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:07:36.727 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:08:06.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:08:06.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:08:37.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:08:37.040 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:09:07.138 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:09:07.141 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:09:37.279 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:09:37.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:10:07.432 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:10:07.435 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:10:37.589 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:10:37.592 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:11:07.671 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:11:07.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:11:37.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:11:37.788 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:12:07.849 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:12:07.853 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:12:37.913 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:12:37.917 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:13:07.972 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:13:07.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:13:38.044 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:13:38.047 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:14:08.106 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:14:08.110 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:14:38.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:14:38.190 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:15:08.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:15:08.335 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:15:38.478 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:15:38.481 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:16:08.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:16:08.619 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:16:38.735 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:16:38.738 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:08.858 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:08.861 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:39.022 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:39.025 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:18:09.234 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:18:09.239 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:18:39.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:18:39.350 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:19:09.495 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:19:09.499 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:19:39.649 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:19:39.653 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:20:09.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:20:09.790 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:20:39.924 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:20:39.927 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:21:10.103 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:21:10.106 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:21:40.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:21:40.269 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:22:10.406 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:22:10.409 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:22:40.535 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:22:40.538 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:23:10.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:23:10.667 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:23:40.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:23:40.897 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:24:11.039 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:24:11.043 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:24:41.212 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:24:41.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:25:11.374 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:25:11.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:25:41.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:25:41.533 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:26:11.676 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:26:11.679 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:26:37.631 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-28T05:26:37.632 DEBUG:teuthology.task.console_log:Killing console logger for smithi177 2023-11-28T05:26:37.632 DEBUG:teuthology.task.console_log:Killing console logger for smithi178 2023-11-28T05:26:37.633 DEBUG:teuthology.exit:Finished running handlers